CatalogManagerConfigurations/MasterStressTest.Test/3: Unrecognized error type. Please see the error log for more information.

Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN      ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-09-28T01:55:03Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-09-28T01:55:03Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260928 01:55:03.425750 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.62:38511
--webserver_interface=127.18.161.62
--webserver_port=0
--builtin_ntp_servers=127.18.161.20:32911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260928 01:55:03.737798 19085 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:55:03.738376 19085 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:55:03.738750 19085 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 01:55:03.773133 19085 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 01:55:03.773435 19085 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:55:03.773638 19085 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 01:55:03.773852 19085 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 01:55:03.813661 19085 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:32911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.62:38511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.161.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:55:03.815116 19085 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:55:03.817023 19085 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 01:55:03.830196 19091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:05.232511 19090 debug-util.cc:398] Leaking SignalData structure 0x7b0800034de0 after lost signal to thread 19085
W20260928 01:55:05.429733 19085 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.600s	user 0.678s	sys 0.918s
W20260928 01:55:03.830457 19092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:05.430125 19085 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.601s	user 0.679s	sys 0.918s
W20260928 01:55:05.432685 19094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:05.434934 19093 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1602 milliseconds
I20260928 01:55:05.435065 19085 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 01:55:05.436618 19085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:55:05.440346 19085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:55:05.441872 19085 hybrid_clock.cc:648] HybridClock initialized: now 1790560505441767 us; error 52 us; skew 500 ppm
I20260928 01:55:05.443194 19085 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:55:05.450448 19085 webserver.cc:533] Webserver started at http://127.18.161.62:44747/ using document root <none> and password file <none>
I20260928 01:55:05.451694 19085 fs_manager.cc:362] Metadata directory not provided
I20260928 01:55:05.451946 19085 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:55:05.452461 19085 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 01:55:05.456975 19085 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/data/instance:
uuid: "81ebb46a410e43ebaec3ef4dd13a71fc"
format_stamp: "Formatted at 2026-09-28 01:55:05 on dist-test-slave-lrdp"
I20260928 01:55:05.458240 19085 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/wal/instance:
uuid: "81ebb46a410e43ebaec3ef4dd13a71fc"
format_stamp: "Formatted at 2026-09-28 01:55:05 on dist-test-slave-lrdp"
I20260928 01:55:05.466161 19085 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.002s
I20260928 01:55:05.472573 19101 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:55:05.474141 19085 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260928 01:55:05.474578 19085 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/wal
uuid: "81ebb46a410e43ebaec3ef4dd13a71fc"
format_stamp: "Formatted at 2026-09-28 01:55:05 on dist-test-slave-lrdp"
I20260928 01:55:05.474993 19085 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:55:05.527756 19085 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:55:05.529397 19085 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:55:05.529883 19085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:55:05.604872 19085 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.62:38511
I20260928 01:55:05.604975 19152 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.62:38511 every 8 connection(s)
I20260928 01:55:05.608103 19085 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/data/info.pb
I20260928 01:55:05.610920 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 19085
I20260928 01:55:05.611522 19076 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-0/wal/instance
I20260928 01:55:05.615697 19153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:05.616256 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.61:43775
--webserver_interface=127.18.161.61
--webserver_port=0
--builtin_ntp_servers=127.18.161.20:32911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 01:55:05.627476 19153 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } has no permanent_uuid. Determining permanent_uuid...
I20260928 01:55:05.659910 19153 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } has no permanent_uuid. Determining permanent_uuid...
W20260928 01:55:05.662917 19102 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43775: connect: Connection refused (error 111)
W20260928 01:55:05.668054 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43775: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43775: connect: Connection refused (error 111)
I20260928 01:55:05.717664 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } attempt: 1
W20260928 01:55:05.722893 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43775: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43775: connect: Connection refused (error 111)
I20260928 01:55:05.791409 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } attempt: 2
W20260928 01:55:05.796307 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43775: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43775: connect: Connection refused (error 111)
I20260928 01:55:05.887801 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } attempt: 3
W20260928 01:55:05.892642 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43775: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43775: connect: Connection refused (error 111)
W20260928 01:55:05.954377 19155 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:55:05.954998 19155 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:55:05.955433 19155 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 01:55:05.992843 19155 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 01:55:05.993201 19155 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:55:05.993567 19155 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 01:55:05.993907 19155 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 01:55:06.035751 19155 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:32911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.61:43775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.161.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:55:06.036300 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } attempt: 4
I20260928 01:55:06.037410 19155 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:55:06.039887 19155 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 01:55:06.041666 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43775: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43775: connect: Connection refused (error 111)
W20260928 01:55:06.054549 19164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:55:06.341383 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } attempt: 5
W20260928 01:55:06.348281 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43775: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43775: connect: Connection refused (error 111)
I20260928 01:55:06.895812 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } attempt: 6
W20260928 01:55:06.922880 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43775: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43775: connect: Connection refused (error 111)
W20260928 01:55:06.055079 19165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:07.389591 19167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:07.393090 19166 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1336 milliseconds
W20260928 01:55:07.393143 19155 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.339s	user 0.501s	sys 0.829s
W20260928 01:55:07.393513 19155 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.339s	user 0.501s	sys 0.829s
I20260928 01:55:07.393813 19155 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 01:55:07.394930 19155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:55:07.397809 19155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:55:07.399236 19155 hybrid_clock.cc:648] HybridClock initialized: now 1790560507399202 us; error 49 us; skew 500 ppm
I20260928 01:55:07.400187 19155 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:55:07.408501 19155 webserver.cc:533] Webserver started at http://127.18.161.61:45413/ using document root <none> and password file <none>
I20260928 01:55:07.409547 19155 fs_manager.cc:362] Metadata directory not provided
I20260928 01:55:07.409821 19155 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:55:07.410300 19155 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 01:55:07.414992 19155 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/data/instance:
uuid: "c17b7f9972364c76893311539b569e0f"
format_stamp: "Formatted at 2026-09-28 01:55:07 on dist-test-slave-lrdp"
I20260928 01:55:07.416692 19155 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/wal/instance:
uuid: "c17b7f9972364c76893311539b569e0f"
format_stamp: "Formatted at 2026-09-28 01:55:07 on dist-test-slave-lrdp"
I20260928 01:55:07.426504 19155 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.004s	sys 0.004s
I20260928 01:55:07.433504 19176 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:55:07.435323 19155 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
I20260928 01:55:07.435748 19155 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/wal
uuid: "c17b7f9972364c76893311539b569e0f"
format_stamp: "Formatted at 2026-09-28 01:55:07 on dist-test-slave-lrdp"
I20260928 01:55:07.436136 19155 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:55:07.525978 19155 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:55:07.527570 19155 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:55:07.528084 19155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:55:07.603641 19155 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.61:43775
I20260928 01:55:07.603749 19227 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.61:43775 every 8 connection(s)
I20260928 01:55:07.606586 19155 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/data/info.pb
I20260928 01:55:07.607568 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 19155
I20260928 01:55:07.608114 19076 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-1/wal/instance
I20260928 01:55:07.612419 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.60:39095
--webserver_interface=127.18.161.60
--webserver_port=0
--builtin_ntp_servers=127.18.161.20:32911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 01:55:07.615692 19228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:07.628402 19228 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } has no permanent_uuid. Determining permanent_uuid...
I20260928 01:55:07.654450 19228 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } has no permanent_uuid. Determining permanent_uuid...
I20260928 01:55:07.672240 19228 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } has no permanent_uuid. Determining permanent_uuid...
W20260928 01:55:07.675071 19179 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
W20260928 01:55:07.679697 19228 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:07.729396 19228 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 1
W20260928 01:55:07.734262 19228 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:07.802731 19228 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 2
W20260928 01:55:07.807586 19228 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:07.899015 19228 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 3
W20260928 01:55:07.903708 19228 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
W20260928 01:55:07.942523 19230 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:55:07.943373 19230 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:55:07.943872 19230 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 01:55:07.978027 19230 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 01:55:07.978396 19230 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:55:07.978655 19230 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 01:55:07.978916 19230 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 01:55:07.983497 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } attempt: 7
I20260928 01:55:07.995538 19153 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } has no permanent_uuid. Determining permanent_uuid...
W20260928 01:55:08.001797 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:08.021111 19230 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:32911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.60:39095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.161.60
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:55:08.022491 19230 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:55:08.024289 19230 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 01:55:08.036595 19242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:55:08.047149 19228 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 4
W20260928 01:55:08.053112 19228 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:08.060374 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 1
W20260928 01:55:08.067337 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:08.148957 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 2
W20260928 01:55:08.155886 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:08.241490 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 3
W20260928 01:55:08.248700 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:08.352608 19228 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 5
W20260928 01:55:08.359300 19228 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:08.389281 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 4
W20260928 01:55:08.395637 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:08.679291 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 5
W20260928 01:55:08.685673 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:08.906890 19228 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 6
W20260928 01:55:08.918622 19228 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
W20260928 01:55:08.039932 19243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:08.041548 19245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:09.208747 19244 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1166 milliseconds
I20260928 01:55:09.208887 19230 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 01:55:09.210157 19230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:55:09.212849 19230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:55:09.214233 19230 hybrid_clock.cc:648] HybridClock initialized: now 1790560509214201 us; error 49 us; skew 500 ppm
I20260928 01:55:09.215126 19230 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:55:09.222255 19230 webserver.cc:533] Webserver started at http://127.18.161.60:34303/ using document root <none> and password file <none>
I20260928 01:55:09.223651 19230 fs_manager.cc:362] Metadata directory not provided
I20260928 01:55:09.223939 19230 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:55:09.224653 19230 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 01:55:09.229312 19230 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data/instance:
uuid: "04e48edd841a42d08a480be209f0d294"
format_stamp: "Formatted at 2026-09-28 01:55:09 on dist-test-slave-lrdp"
I20260928 01:55:09.230556 19230 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/wal/instance:
uuid: "04e48edd841a42d08a480be209f0d294"
format_stamp: "Formatted at 2026-09-28 01:55:09 on dist-test-slave-lrdp"
I20260928 01:55:09.238278 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 6
I20260928 01:55:09.239908 19230 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.004s
W20260928 01:55:09.245793 19153 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:39095: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:09.248257 19256 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:55:09.249698 19230 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
I20260928 01:55:09.250082 19230 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/wal
uuid: "04e48edd841a42d08a480be209f0d294"
format_stamp: "Formatted at 2026-09-28 01:55:09 on dist-test-slave-lrdp"
I20260928 01:55:09.250451 19230 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:55:09.312428 19230 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:55:09.313947 19230 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:55:09.314383 19230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:55:09.385522 19230 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.60:39095
I20260928 01:55:09.385612 19307 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.60:39095 every 8 connection(s)
I20260928 01:55:09.388397 19230 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
I20260928 01:55:09.389297 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 19230
I20260928 01:55:09.389832 19076 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/wal/instance
I20260928 01:55:09.396584 19308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:09.414780 19308 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } has no permanent_uuid. Determining permanent_uuid...
I20260928 01:55:09.440064 19308 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } has no permanent_uuid. Determining permanent_uuid...
I20260928 01:55:09.454449 19308 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } has no permanent_uuid. Determining permanent_uuid...
I20260928 01:55:09.471983 19308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Bootstrap starting.
I20260928 01:55:09.479038 19308 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:09.481184 19308 log.cc:826] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Log is configured to *not* fsync() on all Append() calls
I20260928 01:55:09.486852 19308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: No bootstrap required, opened a new log
I20260928 01:55:09.506657 19308 raft_consensus.cc:359] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:09.507402 19308 raft_consensus.cc:385] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:09.507726 19308 raft_consensus.cc:740] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e48edd841a42d08a480be209f0d294, State: Initialized, Role: FOLLOWER
I20260928 01:55:09.508805 19308 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:09.512084 19318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:09.512830 19318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:09.513782 19308 sys_catalog.cc:565] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 01:55:09.525403 19318 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:09.526087 19318 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:09.529811 19318 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
W20260928 01:55:09.545943 19329 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:55:09.546401 19329 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:55:09.569641 19262 tablet.cc:2433] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 01:55:09.538121 19230 master_runner.cc:187] Error getting master registration for 127.18.161.62:38511: OK, instance_id { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" instance_seqno: 1790560505584243 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 01:55:09.572515 19230 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:55:09.979211 19228 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 7
I20260928 01:55:10.007517 19228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: Bootstrap starting.
I20260928 01:55:10.014667 19228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:10.016633 19228 log.cc:826] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: Log is configured to *not* fsync() on all Append() calls
I20260928 01:55:10.021700 19228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: No bootstrap required, opened a new log
I20260928 01:55:10.051105 19228 raft_consensus.cc:359] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:10.052016 19228 raft_consensus.cc:385] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:10.052382 19228 raft_consensus.cc:740] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c17b7f9972364c76893311539b569e0f, State: Initialized, Role: FOLLOWER
I20260928 01:55:10.053442 19228 consensus_queue.cc:260] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:10.056423 19334 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:10.057294 19334 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:10.058432 19228 sys_catalog.cc:565] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: configured and running, proceeding with master startup.
I20260928 01:55:10.058638 19203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:10.059872 19203 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e48edd841a42d08a480be209f0d294 in term 0.
W20260928 01:55:10.060706 19203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33288 (request call id 1) took 530 ms (client timeout 612 ms). Trace:
W20260928 01:55:10.064628 19203 rpcz_store.cc:269] 0928 01:55:09.529937 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:09.530081 (+   144us) service_pool.cc:224] Handling call
0928 01:55:10.060617 (+530536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:10.067078 19257 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f; no voters: 
I20260928 01:55:10.070374 19336 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:10.070796 19336 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:10.071123 19336 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:10.078311 19336 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:10.082273 19203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f"
I20260928 01:55:10.082639 19336 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 1 election: Requested vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:55:10.083094 19203 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:10.093411 19203 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e48edd841a42d08a480be209f0d294 in term 1.
I20260928 01:55:10.095458 19257 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f; no voters: 
I20260928 01:55:10.096568 19336 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:10.108708 19336 raft_consensus.cc:697] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 1 LEADER]: Becoming Leader. State: Replica: 04e48edd841a42d08a480be209f0d294, State: Running, Role: LEADER
I20260928 01:55:10.109793 19336 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:10.125517 19341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e48edd841a42d08a480be209f0d294. Latest consensus state: current_term: 1 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:10.126425 19341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: LEADER
W20260928 01:55:10.131762 19348 catalog_manager.cc:1607] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:55:10.132148 19348 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:55:10.137526 19350 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
W20260928 01:55:10.142261 19259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.612s (SENT)
I20260928 01:55:10.145740 19350 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 01:55:10.171523 19203 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Refusing update from remote peer 04e48edd841a42d08a480be209f0d294: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 01:55:10.173797 19341 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:10.128696 19155 master_runner.cc:187] Error getting master registration for 127.18.161.62:38511: OK, instance_id { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" instance_seqno: 1790560505584243 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 01:55:10.183164 19155 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:55:10.221868 19334 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e48edd841a42d08a480be209f0d294. Latest consensus state: current_term: 1 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:10.222671 19334 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:10.231365 19341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:10.232239 19341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: LEADER
I20260928 01:55:10.233609 19350 catalog_manager.cc:1396] Generated new cluster ID: 726a03a5ce124d548da65567db2a283d
I20260928 01:55:10.233955 19350 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:55:10.237751 19334 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:10.238531 19334 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:10.279258 19153 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } attempt: 7
I20260928 01:55:10.299368 19350 catalog_manager.cc:1419] Generated new certificate authority record
I20260928 01:55:10.320175 19350 catalog_manager.cc:1553] Loading token signing keys...
I20260928 01:55:10.344792 19153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Bootstrap starting.
I20260928 01:55:10.362870 19153 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:10.365609 19153 log.cc:826] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Log is configured to *not* fsync() on all Append() calls
I20260928 01:55:10.377329 19153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: No bootstrap required, opened a new log
I20260928 01:55:10.417943 19153 raft_consensus.cc:359] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:10.418962 19153 raft_consensus.cc:385] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:10.419405 19153 raft_consensus.cc:740] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81ebb46a410e43ebaec3ef4dd13a71fc, State: Initialized, Role: FOLLOWER
I20260928 01:55:10.420712 19153 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:10.429580 19360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:10.433529 19360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:10.433709 19125 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:10.436494 19128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
W20260928 01:55:10.437721 19128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42974 (request call id 1) took 908 ms (client timeout 612 ms). Trace:
W20260928 01:55:10.438114 19128 rpcz_store.cc:269] 0928 01:55:09.529773 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:09.529936 (+   163us) service_pool.cc:224] Handling call
0928 01:55:10.437616 (+907680us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:10.439359 19127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc"
I20260928 01:55:10.440634 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:10.447999 19125 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Refusing update from remote peer 04e48edd841a42d08a480be209f0d294: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 01:55:10.433107 19153 sys_catalog.cc:565] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: configured and running, proceeding with master startup.
I20260928 01:55:10.450045 19341 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:10.467921 19350 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Generated new TSK 0
I20260928 01:55:10.469120 19350 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 01:55:10.495822 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.161.1:0
--local_ip_for_outbound_sockets=127.18.161.1
--webserver_interface=127.18.161.1
--webserver_port=0
--tserver_master_addrs=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--builtin_ntp_servers=127.18.161.20:32911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 01:55:10.549423 19360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e48edd841a42d08a480be209f0d294. Latest consensus state: current_term: 1 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:10.550472 19360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:10.551489 19369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:10.552681 19369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:10.556123 19336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:10.556875 19336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: LEADER
I20260928 01:55:10.576884 19377 catalog_manager.cc:818] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 01:55:10.987569 19378 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:10.988323 19378 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:10.992128 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:10.993884 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:10.996573 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:11.006558 19378 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:11.008030 19378 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:55:11.080540 19366 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:55:11.081256 19366 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:55:11.082173 19366 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260928 01:55:11.138408 19348 catalog_manager.cc:1308] Loaded cluster ID: 726a03a5ce124d548da65567db2a283d
I20260928 01:55:11.138844 19348 catalog_manager.cc:1601] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: loading cluster ID for follower catalog manager: success
W20260928 01:55:11.148006 19366 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:55:11.149600 19366 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.161.1
I20260928 01:55:11.153818 19348 catalog_manager.cc:1623] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: acquiring CA information for follower catalog manager: success
I20260928 01:55:11.162007 19348 catalog_manager.cc:1651] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 01:55:11.219244 19366 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:32911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.161.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.161.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.161.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:55:11.221104 19366 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:55:11.223487 19366 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 01:55:11.249472 19386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:55:11.530258 19391 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:11.531174 19391 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:11.535056 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:11.539743 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:11.542490 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:55:11.549028 19392 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:11.549376 19391 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:11.613572 19377 catalog_manager.cc:1308] Loaded cluster ID: 726a03a5ce124d548da65567db2a283d
I20260928 01:55:11.613991 19377 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: loading cluster ID for follower catalog manager: success
I20260928 01:55:11.634008 19377 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: acquiring CA information for follower catalog manager: success
I20260928 01:55:11.665076 19377 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 01:55:12.042306 19394 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:12.048696 19394 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:12.052640 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:12.053045 19394 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:12.054951 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:12.058596 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:12.059422 19394 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:12.087764 19395 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:12.088472 19395 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:12.093015 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:12.094419 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:12.096809 19102 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:55:12.100575 19395 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:12.101305 19395 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:12.577134 19397 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:12.578114 19397 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:12.590333 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:12.594823 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:12.596932 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:12.601578 19397 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:12.603461 19397 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:12.674947 19399 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:12.676815 19399 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:12.680749 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:12.684616 19399 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:12.685925 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:12.687955 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:55:12.688786 19399 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:13.562937 19401 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:13.563654 19401 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:13.566521 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:13.582264 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:13.584649 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:13.586172 19401 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:13.587862 19401 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:55:12.643764 19384 debug-util.cc:398] Leaking SignalData structure 0x7b0800037180 after lost signal to thread 19366
W20260928 01:55:13.807876 19366 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.566s	user 0.643s	sys 0.885s
W20260928 01:55:13.808873 19366 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.567s	user 0.643s	sys 0.885s
W20260928 01:55:11.252872 19385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:13.810137 19387 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2566 milliseconds
I20260928 01:55:13.811028 19366 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
W20260928 01:55:13.811097 19388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:55:13.815181 19366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:55:13.817793 19366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:55:13.819245 19366 hybrid_clock.cc:648] HybridClock initialized: now 1790560513819197 us; error 61 us; skew 500 ppm
I20260928 01:55:13.820538 19366 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:55:13.828397 19366 webserver.cc:533] Webserver started at http://127.18.161.1:33691/ using document root <none> and password file <none>
I20260928 01:55:13.829497 19366 fs_manager.cc:362] Metadata directory not provided
I20260928 01:55:13.829751 19366 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:55:13.830294 19366 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 01:55:13.835711 19366 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/data/instance:
uuid: "37089d44fdba4b6488b5b5aea28af614"
format_stamp: "Formatted at 2026-09-28 01:55:13 on dist-test-slave-lrdp"
I20260928 01:55:13.837103 19366 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/instance:
uuid: "37089d44fdba4b6488b5b5aea28af614"
format_stamp: "Formatted at 2026-09-28 01:55:13 on dist-test-slave-lrdp"
I20260928 01:55:13.846195 19366 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.004s
I20260928 01:55:13.852895 19408 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:55:13.854419 19366 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.000s	sys 0.004s
I20260928 01:55:13.854828 19366 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal
uuid: "37089d44fdba4b6488b5b5aea28af614"
format_stamp: "Formatted at 2026-09-28 01:55:13 on dist-test-slave-lrdp"
I20260928 01:55:13.855383 19366 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:55:13.917451 19366 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:55:13.919045 19366 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:55:13.919564 19366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:55:13.922976 19366 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260928 01:55:13.928723 19366 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 01:55:13.928959 19366 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:55:13.929256 19366 ts_tablet_manager.cc:616] Registered 0 tablets
I20260928 01:55:13.929455 19366 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:55:14.098898 19366 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.1:41953
I20260928 01:55:14.099220 19520 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.1:41953 every 8 connection(s)
I20260928 01:55:14.101505 19366 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/data/info.pb
I20260928 01:55:14.104353 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 19366
I20260928 01:55:14.104930 19076 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/instance
I20260928 01:55:14.129284 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.161.2:0
--local_ip_for_outbound_sockets=127.18.161.2
--webserver_interface=127.18.161.2
--webserver_port=0
--tserver_master_addrs=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--builtin_ntp_servers=127.18.161.20:32911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 01:55:14.140895 19525 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:14.141523 19525 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:14.155548 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:14.157673 19525 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:14.161945 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:14.163870 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:14.164776 19525 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:14.171099 19521 heartbeater.cc:344] Connected to a master server at 127.18.161.60:39095
I20260928 01:55:14.171571 19521 heartbeater.cc:461] Registering TS with master...
I20260928 01:55:14.173026 19521 heartbeater.cc:507] Master 127.18.161.60:39095 requested a full tablet report, sending...
I20260928 01:55:14.176440 19273 ts_manager.cc:194] Registered new tserver with Master: 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:14.179243 19273 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.18.161.1:43189
I20260928 01:55:14.186244 19527 heartbeater.cc:344] Connected to a master server at 127.18.161.62:38511
I20260928 01:55:14.186651 19527 heartbeater.cc:461] Registering TS with master...
I20260928 01:55:14.187569 19527 heartbeater.cc:507] Master 127.18.161.62:38511 requested a full tablet report, sending...
I20260928 01:55:14.188017 19522 heartbeater.cc:344] Connected to a master server at 127.18.161.61:43775
I20260928 01:55:14.188454 19522 heartbeater.cc:461] Registering TS with master...
I20260928 01:55:14.189095 19522 heartbeater.cc:507] Master 127.18.161.61:43775 requested a full tablet report, sending...
I20260928 01:55:14.191810 19118 ts_manager.cc:194] Registered new tserver with Master: 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:14.192381 19193 ts_manager.cc:194] Registered new tserver with Master: 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:14.449137 19533 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:14.449815 19533 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:14.453320 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:14.455298 19533 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:14.457139 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:14.459167 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:55:14.460247 19533 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:55:14.497946 19526 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:55:14.498504 19526 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:55:14.499261 19526 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 01:55:14.536185 19526 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:55:14.537464 19526 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.161.2
I20260928 01:55:14.581168 19526 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:32911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.161.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.161.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.161.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:55:14.582763 19526 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:55:14.584874 19526 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 01:55:14.600806 19539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:55:14.684085 19521 heartbeater.cc:499] Master 127.18.161.60:39095 was elected leader, sending a full tablet report...
I20260928 01:55:15.170679 19545 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:15.171087 19545 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:15.172724 19545 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:15.173940 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:15.173939 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:15.175693 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:15.176301 19545 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:15.729769 19546 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:15.730273 19546 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:15.732288 19546 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:15.733603 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:15.733731 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:15.735828 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:15.736727 19546 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:55:14.610904 19542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:14.606509 19540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:15.900251 19541 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1292 milliseconds
I20260928 01:55:15.900403 19526 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 01:55:15.901713 19526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:55:15.904461 19526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:55:15.905970 19526 hybrid_clock.cc:648] HybridClock initialized: now 1790560515905907 us; error 80 us; skew 500 ppm
I20260928 01:55:15.906917 19526 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:55:15.913430 19526 webserver.cc:533] Webserver started at http://127.18.161.2:44857/ using document root <none> and password file <none>
I20260928 01:55:15.914408 19526 fs_manager.cc:362] Metadata directory not provided
I20260928 01:55:15.914650 19526 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:55:15.915107 19526 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 01:55:15.919561 19526 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/data/instance:
uuid: "a3ee288ca1464d20a715673422a214a0"
format_stamp: "Formatted at 2026-09-28 01:55:15 on dist-test-slave-lrdp"
I20260928 01:55:15.920773 19526 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/instance:
uuid: "a3ee288ca1464d20a715673422a214a0"
format_stamp: "Formatted at 2026-09-28 01:55:15 on dist-test-slave-lrdp"
I20260928 01:55:15.928889 19526 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260928 01:55:15.935374 19551 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:55:15.936993 19526 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260928 01:55:15.937454 19526 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal
uuid: "a3ee288ca1464d20a715673422a214a0"
format_stamp: "Formatted at 2026-09-28 01:55:15 on dist-test-slave-lrdp"
I20260928 01:55:15.937917 19526 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:55:15.977473 19554 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:15.978017 19554 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:15.980146 19554 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:15.981415 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:15.982003 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:15.983824 19102 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:55:15.984629 19554 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:15.992604 19526 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:55:15.994201 19526 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:55:15.994676 19526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:55:15.997984 19526 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260928 01:55:16.002682 19526 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 01:55:16.002964 19526 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:55:16.003269 19526 ts_tablet_manager.cc:616] Registered 0 tablets
I20260928 01:55:16.003481 19526 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:55:16.150200 19526 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.2:33591
I20260928 01:55:16.150326 19665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.2:33591 every 8 connection(s)
I20260928 01:55:16.152961 19526 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/data/info.pb
I20260928 01:55:16.159804 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 19526
I20260928 01:55:16.160934 19076 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/instance
I20260928 01:55:16.180500 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.161.3:0
--local_ip_for_outbound_sockets=127.18.161.3
--webserver_interface=127.18.161.3
--webserver_port=0
--tserver_master_addrs=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--builtin_ntp_servers=127.18.161.20:32911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 01:55:16.208107 19668 heartbeater.cc:344] Connected to a master server at 127.18.161.62:38511
I20260928 01:55:16.208670 19668 heartbeater.cc:461] Registering TS with master...
I20260928 01:55:16.209425 19667 heartbeater.cc:344] Connected to a master server at 127.18.161.61:43775
I20260928 01:55:16.209766 19667 heartbeater.cc:461] Registering TS with master...
I20260928 01:55:16.210009 19668 heartbeater.cc:507] Master 127.18.161.62:38511 requested a full tablet report, sending...
I20260928 01:55:16.210942 19667 heartbeater.cc:507] Master 127.18.161.61:43775 requested a full tablet report, sending...
I20260928 01:55:16.214164 19118 ts_manager.cc:194] Registered new tserver with Master: a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:16.215133 19666 heartbeater.cc:344] Connected to a master server at 127.18.161.60:39095
I20260928 01:55:16.215507 19666 heartbeater.cc:461] Registering TS with master...
I20260928 01:55:16.215687 19193 ts_manager.cc:194] Registered new tserver with Master: a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:16.216553 19666 heartbeater.cc:507] Master 127.18.161.60:39095 requested a full tablet report, sending...
I20260928 01:55:16.218613 19273 ts_manager.cc:194] Registered new tserver with Master: a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:16.219873 19273 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.18.161.2:40777
I20260928 01:55:16.499035 19681 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:16.499445 19681 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:16.501128 19681 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:16.501983 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:16.502401 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:16.503971 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:55:16.504937 19681 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:55:16.531476 19676 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:55:16.532081 19676 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:55:16.532670 19676 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 01:55:16.567858 19676 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:55:16.568873 19676 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.161.3
I20260928 01:55:16.609014 19676 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:32911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.161.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.161.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.161.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:55:16.610694 19676 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:55:16.612527 19676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 01:55:16.631299 19684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:55:16.725050 19666 heartbeater.cc:499] Master 127.18.161.60:39095 was elected leader, sending a full tablet report...
I20260928 01:55:16.780704 19689 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:16.781503 19689 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:16.785147 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:16.785895 19689 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:16.787774 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:16.789842 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:16.791371 19689 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:17.384020 19690 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:17.384943 19690 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:17.394347 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:17.398607 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:17.400786 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:17.403095 19690 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:17.405850 19690 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:17.453373 19692 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:17.454140 19692 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:17.457772 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:17.462579 19283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:17.464885 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:55:17.469944 19692 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:17.471323 19692 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:55:18.031963 19682 debug-util.cc:398] Leaking SignalData structure 0x7b0800037180 after lost signal to thread 19676
W20260928 01:55:18.204727 19682 kernel_stack_watchdog.cc:198] Thread 19676 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 396ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260928 01:55:18.205477 19676 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.573s	user 0.634s	sys 0.916s
W20260928 01:55:16.632082 19683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:18.206064 19676 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.573s	user 0.635s	sys 0.916s
W20260928 01:55:18.208389 19686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:18.211108 19685 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1569 milliseconds
I20260928 01:55:18.211153 19676 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 01:55:18.212577 19676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:55:18.214855 19676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:55:18.216328 19676 hybrid_clock.cc:648] HybridClock initialized: now 1790560518216276 us; error 53 us; skew 500 ppm
I20260928 01:55:18.217244 19676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:55:18.224637 19676 webserver.cc:533] Webserver started at http://127.18.161.3:44399/ using document root <none> and password file <none>
I20260928 01:55:18.225621 19676 fs_manager.cc:362] Metadata directory not provided
I20260928 01:55:18.225840 19676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:55:18.226275 19676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 01:55:18.230786 19676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/data/instance:
uuid: "8373bfae1f384c36b5e4c5ca26b208da"
format_stamp: "Formatted at 2026-09-28 01:55:18 on dist-test-slave-lrdp"
I20260928 01:55:18.232012 19676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/instance:
uuid: "8373bfae1f384c36b5e4c5ca26b208da"
format_stamp: "Formatted at 2026-09-28 01:55:18 on dist-test-slave-lrdp"
I20260928 01:55:18.240849 19676 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.002s
I20260928 01:55:18.247630 19700 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:55:18.249120 19676 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.001s
I20260928 01:55:18.249512 19676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal
uuid: "8373bfae1f384c36b5e4c5ca26b208da"
format_stamp: "Formatted at 2026-09-28 01:55:18 on dist-test-slave-lrdp"
I20260928 01:55:18.249841 19676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:55:18.310676 19676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:55:18.312367 19676 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:55:18.312839 19676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:55:18.315527 19676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260928 01:55:18.319983 19676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 01:55:18.320261 19676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260928 01:55:18.320547 19676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260928 01:55:18.320713 19676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:55:18.463335 19676 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.3:44521
I20260928 01:55:18.463444 19812 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.3:44521 every 8 connection(s)
I20260928 01:55:18.466102 19676 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/data/info.pb
I20260928 01:55:18.468305 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 19676
I20260928 01:55:18.468828 19076 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/instance
I20260928 01:55:18.523090 19814 heartbeater.cc:344] Connected to a master server at 127.18.161.61:43775
I20260928 01:55:18.523640 19814 heartbeater.cc:461] Registering TS with master...
I20260928 01:55:18.524379 19813 heartbeater.cc:344] Connected to a master server at 127.18.161.60:39095
I20260928 01:55:18.524544 19815 heartbeater.cc:344] Connected to a master server at 127.18.161.62:38511
I20260928 01:55:18.524752 19813 heartbeater.cc:461] Registering TS with master...
I20260928 01:55:18.524858 19815 heartbeater.cc:461] Registering TS with master...
I20260928 01:55:18.525189 19814 heartbeater.cc:507] Master 127.18.161.61:43775 requested a full tablet report, sending...
I20260928 01:55:18.525770 19813 heartbeater.cc:507] Master 127.18.161.60:39095 requested a full tablet report, sending...
I20260928 01:55:18.525866 19815 heartbeater.cc:507] Master 127.18.161.62:38511 requested a full tablet report, sending...
I20260928 01:55:18.528131 19273 ts_manager.cc:194] Registered new tserver with Master: 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:18.528434 19117 ts_manager.cc:194] Registered new tserver with Master: 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:18.528461 19193 ts_manager.cc:194] Registered new tserver with Master: 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:18.530004 19273 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.18.161.3:49041
I20260928 01:55:18.542227 19076 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260928 01:55:18.600092 19272 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53670:
name: "default.Table_35e1185d8a634d25a18a9b67e3ddfb11"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:18.601138 19271 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53670:
name: "default.Table_95c5e6cdf14a4d1897fdbea64e22e1e6"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:18.600112 19273 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53670:
name: "default.Table_7f92037687c64fcb900a146f4b4163b6"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:18.602535 19270 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53670:
name: "default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:18.604454 19273 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f92037687c64fcb900a146f4b4163b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:18.605253 19271 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95c5e6cdf14a4d1897fdbea64e22e1e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:18.613484 19272 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:18.610749 19270 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:18.706290 19076 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu with pid 19230
W20260928 01:55:18.729238 19178 connection.cc:573] server connection from 127.0.0.1:33288 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:55:18.730252 19411 connection.cc:573] client connection to 127.18.161.60:39095 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:55:18.730818 19102 connection.cc:573] server connection from 127.0.0.1:42974 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:55:18.731608 19521 heartbeater.cc:646] Failed to heartbeat to 127.18.161.60:39095 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:55:18.768357 19666 heartbeater.cc:646] Failed to heartbeat to 127.18.161.60:39095 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:19.033600 19813 heartbeater.cc:499] Master 127.18.161.60:39095 was elected leader, sending a full tablet report...
W20260928 01:55:19.038087 19813 heartbeater.cc:646] Failed to heartbeat to 127.18.161.60:39095 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:19.197180 19859 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:19.197592 19859 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:19.199213 19859 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:19.200242 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
W20260928 01:55:19.202468 19179 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111) [suppressed 6 similar messages]
W20260928 01:55:19.207530 19179 leader_election.cc:336] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095): Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:19.207784 19862 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:19.207903 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:19.208578 19859 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:19.208412 19862 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:19.210995 19862 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:19.211679 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:19.212450 19202 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81ebb46a410e43ebaec3ef4dd13a71fc in term 1.
I20260928 01:55:19.213814 19102 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f; no voters: 
W20260928 01:55:19.214460 19104 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111) [suppressed 13 similar messages]
I20260928 01:55:19.214582 19862 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:55:19.214891 19862 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:19.215246 19862 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:55:19.218925 19104 leader_election.cc:336] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095): Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:19.221753 19862 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:19.223784 19862 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 election: Requested vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:19.224742 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f"
I20260928 01:55:19.225574 19202 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:55:19.229255 19104 leader_election.cc:336] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095): Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:19.233299 19202 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81ebb46a410e43ebaec3ef4dd13a71fc in term 2.
I20260928 01:55:19.234447 19102 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294
I20260928 01:55:19.235761 19862 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:55:19.237294 19862 raft_consensus.cc:697] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 2 LEADER]: Becoming Leader. State: Replica: 81ebb46a410e43ebaec3ef4dd13a71fc, State: Running, Role: LEADER
I20260928 01:55:19.238520 19862 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:19.243130 19866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81ebb46a410e43ebaec3ef4dd13a71fc. Latest consensus state: current_term: 2 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:19.244163 19866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: LEADER
W20260928 01:55:19.644068 19104 consensus_peers.cc:597] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc -> Peer 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095): Couldn't send request to peer 04e48edd841a42d08a480be209f0d294. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:19.708633 19202 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Refusing update from remote peer 81ebb46a410e43ebaec3ef4dd13a71fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260928 01:55:19.710309 19866 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260928 01:55:19.715814 19870 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81ebb46a410e43ebaec3ef4dd13a71fc. Latest consensus state: current_term: 2 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:19.716534 19870 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:19.734138 19870 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:19.734829 19870 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:19.734758 19866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:19.735423 19866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: LEADER
I20260928 01:55:19.764876 19867 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 01:55:19.773566 19867 catalog_manager.cc:692] Loaded metadata for table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]
I20260928 01:55:19.775462 19867 catalog_manager.cc:692] Loaded metadata for table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e]
I20260928 01:55:19.777120 19867 catalog_manager.cc:692] Loaded metadata for table default.Table_95c5e6cdf14a4d1897fdbea64e22e1e6 [id=df2128aeb5ef482d9d29826bb71e0e10]
I20260928 01:55:19.785555 19867 tablet_loader.cc:96] loaded metadata for tablet 31d1535707ae4fa89a605a551c5cfb9e (table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006])
I20260928 01:55:19.787292 19867 tablet_loader.cc:96] loaded metadata for tablet c2597de2c4304074977db5a3c0426814 (table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e])
I20260928 01:55:19.790778 19867 tablet_loader.cc:96] loaded metadata for tablet d54979e5a0f74cc2a281792669506fdb (table default.Table_95c5e6cdf14a4d1897fdbea64e22e1e6 [id=df2128aeb5ef482d9d29826bb71e0e10])
I20260928 01:55:19.792446 19867 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 01:55:19.797226 19867 catalog_manager.cc:1308] Loaded cluster ID: 726a03a5ce124d548da65567db2a283d
I20260928 01:55:19.797634 19867 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:55:19.802881 19867 catalog_manager.cc:1553] Loading token signing keys...
I20260928 01:55:19.807616 19867 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Loaded TSK: 0
I20260928 01:55:19.809135 19867 catalog_manager.cc:1563] Initializing in-progress tserver states...
W20260928 01:55:18.728812 19825 connection.cc:573] client connection to 127.18.161.60:39095 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 01:55:19.965581 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.60:39095
--webserver_interface=127.18.161.60
--webserver_port=34303
--builtin_ntp_servers=127.18.161.20:32911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260928 01:55:19.975272 19825 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.18.161.60:39095)
W20260928 01:55:19.976689 19825 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.18.161.60:39095)
I20260928 01:55:19.988379 19117 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_95c5e6cdf14a4d1897fdbea64e22e1e6" } new_table_name: "default.Table_97c550b41ad24bc09f66cc5e6ac37e2a" modify_external_catalogs: true
I20260928 01:55:19.988936 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:19.991016 19115 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_35e1185d8a634d25a18a9b67e3ddfb11"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:19.990031 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_1da54e4ef467448f8cbdafd75024e1ca"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:19.990123 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_7f92037687c64fcb900a146f4b4163b6"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:20.012702 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:20.012713 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1da54e4ef467448f8cbdafd75024e1ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:20.013561 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f92037687c64fcb900a146f4b4163b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:20.013845 19115 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:20.020875 19115 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_30960d9db7f443448ea569665dce1dcc"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:20.022342 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_de8e96d7d6d24f81bf383241fad9f8cc"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:20.025470 19115 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30960d9db7f443448ea569665dce1dcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:20.026654 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de8e96d7d6d24f81bf383241fad9f8cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:20.036013 19117 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d54979e5a0f74cc2a281792669506fdb has no consensus state
I20260928 01:55:20.062780 19115 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_97c550b41ad24bc09f66cc5e6ac37e2a" } new_table_name: "default.Table_151d9e01bde94ff6973614638f15e59b" modify_external_catalogs: true
I20260928 01:55:20.064355 19114 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_1da54e4ef467448f8cbdafd75024e1ca" } modify_external_catalogs: true
I20260928 01:55:20.064975 19114 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_1da54e4ef467448f8cbdafd75024e1ca" } modify_external_catalogs: true
I20260928 01:55:20.072765 19117 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_30960d9db7f443448ea569665dce1dcc" } modify_external_catalogs: true
I20260928 01:55:20.073361 19117 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_30960d9db7f443448ea569665dce1dcc" } modify_external_catalogs: true
W20260928 01:55:20.085584 19104 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet d54979e5a0f74cc2a281792669506fdb (table default.Table_97c550b41ad24bc09f66cc5e6ac37e2a [id=df2128aeb5ef482d9d29826bb71e0e10], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d54979e5a0f74cc2a281792669506fdb has no consensus state
W20260928 01:55:20.133154 19115 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d54979e5a0f74cc2a281792669506fdb consensus state has no leader
I20260928 01:55:20.133426 19114 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 624571795246419fa8168574a07e2234
I20260928 01:55:20.141994 19600 tablet_service.cc:1511] Processing CreateTablet for tablet d54979e5a0f74cc2a281792669506fdb (DEFAULT_TABLE table=default.Table_97c550b41ad24bc09f66cc5e6ac37e2a [id=df2128aeb5ef482d9d29826bb71e0e10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.144073 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54979e5a0f74cc2a281792669506fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.148849 19601 tablet_service.cc:1511] Processing CreateTablet for tablet c2597de2c4304074977db5a3c0426814 (DEFAULT_TABLE table=default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.150101 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2597de2c4304074977db5a3c0426814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.153127 19117 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet ea93fd0ea3fe4207b99771fadc80399e
I20260928 01:55:20.149900 19456 tablet_service.cc:1511] Processing CreateTablet for tablet c2597de2c4304074977db5a3c0426814 (DEFAULT_TABLE table=default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.155301 19455 tablet_service.cc:1511] Processing CreateTablet for tablet d54979e5a0f74cc2a281792669506fdb (DEFAULT_TABLE table=default.Table_97c550b41ad24bc09f66cc5e6ac37e2a [id=df2128aeb5ef482d9d29826bb71e0e10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.156324 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2597de2c4304074977db5a3c0426814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.156064 19454 tablet_service.cc:1511] Processing CreateTablet for tablet 31d1535707ae4fa89a605a551c5cfb9e (DEFAULT_TABLE table=default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.157311 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d1535707ae4fa89a605a551c5cfb9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.159863 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54979e5a0f74cc2a281792669506fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.160548 19599 tablet_service.cc:1511] Processing CreateTablet for tablet 31d1535707ae4fa89a605a551c5cfb9e (DEFAULT_TABLE table=default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.162786 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d1535707ae4fa89a605a551c5cfb9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.209735 19748 tablet_service.cc:1511] Processing CreateTablet for tablet c2597de2c4304074977db5a3c0426814 (DEFAULT_TABLE table=default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.211727 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2597de2c4304074977db5a3c0426814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.218089 19747 tablet_service.cc:1511] Processing CreateTablet for tablet d54979e5a0f74cc2a281792669506fdb (DEFAULT_TABLE table=default.Table_97c550b41ad24bc09f66cc5e6ac37e2a [id=df2128aeb5ef482d9d29826bb71e0e10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.219314 19747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54979e5a0f74cc2a281792669506fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.226186 19746 tablet_service.cc:1511] Processing CreateTablet for tablet 31d1535707ae4fa89a605a551c5cfb9e (DEFAULT_TABLE table=default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.227528 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d1535707ae4fa89a605a551c5cfb9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.232789 19453 tablet_service.cc:1511] Processing CreateTablet for tablet 0d03fcc09bfc496bb3c5b11bbe472059 (DEFAULT_TABLE table=default.Table_7f92037687c64fcb900a146f4b4163b6 [id=3ce11f08674f49feacdef55232965124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.234027 19453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d03fcc09bfc496bb3c5b11bbe472059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.236757 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 0d03fcc09bfc496bb3c5b11bbe472059 (DEFAULT_TABLE table=default.Table_7f92037687c64fcb900a146f4b4163b6 [id=3ce11f08674f49feacdef55232965124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.238004 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d03fcc09bfc496bb3c5b11bbe472059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.238739 19598 tablet_service.cc:1511] Processing CreateTablet for tablet 0d03fcc09bfc496bb3c5b11bbe472059 (DEFAULT_TABLE table=default.Table_7f92037687c64fcb900a146f4b4163b6 [id=3ce11f08674f49feacdef55232965124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.239900 19598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d03fcc09bfc496bb3c5b11bbe472059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.239823 19597 tablet_service.cc:1511] Processing CreateTablet for tablet b98e030c427e4d64b5887d42d21c6411 (DEFAULT_TABLE table=default.Table_de8e96d7d6d24f81bf383241fad9f8cc [id=37c493e25b6a4468842a5ca467a82329]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.240996 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98e030c427e4d64b5887d42d21c6411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.249922 19744 tablet_service.cc:1511] Processing CreateTablet for tablet b98e030c427e4d64b5887d42d21c6411 (DEFAULT_TABLE table=default.Table_de8e96d7d6d24f81bf383241fad9f8cc [id=37c493e25b6a4468842a5ca467a82329]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.251281 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98e030c427e4d64b5887d42d21c6411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.258814 19452 tablet_service.cc:1511] Processing CreateTablet for tablet b98e030c427e4d64b5887d42d21c6411 (DEFAULT_TABLE table=default.Table_de8e96d7d6d24f81bf383241fad9f8cc [id=37c493e25b6a4468842a5ca467a82329]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.260129 19452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98e030c427e4d64b5887d42d21c6411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.262627 19117 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_151d9e01bde94ff6973614638f15e59b" } new_table_name: "default.Table_0f25cff84cae44ce94f88d85978c1dba" modify_external_catalogs: true
I20260928 01:55:20.289716 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_960bebceca054e449b909f586325157c"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:20.291597 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_960bebceca054e449b909f586325157c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:20.304034 19115 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_3f526630f0ba41b6aa80e08c62a62a5c"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:20.305990 19115 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f526630f0ba41b6aa80e08c62a62a5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:20.313084 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_6426312da3e54b60856f51d856be63a6"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:20.314934 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6426312da3e54b60856f51d856be63a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:20.318168 19890 tablet_bootstrap.cc:492] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:20.321702 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_f045c1706de24bcdb20184c345632404"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:20.323494 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f045c1706de24bcdb20184c345632404 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:20.325608 19894 tablet_bootstrap.cc:492] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:20.338577 19890 tablet_bootstrap.cc:654] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.341017 19890 log.cc:826] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0: Log is configured to *not* fsync() on all Append() calls
I20260928 01:55:20.345468 19894 tablet_bootstrap.cc:654] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.348037 19894 log.cc:826] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: Log is configured to *not* fsync() on all Append() calls
I20260928 01:55:20.350713 19896 tablet_bootstrap.cc:492] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:20.357604 19890 tablet_bootstrap.cc:492] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:20.358189 19890 ts_tablet_manager.cc:1403] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.005s
I20260928 01:55:20.361207 19896 tablet_bootstrap.cc:654] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.363722 19896 log.cc:826] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614: Log is configured to *not* fsync() on all Append() calls
W20260928 01:55:20.364800 19117 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d54979e5a0f74cc2a281792669506fdb consensus state has no leader
I20260928 01:55:20.366792 19894 tablet_bootstrap.cc:492] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:20.367403 19894 ts_tablet_manager.cc:1403] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.000s
I20260928 01:55:20.388916 19117 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_de8e96d7d6d24f81bf383241fad9f8cc" } modify_external_catalogs: true
I20260928 01:55:20.389535 19117 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_de8e96d7d6d24f81bf383241fad9f8cc" } modify_external_catalogs: true
I20260928 01:55:20.390566 19113 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_7f92037687c64fcb900a146f4b4163b6" } new_table_name: "default.Table_15709085be10414e89049188a3460895" modify_external_catalogs: true
I20260928 01:55:20.390338 19890 raft_consensus.cc:359] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.391371 19890 raft_consensus.cc:385] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.391661 19890 raft_consensus.cc:740] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.392835 19890 consensus_queue.cc:260] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.394634 19112 master_service.cc:960] ReplaceTablet: received request to replace tablet 0d03fcc09bfc496bb3c5b11bbe472059 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:20.398953 19896 tablet_bootstrap.cc:492] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:20.399585 19896 ts_tablet_manager.cc:1403] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.017s
I20260928 01:55:20.399749 19111 master_service.cc:960] ReplaceTablet: received request to replace tablet 0d03fcc09bfc496bb3c5b11bbe472059 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:20.405903 19110 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_0f25cff84cae44ce94f88d85978c1dba" } modify_external_catalogs: true
I20260928 01:55:20.406615 19110 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_0f25cff84cae44ce94f88d85978c1dba" } modify_external_catalogs: true
I20260928 01:55:20.434216 19668 heartbeater.cc:499] Master 127.18.161.62:38511 was elected leader, sending a full tablet report...
I20260928 01:55:20.436344 19890 ts_tablet_manager.cc:1434] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.078s	user 0.048s	sys 0.025s
I20260928 01:55:20.437361 19890 tablet_bootstrap.cc:492] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:20.441272 19669 tablet.cc:2433] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 01:55:20.445683 19890 tablet_bootstrap.cc:654] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.452129 19890 tablet_bootstrap.cc:492] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:20.452769 19890 ts_tablet_manager.cc:1403] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.016s	user 0.003s	sys 0.009s
I20260928 01:55:20.452864 19896 raft_consensus.cc:359] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.453976 19896 raft_consensus.cc:385] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.452864 19894 raft_consensus.cc:359] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.454308 19896 raft_consensus.cc:740] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.454468 19894 raft_consensus.cc:385] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.454756 19894 raft_consensus.cc:740] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.455615 19890 raft_consensus.cc:359] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:20.455488 19896 consensus_queue.cc:260] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.455670 19894 consensus_queue.cc:260] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.456271 19890 raft_consensus.cc:385] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.456573 19890 raft_consensus.cc:740] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.457334 19890 consensus_queue.cc:260] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:20.463565 19890 ts_tablet_manager.cc:1434] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260928 01:55:20.464921 19890 tablet_bootstrap.cc:492] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:20.473469 19890 tablet_bootstrap.cc:654] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.486932 19890 tablet_bootstrap.cc:492] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:20.487475 19890 ts_tablet_manager.cc:1403] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.006s
I20260928 01:55:20.490916 19890 raft_consensus.cc:359] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.492101 19890 raft_consensus.cc:385] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.492478 19890 raft_consensus.cc:740] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.493522 19890 consensus_queue.cc:260] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.496739 19890 ts_tablet_manager.cc:1434] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260928 01:55:20.497814 19890 tablet_bootstrap.cc:492] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:20.512643 19890 tablet_bootstrap.cc:654] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.530051 19112 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 0d03fcc09bfc496bb3c5b11bbe472059
I20260928 01:55:20.531231 19896 ts_tablet_manager.cc:1434] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.131s	user 0.060s	sys 0.039s
I20260928 01:55:20.533115 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d03fcc09bfc496bb3c5b11bbe472059 with delete_type TABLET_DATA_DELETED (replaced by tablet ab702ddf7caf4c5eab5d0cea49724121) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:20.534685 19597 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d03fcc09bfc496bb3c5b11bbe472059 with delete_type TABLET_DATA_DELETED (replaced by tablet ab702ddf7caf4c5eab5d0cea49724121) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:20.535007 19112 catalog_manager.cc:6934] ReplaceTablet: tablet 0d03fcc09bfc496bb3c5b11bbe472059 deleted and replaced by tablet ab702ddf7caf4c5eab5d0cea49724121
I20260928 01:55:20.535763 19896 tablet_bootstrap.cc:492] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:20.535890 19527 heartbeater.cc:499] Master 127.18.161.62:38511 was elected leader, sending a full tablet report...
I20260928 01:55:20.537825 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d03fcc09bfc496bb3c5b11bbe472059 with delete_type TABLET_DATA_DELETED (replaced by tablet ab702ddf7caf4c5eab5d0cea49724121) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:20.541538 19890 tablet_bootstrap.cc:492] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:20.542021 19890 ts_tablet_manager.cc:1403] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.008s
I20260928 01:55:20.544896 19890 raft_consensus.cc:359] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.545703 19890 raft_consensus.cc:385] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.545995 19890 raft_consensus.cc:740] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.546694 19890 consensus_queue.cc:260] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.547798 19815 heartbeater.cc:499] Master 127.18.161.62:38511 was elected leader, sending a full tablet report...
I20260928 01:55:20.548807 19890 ts_tablet_manager.cc:1434] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260928 01:55:20.549700 19890 tablet_bootstrap.cc:492] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:20.552500 19896 tablet_bootstrap.cc:654] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.556027 19894 ts_tablet_manager.cc:1434] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.188s	user 0.038s	sys 0.014s
I20260928 01:55:20.562422 19890 tablet_bootstrap.cc:654] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.564141 19908 tablet_replica.cc:333] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:20.565155 19908 raft_consensus.cc:2243] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:20.565737 19908 raft_consensus.cc:2272] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:20.575517 19118 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_3f526630f0ba41b6aa80e08c62a62a5c" } new_table_name: "default.Table_7ed5dc038aaf4cceace845ff6e55d1a9" modify_external_catalogs: true
I20260928 01:55:20.579744 19908 ts_tablet_manager.cc:1916] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:20.581187 19894 tablet_bootstrap.cc:492] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:20.599745 19904 raft_consensus.cc:493] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:20.600548 19904 raft_consensus.cc:515] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.603941 19597 tablet_service.cc:1511] Processing CreateTablet for tablet 29bf124261034ebf8595eeaae9d96d73 (DEFAULT_TABLE table=default.Table_3f526630f0ba41b6aa80e08c62a62a5c [id=504c0a60661340feb59f8cb73a219305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.605139 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29bf124261034ebf8595eeaae9d96d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.609509 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 29bf124261034ebf8595eeaae9d96d73 (DEFAULT_TABLE table=default.Table_3f526630f0ba41b6aa80e08c62a62a5c [id=504c0a60661340feb59f8cb73a219305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.610685 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29bf124261034ebf8595eeaae9d96d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.615429 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 5380b2b4da1c476b959a11cd8a20bf2d (DEFAULT_TABLE table=default.Table_6426312da3e54b60856f51d856be63a6 [id=a7ba65289ffb41f99d1744f084739dda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.616657 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5380b2b4da1c476b959a11cd8a20bf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.620488 19894 tablet_bootstrap.cc:654] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.626543 19890 tablet_bootstrap.cc:492] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:20.631377 19890 ts_tablet_manager.cc:1403] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.082s	user 0.005s	sys 0.026s
I20260928 01:55:20.633535 19909 tablet_replica.cc:333] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:20.634459 19909 raft_consensus.cc:2243] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:20.635051 19909 raft_consensus.cc:2272] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:20.627812 19599 tablet_service.cc:1511] Processing CreateTablet for tablet 5380b2b4da1c476b959a11cd8a20bf2d (DEFAULT_TABLE table=default.Table_6426312da3e54b60856f51d856be63a6 [id=a7ba65289ffb41f99d1744f084739dda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.636981 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5380b2b4da1c476b959a11cd8a20bf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.638132 19890 raft_consensus.cc:359] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.640445 19117 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet b98e030c427e4d64b5887d42d21c6411
W20260928 01:55:20.642843 19113 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab702ddf7caf4c5eab5d0cea49724121 has no consensus state
I20260928 01:55:20.642927 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet b98e030c427e4d64b5887d42d21c6411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:20.645401 19890 raft_consensus.cc:385] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.645741 19890 raft_consensus.cc:740] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.646672 19110 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet d54979e5a0f74cc2a281792669506fdb
I20260928 01:55:20.647466 19890 consensus_queue.cc:260] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.649868 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet d54979e5a0f74cc2a281792669506fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:20.650352 19452 tablet_service.cc:1558] Processing DeleteTablet for tablet d54979e5a0f74cc2a281792669506fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:20.656733 19890 ts_tablet_manager.cc:1434] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.005s
I20260928 01:55:20.660063 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet b98e030c427e4d64b5887d42d21c6411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:20.667598 19909 ts_tablet_manager.cc:1916] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:20.679517 19454 tablet_service.cc:1511] Processing CreateTablet for tablet d83b071a5ec24eefb9bae5e75faf6d5b (DEFAULT_TABLE table=default.Table_f045c1706de24bcdb20184c345632404 [id=67a5a466dfa54e2384f915271a66a8b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.680773 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83b071a5ec24eefb9bae5e75faf6d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.681025 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 29bf124261034ebf8595eeaae9d96d73 (DEFAULT_TABLE table=default.Table_3f526630f0ba41b6aa80e08c62a62a5c [id=504c0a60661340feb59f8cb73a219305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.682192 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29bf124261034ebf8595eeaae9d96d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.683244 19894 tablet_bootstrap.cc:492] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:20.683853 19894 ts_tablet_manager.cc:1403] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.103s	user 0.015s	sys 0.015s
I20260928 01:55:20.687109 19894 raft_consensus.cc:359] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.690585 19894 raft_consensus.cc:385] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.692138 19894 raft_consensus.cc:740] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.696339 19894 consensus_queue.cc:260] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.698024 19746 tablet_service.cc:1511] Processing CreateTablet for tablet 5380b2b4da1c476b959a11cd8a20bf2d (DEFAULT_TABLE table=default.Table_6426312da3e54b60856f51d856be63a6 [id=a7ba65289ffb41f99d1744f084739dda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.703718 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5380b2b4da1c476b959a11cd8a20bf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.698836 19747 tablet_service.cc:1558] Processing DeleteTablet for tablet b98e030c427e4d64b5887d42d21c6411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:20.708412 19600 tablet_service.cc:1511] Processing CreateTablet for tablet d83b071a5ec24eefb9bae5e75faf6d5b (DEFAULT_TABLE table=default.Table_f045c1706de24bcdb20184c345632404 [id=67a5a466dfa54e2384f915271a66a8b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.711894 19452 tablet_service.cc:1511] Processing CreateTablet for tablet 2120beacbd764f418a559189b7d06c00 (DEFAULT_TABLE table=default.Table_960bebceca054e449b909f586325157c [id=723cb039487b46c7887ec8a10626b0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.713039 19452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2120beacbd764f418a559189b7d06c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.713943 19747 tablet_service.cc:1558] Processing DeleteTablet for tablet d54979e5a0f74cc2a281792669506fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:20.720233 19747 tablet_service.cc:1511] Processing CreateTablet for tablet d83b071a5ec24eefb9bae5e75faf6d5b (DEFAULT_TABLE table=default.Table_f045c1706de24bcdb20184c345632404 [id=67a5a466dfa54e2384f915271a66a8b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.721328 19747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83b071a5ec24eefb9bae5e75faf6d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.722574 19894 ts_tablet_manager.cc:1434] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
W20260928 01:55:20.723182 19118 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29bf124261034ebf8595eeaae9d96d73 consensus state has no leader
I20260928 01:55:20.731499 19894 tablet_bootstrap.cc:492] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:20.737970 19904 leader_election.cc:290] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:20.740075 19907 tablet_replica.cc:333] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:20.741034 19907 raft_consensus.cc:2243] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:20.741616 19907 raft_consensus.cc:2272] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:20.746315 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_d5185be74c414c8a886b3b5ccebf4cd7"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:20.748618 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5185be74c414c8a886b3b5ccebf4cd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:20.755615 19820 tablet.cc:2433] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 01:55:20.759367 19894 tablet_bootstrap.cc:654] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.759511 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_16ab0f33352d4271902bf0f2389bf36f"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:20.761652 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16ab0f33352d4271902bf0f2389bf36f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:20.770123 19909 ts_tablet_manager.cc:1929] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:20.770591 19909 log.cc:1199] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/0d03fcc09bfc496bb3c5b11bbe472059
I20260928 01:55:20.773048 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 2120beacbd764f418a559189b7d06c00 (DEFAULT_TABLE table=default.Table_960bebceca054e449b909f586325157c [id=723cb039487b46c7887ec8a10626b0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.773473 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d1535707ae4fa89a605a551c5cfb9e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:20.774366 19621 raft_consensus.cc:2468] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:20.776233 19704 leader_election.cc:304] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:20.777936 19909 ts_tablet_manager.cc:1950] T 0d03fcc09bfc496bb3c5b11bbe472059 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:20.778362 19904 raft_consensus.cc:2804] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:20.778792 19904 raft_consensus.cc:493] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:20.779170 19904 raft_consensus.cc:3060] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:20.780364 19896 tablet_bootstrap.cc:492] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:20.780939 19896 ts_tablet_manager.cc:1403] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.245s	user 0.029s	sys 0.035s
I20260928 01:55:20.781816 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 0d03fcc09bfc496bb3c5b11bbe472059 (table default.Table_15709085be10414e89049188a3460895 [id=3ce11f08674f49feacdef55232965124]) successfully deleted
I20260928 01:55:20.785511 19115 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_d86b7bc9587e442186ac7891b241c14b"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:20.787897 19115 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d86b7bc9587e442186ac7891b241c14b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:20.789812 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_ef58636bc26841e2b545339d5674d8c8"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:20.792461 19110 master_service.cc:960] ReplaceTablet: received request to replace tablet 31d1535707ae4fa89a605a551c5cfb9e from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:20.793006 19896 raft_consensus.cc:359] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.793723 19896 raft_consensus.cc:385] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.794015 19896 raft_consensus.cc:740] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.794381 19746 tablet_service.cc:1511] Processing CreateTablet for tablet 2120beacbd764f418a559189b7d06c00 (DEFAULT_TABLE table=default.Table_960bebceca054e449b909f586325157c [id=723cb039487b46c7887ec8a10626b0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:20.794751 19896 consensus_queue.cc:260] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.795792 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2120beacbd764f418a559189b7d06c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.799530 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83b071a5ec24eefb9bae5e75faf6d5b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:20.799685 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet d54979e5a0f74cc2a281792669506fdb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d54979e5a0f74cc2a281792669506fdb already in progress: creating tablet
W20260928 01:55:20.800628 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet b98e030c427e4d64b5887d42d21c6411 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b98e030c427e4d64b5887d42d21c6411 already in progress: creating tablet
I20260928 01:55:20.801017 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2120beacbd764f418a559189b7d06c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:20.803227 19896 ts_tablet_manager.cc:1434] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
W20260928 01:55:20.791874 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef58636bc26841e2b545339d5674d8c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:20.804751 19896 tablet_bootstrap.cc:492] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:20.810662 19890 tablet_bootstrap.cc:492] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:20.817059 19890 tablet_bootstrap.cc:654] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.822697 19894 tablet_bootstrap.cc:492] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:20.823179 19894 ts_tablet_manager.cc:1403] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.018s
I20260928 01:55:20.826012 19894 raft_consensus.cc:359] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.826738 19894 raft_consensus.cc:385] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.827013 19894 raft_consensus.cc:740] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.829429 19908 ts_tablet_manager.cc:1929] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:20.830878 19908 log.cc:1199] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/0d03fcc09bfc496bb3c5b11bbe472059
I20260928 01:55:20.830792 19894 consensus_queue.cc:260] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.831916 19908 ts_tablet_manager.cc:1950] T 0d03fcc09bfc496bb3c5b11bbe472059 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:20.835433 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 0d03fcc09bfc496bb3c5b11bbe472059 (table default.Table_15709085be10414e89049188a3460895 [id=3ce11f08674f49feacdef55232965124]) successfully deleted
I20260928 01:55:20.836432 19894 ts_tablet_manager.cc:1434] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260928 01:55:20.837345 19894 tablet_bootstrap.cc:492] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:20.842214 19890 tablet_bootstrap.cc:492] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:20.842828 19890 ts_tablet_manager.cc:1403] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.000s
I20260928 01:55:20.845544 19890 raft_consensus.cc:359] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:20.846230 19890 raft_consensus.cc:385] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.846509 19890 raft_consensus.cc:740] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.847290 19896 tablet_bootstrap.cc:654] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.847704 19890 consensus_queue.cc:260] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:20.852531 19890 ts_tablet_manager.cc:1434] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260928 01:55:20.853570 19890 tablet_bootstrap.cc:492] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:20.855288 19894 tablet_bootstrap.cc:654] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.858119 19899 raft_consensus.cc:493] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:20.858646 19899 raft_consensus.cc:515] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:20.873690 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d1535707ae4fa89a605a551c5cfb9e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:20.878306 19703 leader_election.cc:343] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:20.878548 19899 leader_election.cc:290] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:20.882823 19890 tablet_bootstrap.cc:654] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.882923 19903 raft_consensus.cc:493] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:20.883510 19903 raft_consensus.cc:515] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.890859 19903 leader_election.cc:290] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:20.885573 19907 ts_tablet_manager.cc:1916] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:20.908587 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54979e5a0f74cc2a281792669506fdb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:20.909355 19621 raft_consensus.cc:2468] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:20.911453 19896 tablet_bootstrap.cc:492] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:20.918788 19908 tablet_replica.cc:333] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:20.919621 19908 raft_consensus.cc:2243] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:20.923062 19894 tablet_bootstrap.cc:492] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:20.923580 19894 ts_tablet_manager.cc:1403] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.086s	user 0.022s	sys 0.012s
I20260928 01:55:20.911525 19412 leader_election.cc:304] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:20.918540 19532 tablet.cc:2433] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 01:55:20.924583 19896 ts_tablet_manager.cc:1403] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.120s	user 0.007s	sys 0.013s
I20260928 01:55:20.926178 19903 raft_consensus.cc:2804] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:20.926607 19903 raft_consensus.cc:493] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:20.927013 19903 raft_consensus.cc:3060] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:20.920127 19908 raft_consensus.cc:2272] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:20.927007 19894 raft_consensus.cc:359] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.927824 19894 raft_consensus.cc:385] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.929095 19894 raft_consensus.cc:740] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.931759 19117 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_6426312da3e54b60856f51d856be63a6" } modify_external_catalogs: true
I20260928 01:55:20.932440 19117 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_6426312da3e54b60856f51d856be63a6" } modify_external_catalogs: true
I20260928 01:55:20.938035 19908 ts_tablet_manager.cc:1916] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:20.938565 19114 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_f045c1706de24bcdb20184c345632404" } modify_external_catalogs: true
I20260928 01:55:20.938630 19894 consensus_queue.cc:260] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.939273 19114 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_f045c1706de24bcdb20184c345632404" } modify_external_catalogs: true
I20260928 01:55:20.940979 19894 ts_tablet_manager.cc:1434] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260928 01:55:20.942168 19894 tablet_bootstrap.cc:492] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:20.942421 19109 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_15709085be10414e89049188a3460895" } new_table_name: "default.Table_f8fbaf65902f43be8bbe856cd5e13599" modify_external_catalogs: true
I20260928 01:55:20.907913 19904 raft_consensus.cc:515] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.949213 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d1535707ae4fa89a605a551c5cfb9e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:20.949869 19621 raft_consensus.cc:3060] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:20.952287 19894 tablet_bootstrap.cc:654] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:20.955788 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d1535707ae4fa89a605a551c5cfb9e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:20.957664 19621 raft_consensus.cc:2468] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:20.959383 19704 leader_election.cc:304] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:20.959661 19890 tablet_bootstrap.cc:492] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:20.960120 19890 ts_tablet_manager.cc:1403] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.000s
I20260928 01:55:20.960530 19910 raft_consensus.cc:2804] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:20.963009 19115 master_service.cc:960] ReplaceTablet: received request to replace tablet 29bf124261034ebf8595eeaae9d96d73 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:20.967628 19890 raft_consensus.cc:359] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:20.971966 19894 tablet_bootstrap.cc:492] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:20.972548 19894 ts_tablet_manager.cc:1403] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.002s
I20260928 01:55:20.968443 19890 raft_consensus.cc:385] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.974792 19890 raft_consensus.cc:740] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.976013 19894 raft_consensus.cc:359] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:20.976754 19894 raft_consensus.cc:385] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:20.977046 19894 raft_consensus.cc:740] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:20.977833 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54979e5a0f74cc2a281792669506fdb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:20.978171 19894 consensus_queue.cc:260] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:20.978638 19768 raft_consensus.cc:2468] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:20.979423 19903 raft_consensus.cc:515] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.981215 19890 consensus_queue.cc:260] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:20.983551 19904 leader_election.cc:290] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:20.992360 19703 leader_election.cc:343] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:20.993829 19910 raft_consensus.cc:697] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:20.995193 19894 ts_tablet_manager.cc:1434] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.008s
I20260928 01:55:20.994979 19910 consensus_queue.cc:237] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:20.997252 19890 ts_tablet_manager.cc:1434] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260928 01:55:20.998270 19890 tablet_bootstrap.cc:492] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:21.008657 19896 raft_consensus.cc:359] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:21.009431 19896 raft_consensus.cc:385] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.009733 19896 raft_consensus.cc:740] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.010744 19896 consensus_queue.cc:260] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:21.013387 19894 tablet_bootstrap.cc:492] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:21.016216 19903 leader_election.cc:290] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:21.017002 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54979e5a0f74cc2a281792669506fdb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:21.017722 19768 raft_consensus.cc:3060] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:21.021812 19894 tablet_bootstrap.cc:654] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.027040 19890 tablet_bootstrap.cc:654] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.031277 19768 raft_consensus.cc:2468] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:21.031498 19908 ts_tablet_manager.cc:1929] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.031903 19908 log.cc:1199] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/b98e030c427e4d64b5887d42d21c6411
I20260928 01:55:21.032655 19908 ts_tablet_manager.cc:1950] T b98e030c427e4d64b5887d42d21c6411 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:21.032994 19409 leader_election.cc:304] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:21.033787 19456 tablet_service.cc:1558] Processing DeleteTablet for tablet d54979e5a0f74cc2a281792669506fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:21.034731 19903 raft_consensus.cc:2804] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:21.034788 19909 tablet_replica.cc:333] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:21.035241 19908 tablet_replica.cc:333] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:21.036454 19903 raft_consensus.cc:697] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:21.037459 19903 consensus_queue.cc:237] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:21.040259 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54979e5a0f74cc2a281792669506fdb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:21.040192 19112 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_960bebceca054e449b909f586325157c" } new_table_name: "default.Table_a8beedb7e2f3499cba462a232332880a" modify_external_catalogs: true
I20260928 01:55:21.041371 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet b98e030c427e4d64b5887d42d21c6411 (table default.Table_de8e96d7d6d24f81bf383241fad9f8cc [id=37c493e25b6a4468842a5ca467a82329]) successfully deleted
I20260928 01:55:21.042519 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bf124261034ebf8595eeaae9d96d73" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:21.044831 19556 leader_election.cc:343] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.036005 19908 raft_consensus.cc:2243] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:21.046623 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bf124261034ebf8595eeaae9d96d73" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:21.048498 19553 leader_election.cc:343] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.048988 19553 leader_election.cc:304] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:21.050280 19899 raft_consensus.cc:2749] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:21.050299 19908 raft_consensus.cc:2272] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 01:55:21.051945 19412 leader_election.cc:343] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.055464 19890 tablet_bootstrap.cc:492] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:21.055900 19890 ts_tablet_manager.cc:1403] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.006s
I20260928 01:55:21.053900 19908 ts_tablet_manager.cc:1916] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.060333 19890 raft_consensus.cc:359] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.060986 19890 raft_consensus.cc:385] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.061252 19890 raft_consensus.cc:740] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.061906 19890 consensus_queue.cc:260] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.070309 19894 tablet_bootstrap.cc:492] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:21.073751 19890 ts_tablet_manager.cc:1434] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260928 01:55:21.074777 19890 tablet_bootstrap.cc:492] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:21.080734 19890 tablet_bootstrap.cc:654] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:21.081988 19109 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab702ddf7caf4c5eab5d0cea49724121 has no consensus state
I20260928 01:55:21.088936 19894 ts_tablet_manager.cc:1403] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.006s
I20260928 01:55:21.089402 19899 raft_consensus.cc:493] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:21.089895 19899 raft_consensus.cc:515] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.092273 19899 leader_election.cc:290] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:21.092183 19894 raft_consensus.cc:359] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.092973 19894 raft_consensus.cc:385] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.093287 19894 raft_consensus.cc:740] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.094251 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83b071a5ec24eefb9bae5e75faf6d5b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:21.095978 19553 leader_election.cc:343] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.096774 19908 ts_tablet_manager.cc:1929] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.097223 19908 log.cc:1199] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/d54979e5a0f74cc2a281792669506fdb
I20260928 01:55:21.097167 19111 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 29bf124261034ebf8595eeaae9d96d73 (table default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]). Expected version 1 got 0
I20260928 01:55:21.099027 19908 ts_tablet_manager.cc:1950] T d54979e5a0f74cc2a281792669506fdb P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:21.102128 19894 consensus_queue.cc:260] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.105697 19894 ts_tablet_manager.cc:1434] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260928 01:55:21.107479 19894 tablet_bootstrap.cc:492] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:21.108953 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet d54979e5a0f74cc2a281792669506fdb (table default.Table_0f25cff84cae44ce94f88d85978c1dba [id=df2128aeb5ef482d9d29826bb71e0e10]) successfully deleted
I20260928 01:55:21.112658 19910 raft_consensus.cc:493] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:21.112815 19601 tablet_service.cc:1511] Processing CreateTablet for tablet ab702ddf7caf4c5eab5d0cea49724121 (DEFAULT_TABLE table=default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.113145 19910 raft_consensus.cc:515] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:21.114190 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab702ddf7caf4c5eab5d0cea49724121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.115577 19910 leader_election.cc:290] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:21.119143 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2597de2c4304074977db5a3c0426814" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:21.120256 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2597de2c4304074977db5a3c0426814" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:21.120896 19621 raft_consensus.cc:2468] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
W20260928 01:55:21.121515 19703 leader_election.cc:343] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:21.121977 19103 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet ab702ddf7caf4c5eab5d0cea49724121 (table default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet ab702ddf7caf4c5eab5d0cea49724121 consensus state has no leader
I20260928 01:55:21.122205 19704 leader_election.cc:304] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:21.123389 19904 raft_consensus.cc:2804] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:21.123821 19904 raft_consensus.cc:493] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:21.124284 19904 raft_consensus.cc:3060] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:21.131378 19904 raft_consensus.cc:515] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:21.133531 19894 tablet_bootstrap.cc:654] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.134400 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2597de2c4304074977db5a3c0426814" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:21.134609 19456 tablet_service.cc:1511] Processing CreateTablet for tablet ab702ddf7caf4c5eab5d0cea49724121 (DEFAULT_TABLE table=default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.135018 19621 raft_consensus.cc:3060] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:21.137729 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab702ddf7caf4c5eab5d0cea49724121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.141239 19747 tablet_service.cc:1511] Processing CreateTablet for tablet ab702ddf7caf4c5eab5d0cea49724121 (DEFAULT_TABLE table=default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.141846 19621 raft_consensus.cc:2468] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:21.142632 19747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab702ddf7caf4c5eab5d0cea49724121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.143101 19704 leader_election.cc:304] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:21.144124 19910 raft_consensus.cc:2804] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:21.144972 19910 raft_consensus.cc:697] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:21.145948 19910 consensus_queue.cc:237] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:21.151404 19904 leader_election.cc:290] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:21.155267 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2597de2c4304074977db5a3c0426814" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
W20260928 01:55:21.160723 19703 leader_election.cc:343] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.164541 19899 raft_consensus.cc:493] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:21.165007 19899 raft_consensus.cc:515] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.167078 19899 leader_election.cc:290] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:21.170797 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380b2b4da1c476b959a11cd8a20bf2d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:21.171648 19768 raft_consensus.cc:2468] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:21.176505 19553 leader_election.cc:304] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:21.177806 19899 raft_consensus.cc:2804] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:21.178231 19899 raft_consensus.cc:493] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:21.178566 19899 raft_consensus.cc:3060] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:21.182215 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380b2b4da1c476b959a11cd8a20bf2d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:21.182438 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83b071a5ec24eefb9bae5e75faf6d5b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:21.184490 19556 leader_election.cc:343] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:21.185463 19556 leader_election.cc:343] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.185870 19556 leader_election.cc:304] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:21.192379 19896 ts_tablet_manager.cc:1434] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.267s	user 0.008s	sys 0.007s
I20260928 01:55:21.197233 19896 tablet_bootstrap.cc:492] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:21.197630 19894 tablet_bootstrap.cc:492] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:21.198061 19894 ts_tablet_manager.cc:1403] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.017s
I20260928 01:55:21.203833 19111 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_cf24bc3f80284979a9a30c88965c648e"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:21.204790 19899 raft_consensus.cc:515] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:21.205788 19111 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf24bc3f80284979a9a30c88965c648e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:21.208237 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_2aaf4ac3068c408db62d4261692c1abf"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:21.208668 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380b2b4da1c476b959a11cd8a20bf2d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:21.209316 19768 raft_consensus.cc:3060] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:21.210003 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2aaf4ac3068c408db62d4261692c1abf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:21.214614 19112 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2120beacbd764f418a559189b7d06c00 consensus state has no leader
I20260928 01:55:21.215744 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_fea69b0ce347435092a720e7c672d639"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:21.216846 19768 raft_consensus.cc:2468] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
W20260928 01:55:21.217737 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fea69b0ce347435092a720e7c672d639 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:21.218432 19553 leader_election.cc:304] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:21.224293 19942 raft_consensus.cc:2749] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:21.225407 19909 raft_consensus.cc:2243] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:21.234572 19909 pending_rounds.cc:70] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: Trying to abort 1 pending ops.
I20260928 01:55:21.235018 19909 pending_rounds.cc:77] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135894210494464 op_type: NO_OP noop_request { }
I20260928 01:55:21.235635 19909 raft_consensus.cc:2889] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:21.237452 19890 tablet_bootstrap.cc:492] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:21.237895 19890 ts_tablet_manager.cc:1403] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.163s	user 0.036s	sys 0.033s
I20260928 01:55:21.236089 19909 raft_consensus.cc:2272] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.238341 19894 raft_consensus.cc:359] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.239014 19894 raft_consensus.cc:385] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.239272 19894 raft_consensus.cc:740] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:55:21.239580 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 54127.1us
I20260928 01:55:21.225142 19942 raft_consensus.cc:2804] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:21.240582 19899 leader_election.cc:290] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:21.241034 19942 raft_consensus.cc:697] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:21.242118 19942 consensus_queue.cc:237] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.242890 19894 consensus_queue.cc:260] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.249141 19907 ts_tablet_manager.cc:1929] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.249595 19907 log.cc:1199] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/0d03fcc09bfc496bb3c5b11bbe472059
I20260928 01:55:21.251505 19890 raft_consensus.cc:359] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.253238 19894 ts_tablet_manager.cc:1434] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.006s
I20260928 01:55:21.234649 19896 tablet_bootstrap.cc:654] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.257402 19894 tablet_bootstrap.cc:492] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:21.252152 19890 raft_consensus.cc:385] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.262588 19890 raft_consensus.cc:740] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.263367 19894 tablet_bootstrap.cc:654] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.263362 19890 consensus_queue.cc:260] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.274482 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380b2b4da1c476b959a11cd8a20bf2d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:21.275185 19907 ts_tablet_manager.cc:1950] T 0d03fcc09bfc496bb3c5b11bbe472059 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
W20260928 01:55:21.276328 19556 leader_election.cc:343] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.285447 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 0d03fcc09bfc496bb3c5b11bbe472059 (table default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]) successfully deleted
I20260928 01:55:21.290336 19115 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 29bf124261034ebf8595eeaae9d96d73
I20260928 01:55:21.290670 19890 ts_tablet_manager.cc:1434] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260928 01:55:21.290629 19110 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 31d1535707ae4fa89a605a551c5cfb9e
I20260928 01:55:21.292165 19890 tablet_bootstrap.cc:492] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:21.292230 19110 catalog_manager.cc:6934] ReplaceTablet: tablet 31d1535707ae4fa89a605a551c5cfb9e deleted and replaced by tablet 7801c623930d4e4eaf24c5c424b06d26
I20260928 01:55:21.293183 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_ba101536dd544f75a023727ab9ef2ac7"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:21.296053 19907 tablet_replica.cc:333] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:21.296900 19907 raft_consensus.cc:2243] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:21.297394 19907 raft_consensus.cc:2272] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.300495 19117 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 5380b2b4da1c476b959a11cd8a20bf2d
I20260928 01:55:21.301479 19601 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d1535707ae4fa89a605a551c5cfb9e with delete_type TABLET_DATA_DELETED (replaced by tablet 7801c623930d4e4eaf24c5c424b06d26) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:21.302332 19908 tablet_replica.cc:333] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:21.302520 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet 29bf124261034ebf8595eeaae9d96d73 with delete_type TABLET_DATA_DELETED (replaced by tablet c8bbb627a14a477c9362d2b250f27c1e) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:21.303159 19908 raft_consensus.cc:2243] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:21.303304 19114 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet d83b071a5ec24eefb9bae5e75faf6d5b
I20260928 01:55:21.303687 19908 raft_consensus.cc:2272] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.305783 19908 ts_tablet_manager.cc:1916] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.308128 19894 tablet_bootstrap.cc:492] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:21.308692 19894 ts_tablet_manager.cc:1403] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.012s
I20260928 01:55:21.309598 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet 5380b2b4da1c476b959a11cd8a20bf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:21.310304 19907 ts_tablet_manager.cc:1916] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.310323 19601 tablet_service.cc:1558] Processing DeleteTablet for tablet d83b071a5ec24eefb9bae5e75faf6d5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:21.292080 19115 catalog_manager.cc:6934] ReplaceTablet: tablet 29bf124261034ebf8595eeaae9d96d73 deleted and replaced by tablet c8bbb627a14a477c9362d2b250f27c1e
I20260928 01:55:21.312397 19747 tablet_service.cc:1558] Processing DeleteTablet for tablet 29bf124261034ebf8595eeaae9d96d73 with delete_type TABLET_DATA_DELETED (replaced by tablet c8bbb627a14a477c9362d2b250f27c1e) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:21.312794 19746 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d1535707ae4fa89a605a551c5cfb9e with delete_type TABLET_DATA_DELETED (replaced by tablet 7801c623930d4e4eaf24c5c424b06d26) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:21.311241 19894 raft_consensus.cc:359] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.313673 19894 raft_consensus.cc:385] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.313947 19894 raft_consensus.cc:740] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.314723 19894 consensus_queue.cc:260] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:21.315333 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba101536dd544f75a023727ab9ef2ac7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:21.317714 19116 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_16ab0f33352d4271902bf0f2389bf36f" } new_table_name: "default.Table_e72befab9eb14455817f899a410e6f0b" modify_external_catalogs: true
I20260928 01:55:21.322451 19746 tablet_service.cc:1558] Processing DeleteTablet for tablet 5380b2b4da1c476b959a11cd8a20bf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:21.324683 19747 tablet_service.cc:1558] Processing DeleteTablet for tablet d83b071a5ec24eefb9bae5e75faf6d5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:21.326534 19894 ts_tablet_manager.cc:1434] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260928 01:55:21.330717 19894 tablet_bootstrap.cc:492] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:21.334052 19452 tablet_service.cc:1558] Processing DeleteTablet for tablet 29bf124261034ebf8595eeaae9d96d73 with delete_type TABLET_DATA_DELETED (replaced by tablet c8bbb627a14a477c9362d2b250f27c1e) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:21.336459 19894 tablet_bootstrap.cc:654] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.339428 19455 tablet_service.cc:1558] Processing DeleteTablet for tablet d83b071a5ec24eefb9bae5e75faf6d5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:21.351835 19452 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d1535707ae4fa89a605a551c5cfb9e with delete_type TABLET_DATA_DELETED (replaced by tablet 7801c623930d4e4eaf24c5c424b06d26) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:21.352504 19890 tablet_bootstrap.cc:654] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.352758 19456 tablet_service.cc:1558] Processing DeleteTablet for tablet 5380b2b4da1c476b959a11cd8a20bf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:21.355062 19940 consensus_queue.cc:1175] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "37089d44fdba4b6488b5b5aea28af614" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260928 01:55:21.357985 19909 ts_tablet_manager.cc:1916] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.360687 19908 ts_tablet_manager.cc:1929] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.361148 19908 log.cc:1199] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/31d1535707ae4fa89a605a551c5cfb9e
I20260928 01:55:21.361907 19908 ts_tablet_manager.cc:1950] T 31d1535707ae4fa89a605a551c5cfb9e P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:21.365274 19908 tablet_replica.cc:333] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:21.365357 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 31d1535707ae4fa89a605a551c5cfb9e (table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]) successfully deleted
I20260928 01:55:21.366065 19908 raft_consensus.cc:2243] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:21.366576 19908 raft_consensus.cc:2272] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.367161 19894 tablet_bootstrap.cc:492] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:21.367600 19894 ts_tablet_manager.cc:1403] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.015s
I20260928 01:55:21.368516 19908 ts_tablet_manager.cc:1916] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.370134 19894 raft_consensus.cc:359] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.370800 19894 raft_consensus.cc:385] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.371073 19894 raft_consensus.cc:740] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.371884 19894 consensus_queue.cc:260] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.378189 19890 tablet_bootstrap.cc:492] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:21.378645 19890 ts_tablet_manager.cc:1403] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.087s	user 0.003s	sys 0.006s
I20260928 01:55:21.381300 19890 raft_consensus.cc:359] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:21.382061 19890 raft_consensus.cc:385] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.382340 19890 raft_consensus.cc:740] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.383324 19890 consensus_queue.cc:260] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:21.384459 19894 ts_tablet_manager.cc:1434] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260928 01:55:21.384853 19908 ts_tablet_manager.cc:1929] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.387967 19908 log.cc:1199] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/29bf124261034ebf8595eeaae9d96d73
I20260928 01:55:21.388753 19908 ts_tablet_manager.cc:1950] T 29bf124261034ebf8595eeaae9d96d73 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:21.392035 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 29bf124261034ebf8595eeaae9d96d73 (table default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]) successfully deleted
I20260928 01:55:21.392390 19908 tablet_replica.cc:333] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:21.393136 19908 raft_consensus.cc:2243] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:21.394002 19908 pending_rounds.cc:70] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0: Trying to abort 1 pending ops.
I20260928 01:55:21.394300 19908 pending_rounds.cc:77] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135895021912064 op_type: NO_OP noop_request { }
I20260928 01:55:21.394769 19908 raft_consensus.cc:2889] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:21.395175 19908 raft_consensus.cc:2272] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.399587 19908 ts_tablet_manager.cc:1916] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.399878 19894 tablet_bootstrap.cc:492] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:21.400132 19890 ts_tablet_manager.cc:1434] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260928 01:55:21.403285 19907 ts_tablet_manager.cc:1929] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.403733 19907 log.cc:1199] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/b98e030c427e4d64b5887d42d21c6411
I20260928 01:55:21.404500 19907 ts_tablet_manager.cc:1950] T b98e030c427e4d64b5887d42d21c6411 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:21.405731 19894 tablet_bootstrap.cc:654] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.407683 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet b98e030c427e4d64b5887d42d21c6411 (table default.Table_de8e96d7d6d24f81bf383241fad9f8cc [id=37c493e25b6a4468842a5ca467a82329]) successfully deleted
I20260928 01:55:21.408149 19896 tablet_bootstrap.cc:492] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:21.408761 19896 ts_tablet_manager.cc:1403] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.212s	user 0.014s	sys 0.000s
I20260928 01:55:21.418807 19907 tablet_replica.cc:333] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:21.419677 19907 raft_consensus.cc:2243] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:21.420234 19907 raft_consensus.cc:2272] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.422168 19907 ts_tablet_manager.cc:1916] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.422290 19908 ts_tablet_manager.cc:1929] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:21.422765 19908 log.cc:1199] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/5380b2b4da1c476b959a11cd8a20bf2d
I20260928 01:55:21.423612 19908 ts_tablet_manager.cc:1950] T 5380b2b4da1c476b959a11cd8a20bf2d P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:21.426934 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 5380b2b4da1c476b959a11cd8a20bf2d (table default.Table_6426312da3e54b60856f51d856be63a6 [id=a7ba65289ffb41f99d1744f084739dda]) successfully deleted
I20260928 01:55:21.427820 19908 tablet_replica.cc:333] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:21.428817 19908 raft_consensus.cc:2243] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:21.429395 19894 tablet_bootstrap.cc:492] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:21.429369 19908 raft_consensus.cc:2272] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.429828 19894 ts_tablet_manager.cc:1403] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.010s
I20260928 01:55:21.430338 19112 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_cf24bc3f80284979a9a30c88965c648e" } new_table_name: "default.Table_88ced5d20fea41538f5221b8f4367570" modify_external_catalogs: true
I20260928 01:55:21.431473 19908 ts_tablet_manager.cc:1916] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.433730 19894 raft_consensus.cc:359] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:21.436933 19116 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3f08e6838341436f8a85d6dbafc805df has no consensus state
I20260928 01:55:21.434386 19894 raft_consensus.cc:385] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.439577 19894 raft_consensus.cc:740] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.440438 19894 consensus_queue.cc:260] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:21.445863 19908 ts_tablet_manager.cc:1929] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.446218 19908 log.cc:1199] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/d83b071a5ec24eefb9bae5e75faf6d5b
I20260928 01:55:21.446828 19908 ts_tablet_manager.cc:1950] T d83b071a5ec24eefb9bae5e75faf6d5b P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:21.449627 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet d83b071a5ec24eefb9bae5e75faf6d5b (table default.Table_f045c1706de24bcdb20184c345632404 [id=67a5a466dfa54e2384f915271a66a8b8]) successfully deleted
I20260928 01:55:21.450682 19896 raft_consensus.cc:359] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:21.451577 19896 raft_consensus.cc:385] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.451926 19896 raft_consensus.cc:740] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.451964 19942 raft_consensus.cc:493] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:21.452189 19894 ts_tablet_manager.cc:1434] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260928 01:55:21.452540 19942 raft_consensus.cc:515] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:21.454787 19942 leader_election.cc:290] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:21.456425 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab702ddf7caf4c5eab5d0cea49724121" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:21.457005 19768 raft_consensus.cc:2468] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:21.457322 19909 ts_tablet_manager.cc:1929] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:21.457739 19909 log.cc:1199] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/d54979e5a0f74cc2a281792669506fdb
I20260928 01:55:21.457960 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab702ddf7caf4c5eab5d0cea49724121" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:21.458673 19909 ts_tablet_manager.cc:1950] T d54979e5a0f74cc2a281792669506fdb P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
W20260928 01:55:21.459446 19556 leader_election.cc:343] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.460357 19553 leader_election.cc:304] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:21.464650 19942 raft_consensus.cc:2804] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:21.465109 19942 raft_consensus.cc:493] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:21.465528 19942 raft_consensus.cc:3060] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:21.465914 19907 ts_tablet_manager.cc:1929] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.466322 19907 log.cc:1199] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/d54979e5a0f74cc2a281792669506fdb
I20260928 01:55:21.466974 19907 ts_tablet_manager.cc:1950] T d54979e5a0f74cc2a281792669506fdb P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:21.468536 19896 consensus_queue.cc:260] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:21.469852 19907 tablet_replica.cc:333] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:21.470108 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet d54979e5a0f74cc2a281792669506fdb (table default.Table_0f25cff84cae44ce94f88d85978c1dba [id=df2128aeb5ef482d9d29826bb71e0e10]) successfully deleted
I20260928 01:55:21.470866 19907 raft_consensus.cc:2243] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:21.471400 19907 raft_consensus.cc:2272] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.473376 19896 ts_tablet_manager.cc:1434] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260928 01:55:21.474542 19896 tablet_bootstrap.cc:492] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:21.483510 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet d54979e5a0f74cc2a281792669506fdb (table default.Table_0f25cff84cae44ce94f88d85978c1dba [id=df2128aeb5ef482d9d29826bb71e0e10]) successfully deleted
I20260928 01:55:21.490696 19907 ts_tablet_manager.cc:1916] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.493520 19109 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 2120beacbd764f418a559189b7d06c00 (table default.Table_a8beedb7e2f3499cba462a232332880a [id=723cb039487b46c7887ec8a10626b0cd]). Expected version 1 got 0
I20260928 01:55:21.481834 19942 raft_consensus.cc:515] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:21.496750 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab702ddf7caf4c5eab5d0cea49724121" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:21.498365 19601 tablet_service.cc:1558] Processing DeleteTablet for tablet 5380b2b4da1c476b959a11cd8a20bf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:21.500177 19896 tablet_bootstrap.cc:654] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:21.500485 19556 leader_election.cc:343] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.501631 19942 leader_election.cc:290] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:21.502942 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab702ddf7caf4c5eab5d0cea49724121" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:21.503551 19768 raft_consensus.cc:3060] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:21.504748 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 5380b2b4da1c476b959a11cd8a20bf2d because the tablet was not found. No further retry: Not found: Tablet not found: 5380b2b4da1c476b959a11cd8a20bf2d
I20260928 01:55:21.510854 19768 raft_consensus.cc:2468] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:21.511302 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 3f08e6838341436f8a85d6dbafc805df (DEFAULT_TABLE table=default.Table_e72befab9eb14455817f899a410e6f0b [id=e17a4562755a46b6922715042f9d07d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.512519 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f08e6838341436f8a85d6dbafc805df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.512323 19553 leader_election.cc:304] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:21.513638 19942 raft_consensus.cc:2804] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:21.514180 19942 raft_consensus.cc:697] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:21.515142 19942 consensus_queue.cc:237] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:21.516280 19896 tablet_bootstrap.cc:492] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:21.516568 19452 tablet_service.cc:1558] Processing DeleteTablet for tablet d54979e5a0f74cc2a281792669506fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:21.516781 19896 ts_tablet_manager.cc:1403] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.011s
I20260928 01:55:21.516783 19907 ts_tablet_manager.cc:1929] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.517230 19907 log.cc:1199] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/29bf124261034ebf8595eeaae9d96d73
I20260928 01:55:21.517953 19907 ts_tablet_manager.cc:1950] T 29bf124261034ebf8595eeaae9d96d73 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:21.522197 19896 raft_consensus.cc:359] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:21.522958 19896 raft_consensus.cc:385] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.523252 19896 raft_consensus.cc:740] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.524220 19907 tablet_replica.cc:333] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:21.523988 19896 consensus_queue.cc:260] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:21.526582 19896 ts_tablet_manager.cc:1434] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260928 01:55:21.525040 19907 raft_consensus.cc:2243] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:21.527619 19896 tablet_bootstrap.cc:492] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:21.527580 19907 pending_rounds.cc:70] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: Trying to abort 1 pending ops.
I20260928 01:55:21.530586 19907 pending_rounds.cc:77] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135894009348096 op_type: NO_OP noop_request { }
I20260928 01:55:21.531055 19907 raft_consensus.cc:2889] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:21.531430 19907 raft_consensus.cc:2272] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.534749 19896 tablet_bootstrap.cc:654] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.535053 19907 ts_tablet_manager.cc:1916] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.545369 19903 raft_consensus.cc:493] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:21.545984 19896 tablet_bootstrap.cc:492] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:21.545854 19903 raft_consensus.cc:515] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:21.546439 19896 ts_tablet_manager.cc:1403] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.019s	user 0.000s	sys 0.016s
I20260928 01:55:21.549441 19896 raft_consensus.cc:359] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.550128 19896 raft_consensus.cc:385] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.550400 19896 raft_consensus.cc:740] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
W20260928 01:55:21.550865 19412 leader_election.cc:343] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 31d1535707ae4fa89a605a551c5cfb9e
I20260928 01:55:21.551271 19896 consensus_queue.cc:260] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.552680 19907 ts_tablet_manager.cc:1929] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:21.553035 19907 log.cc:1199] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/31d1535707ae4fa89a605a551c5cfb9e
I20260928 01:55:21.553786 19907 ts_tablet_manager.cc:1950] T 31d1535707ae4fa89a605a551c5cfb9e P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:21.553907 19896 ts_tablet_manager.cc:1434] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260928 01:55:21.554881 19896 tablet_bootstrap.cc:492] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:21.556852 19907 tablet_replica.cc:333] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:21.557722 19907 raft_consensus.cc:2243] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:21.558199 19907 raft_consensus.cc:2272] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.560611 19907 ts_tablet_manager.cc:1916] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.561136 19896 tablet_bootstrap.cc:654] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.570631 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 3f08e6838341436f8a85d6dbafc805df (DEFAULT_TABLE table=default.Table_e72befab9eb14455817f899a410e6f0b [id=e17a4562755a46b6922715042f9d07d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.571079 19452 tablet_service.cc:1511] Processing CreateTablet for tablet efa8a7589d314c25aeccf678c938ecf0 (DEFAULT_TABLE table=default.Table_d5185be74c414c8a886b3b5ccebf4cd7 [id=3e43587428fb4c679f8222cf3c30d08d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.571856 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f08e6838341436f8a85d6dbafc805df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.572655 19452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa8a7589d314c25aeccf678c938ecf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.575212 19600 tablet_service.cc:1511] Processing CreateTablet for tablet efa8a7589d314c25aeccf678c938ecf0 (DEFAULT_TABLE table=default.Table_d5185be74c414c8a886b3b5ccebf4cd7 [id=3e43587428fb4c679f8222cf3c30d08d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.575893 19907 ts_tablet_manager.cc:1929] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.576277 19907 log.cc:1199] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/5380b2b4da1c476b959a11cd8a20bf2d
I20260928 01:55:21.576382 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa8a7589d314c25aeccf678c938ecf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.576979 19907 ts_tablet_manager.cc:1950] T 5380b2b4da1c476b959a11cd8a20bf2d P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:21.578620 19110 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_a8beedb7e2f3499cba462a232332880a" } modify_external_catalogs: true
I20260928 01:55:21.579246 19110 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_a8beedb7e2f3499cba462a232332880a" } modify_external_catalogs: true
I20260928 01:55:21.579555 19116 master_service.cc:960] ReplaceTablet: received request to replace tablet ab702ddf7caf4c5eab5d0cea49724121 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:21.580181 19907 tablet_replica.cc:333] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:21.580961 19907 raft_consensus.cc:2243] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:21.581060 19747 tablet_service.cc:1511] Processing CreateTablet for tablet 3f08e6838341436f8a85d6dbafc805df (DEFAULT_TABLE table=default.Table_e72befab9eb14455817f899a410e6f0b [id=e17a4562755a46b6922715042f9d07d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.581476 19907 raft_consensus.cc:2272] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.582247 19747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f08e6838341436f8a85d6dbafc805df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.585481 19111 master_service.cc:960] ReplaceTablet: received request to replace tablet 29bf124261034ebf8595eeaae9d96d73 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:21.590629 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_a880aa6453b54575a6c2741c2d07be1f"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:21.592871 19907 ts_tablet_manager.cc:1916] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:55:21.592867 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a880aa6453b54575a6c2741c2d07be1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:21.548036 19903 leader_election.cc:290] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:21.598601 19409 leader_election.cc:343] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: 31d1535707ae4fa89a605a551c5cfb9e
I20260928 01:55:21.599116 19409 leader_election.cc:304] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:21.602739 19115 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_2aaf4ac3068c408db62d4261692c1abf" } modify_external_catalogs: true
I20260928 01:55:21.603350 19115 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_2aaf4ac3068c408db62d4261692c1abf" } modify_external_catalogs: true
I20260928 01:55:21.607115 19903 raft_consensus.cc:2749] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:21.503319 19118 catalog_manager.cc:5838] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:21.610255 19118 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 2120beacbd764f418a559189b7d06c00 (table default.Table_a8beedb7e2f3499cba462a232332880a [id=723cb039487b46c7887ec8a10626b0cd]). Expected version 1 got 0
I20260928 01:55:21.628062 19894 tablet_bootstrap.cc:492] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:21.629405 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_26116cab8a164e2cb26e73efbde6d923"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:21.630915 19896 tablet_bootstrap.cc:492] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:21.631337 19896 ts_tablet_manager.cc:1403] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.016s
W20260928 01:55:21.631382 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26116cab8a164e2cb26e73efbde6d923 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:21.632731 19890 tablet_bootstrap.cc:492] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:21.633663 19894 tablet_bootstrap.cc:654] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.636502 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_3fd91eebe68a4037a65ad0c88be99393"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:21.638266 19890 tablet_bootstrap.cc:654] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:21.638334 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fd91eebe68a4037a65ad0c88be99393 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:21.640637 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 29bf124261034ebf8595eeaae9d96d73 (table default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]) successfully deleted
I20260928 01:55:21.643505 19907 ts_tablet_manager.cc:1929] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.643515 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 31d1535707ae4fa89a605a551c5cfb9e (table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]) successfully deleted
I20260928 01:55:21.643864 19907 log.cc:1199] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/d83b071a5ec24eefb9bae5e75faf6d5b
I20260928 01:55:21.649731 19601 tablet_service.cc:1511] Processing CreateTablet for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 (DEFAULT_TABLE table=default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.650887 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.651058 19907 ts_tablet_manager.cc:1950] T d83b071a5ec24eefb9bae5e75faf6d5b P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:21.652477 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 5380b2b4da1c476b959a11cd8a20bf2d (table default.Table_6426312da3e54b60856f51d856be63a6 [id=a7ba65289ffb41f99d1744f084739dda]) successfully deleted
I20260928 01:55:21.653918 19890 tablet_bootstrap.cc:492] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:21.654316 19890 ts_tablet_manager.cc:1403] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.001s
I20260928 01:55:21.656375 19747 tablet_service.cc:1511] Processing CreateTablet for tablet efa8a7589d314c25aeccf678c938ecf0 (DEFAULT_TABLE table=default.Table_d5185be74c414c8a886b3b5ccebf4cd7 [id=3e43587428fb4c679f8222cf3c30d08d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.657011 19890 raft_consensus.cc:359] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.657405 19455 tablet_service.cc:1511] Processing CreateTablet for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 (DEFAULT_TABLE table=default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.657696 19747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa8a7589d314c25aeccf678c938ecf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.657831 19890 raft_consensus.cc:385] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.658111 19890 raft_consensus.cc:740] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.658798 19890 consensus_queue.cc:260] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.657824 19896 raft_consensus.cc:359] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.663563 19896 raft_consensus.cc:385] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.665241 19454 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5d78f6a3c14931b0033ef5ab76f701 (DEFAULT_TABLE table=default.Table_ef58636bc26841e2b545339d5674d8c8 [id=b40893608e4a4237ae1f2b14101fc2a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.666570 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5d78f6a3c14931b0033ef5ab76f701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.663867 19896 raft_consensus.cc:740] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.668867 19896 consensus_queue.cc:260] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.670794 19896 ts_tablet_manager.cc:1434] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260928 01:55:21.672803 19903 raft_consensus.cc:493] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:21.673261 19903 raft_consensus.cc:515] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.675400 19894 tablet_bootstrap.cc:492] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:21.675815 19894 ts_tablet_manager.cc:1403] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.000s
I20260928 01:55:21.676862 19890 ts_tablet_manager.cc:1434] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260928 01:55:21.678246 19890 tablet_bootstrap.cc:492] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:21.678251 19896 tablet_bootstrap.cc:492] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:21.678486 19412 leader_election.cc:343] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: d83b071a5ec24eefb9bae5e75faf6d5b
I20260928 01:55:21.682020 19903 leader_election.cc:290] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:21.681499 19894 raft_consensus.cc:359] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.682423 19894 raft_consensus.cc:385] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.682683 19894 raft_consensus.cc:740] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:55:21.683004 19409 leader_election.cc:343] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: d83b071a5ec24eefb9bae5e75faf6d5b
I20260928 01:55:21.683391 19409 leader_election.cc:304] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:21.683287 19894 consensus_queue.cc:260] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.683825 19896 tablet_bootstrap.cc:654] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.684688 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.690698 19903 raft_consensus.cc:2749] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:21.694743 19909 tablet_replica.cc:333] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:21.694583 19746 tablet_service.cc:1511] Processing CreateTablet for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 (DEFAULT_TABLE table=default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.695564 19909 raft_consensus.cc:2243] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:21.695780 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.696050 19909 raft_consensus.cc:2272] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.698725 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5d78f6a3c14931b0033ef5ab76f701 (DEFAULT_TABLE table=default.Table_ef58636bc26841e2b545339d5674d8c8 [id=b40893608e4a4237ae1f2b14101fc2a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.699813 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5d78f6a3c14931b0033ef5ab76f701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.708829 19909 ts_tablet_manager.cc:1916] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.709972 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet d83b071a5ec24eefb9bae5e75faf6d5b (table default.Table_f045c1706de24bcdb20184c345632404 [id=67a5a466dfa54e2384f915271a66a8b8]) successfully deleted
I20260928 01:55:21.711674 19894 ts_tablet_manager.cc:1434] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
W20260928 01:55:21.728132 19112 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 952df055998942f89baabb341e204f43 has no consensus state
I20260928 01:55:21.729205 19112 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_fea69b0ce347435092a720e7c672d639" } new_table_name: "default.Table_a2a87b5badd741caa9c92c3a137b0a2d" modify_external_catalogs: true
I20260928 01:55:21.732462 19942 raft_consensus.cc:493] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:21.732952 19942 raft_consensus.cc:515] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.734953 19942 leader_election.cc:290] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:21.737563 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2120beacbd764f418a559189b7d06c00" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:21.737408 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_7be970fbb13745978e6b90a9a7d84fb7"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:21.738155 19768 raft_consensus.cc:2468] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
W20260928 01:55:21.739099 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7be970fbb13745978e6b90a9a7d84fb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:21.739704 19453 tablet_service.cc:1558] Processing DeleteTablet for tablet b98e030c427e4d64b5887d42d21c6411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:21.741878 19894 tablet_bootstrap.cc:492] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:21.741746 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2120beacbd764f418a559189b7d06c00" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:21.743121 19116 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet ab702ddf7caf4c5eab5d0cea49724121
I20260928 01:55:21.744788 19116 catalog_manager.cc:6934] ReplaceTablet: tablet ab702ddf7caf4c5eab5d0cea49724121 deleted and replaced by tablet 457837143b0f4763a4b91bb25b580477
I20260928 01:55:21.745177 19115 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 384e495c32204ae6ab2e884f1deede40
I20260928 01:55:21.747563 19894 tablet_bootstrap.cc:654] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.748914 19553 leader_election.cc:304] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:21.750001 19556 leader_election.cc:343] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.750962 19890 tablet_bootstrap.cc:654] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.751348 19599 tablet_service.cc:1558] Processing DeleteTablet for tablet ab702ddf7caf4c5eab5d0cea49724121 with delete_type TABLET_DATA_DELETED (replaced by tablet 457837143b0f4763a4b91bb25b580477) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:21.752060 19908 tablet_replica.cc:333] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:21.752748 19908 raft_consensus.cc:2243] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:21.753394 19908 pending_rounds.cc:70] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0: Trying to abort 1 pending ops.
I20260928 01:55:21.753603 19908 pending_rounds.cc:77] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135896141897728 op_type: NO_OP noop_request { }
I20260928 01:55:21.753939 19908 raft_consensus.cc:2889] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:21.754236 19908 raft_consensus.cc:2272] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.755612 19453 tablet_service.cc:1558] Processing DeleteTablet for tablet ab702ddf7caf4c5eab5d0cea49724121 with delete_type TABLET_DATA_DELETED (replaced by tablet 457837143b0f4763a4b91bb25b580477) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:21.758556 19894 tablet_bootstrap.cc:492] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:21.758977 19894 ts_tablet_manager.cc:1403] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.001s
I20260928 01:55:21.758832 19942 raft_consensus.cc:2804] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:21.759243 19942 raft_consensus.cc:493] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:21.759552 19942 raft_consensus.cc:3060] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:21.760705 19908 ts_tablet_manager.cc:1916] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.761684 19894 raft_consensus.cc:359] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.762301 19894 raft_consensus.cc:385] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.762773 19894 raft_consensus.cc:740] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.763515 19894 consensus_queue.cc:260] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.772534 19942 raft_consensus.cc:515] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:21.775868 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 60221.2us
I20260928 01:55:21.778102 19747 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5d78f6a3c14931b0033ef5ab76f701 (DEFAULT_TABLE table=default.Table_ef58636bc26841e2b545339d5674d8c8 [id=b40893608e4a4237ae1f2b14101fc2a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.779245 19747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5d78f6a3c14931b0033ef5ab76f701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.788973 19746 tablet_service.cc:1558] Processing DeleteTablet for tablet ab702ddf7caf4c5eab5d0cea49724121 with delete_type TABLET_DATA_DELETED (replaced by tablet 457837143b0f4763a4b91bb25b580477) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:21.789119 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2120beacbd764f418a559189b7d06c00" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:21.789786 19907 tablet_replica.cc:333] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:21.790484 19907 raft_consensus.cc:2243] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 01:55:21.790762 19556 leader_election.cc:343] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.790951 19907 raft_consensus.cc:2272] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.793200 19907 ts_tablet_manager.cc:1916] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.798827 19942 leader_election.cc:290] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:21.799572 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2120beacbd764f418a559189b7d06c00" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:21.800423 19768 raft_consensus.cc:3060] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:21.806653 19890 tablet_bootstrap.cc:492] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:21.807117 19890 ts_tablet_manager.cc:1403] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.000s
I20260928 01:55:21.807118 19768 raft_consensus.cc:2468] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:21.808496 19553 leader_election.cc:304] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:21.809824 19942 raft_consensus.cc:2804] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:21.810006 19890 raft_consensus.cc:359] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.810626 19890 raft_consensus.cc:385] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.810910 19890 raft_consensus.cc:740] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.811913 19942 raft_consensus.cc:697] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:21.800426 19894 ts_tablet_manager.cc:1434] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260928 01:55:21.822114 19894 tablet_bootstrap.cc:492] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:21.827314 19908 ts_tablet_manager.cc:1929] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:21.827718 19908 log.cc:1199] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/ab702ddf7caf4c5eab5d0cea49724121
I20260928 01:55:21.812920 19942 consensus_queue.cc:237] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.828495 19908 ts_tablet_manager.cc:1950] T ab702ddf7caf4c5eab5d0cea49724121 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:21.830030 19890 consensus_queue.cc:260] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.835603 19890 ts_tablet_manager.cc:1434] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260928 01:55:21.835951 19896 tablet_bootstrap.cc:492] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:21.836475 19896 ts_tablet_manager.cc:1403] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.158s	user 0.008s	sys 0.002s
I20260928 01:55:21.837802 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet ab702ddf7caf4c5eab5d0cea49724121 (table default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]) successfully deleted
I20260928 01:55:21.841374 19890 tablet_bootstrap.cc:492] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:21.843727 19896 raft_consensus.cc:359] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.845363 19899 raft_consensus.cc:493] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:21.845811 19899 raft_consensus.cc:515] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.847813 19899 leader_election.cc:290] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:21.848292 19896 raft_consensus.cc:385] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.849566 19894 tablet_bootstrap.cc:654] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.850116 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa8a7589d314c25aeccf678c938ecf0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:21.850370 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa8a7589d314c25aeccf678c938ecf0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:21.851181 19896 raft_consensus.cc:740] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
W20260928 01:55:21.851650 19553 leader_election.cc:343] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:21.852118 19556 leader_election.cc:343] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.852532 19556 leader_election.cc:304] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:21.852738 19909 ts_tablet_manager.cc:1929] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.853142 19909 log.cc:1199] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/29bf124261034ebf8595eeaae9d96d73
I20260928 01:55:21.853611 19899 raft_consensus.cc:2749] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:21.853766 19909 ts_tablet_manager.cc:1950] T 29bf124261034ebf8595eeaae9d96d73 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:21.854727 19896 consensus_queue.cc:260] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.855600 19907 ts_tablet_manager.cc:1929] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.856549 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 29bf124261034ebf8595eeaae9d96d73 (table default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]) successfully deleted
W20260928 01:55:21.866089 19112 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e902da355b641868c207fc26578b739 has no consensus state
I20260928 01:55:21.855958 19907 log.cc:1199] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/ab702ddf7caf4c5eab5d0cea49724121
I20260928 01:55:21.868817 19907 ts_tablet_manager.cc:1950] T ab702ddf7caf4c5eab5d0cea49724121 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:21.868906 19110 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 2120beacbd764f418a559189b7d06c00
I20260928 01:55:21.872435 19601 tablet_service.cc:1558] Processing DeleteTablet for tablet 2120beacbd764f418a559189b7d06c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:21 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:21.873243 19908 tablet_replica.cc:333] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:21.873953 19908 raft_consensus.cc:2243] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:21.874728 19908 pending_rounds.cc:70] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0: Trying to abort 1 pending ops.
I20260928 01:55:21.874969 19908 pending_rounds.cc:77] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135897467801600 op_type: NO_OP noop_request { }
I20260928 01:55:21.875309 19908 raft_consensus.cc:2889] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:21.875689 19908 raft_consensus.cc:2272] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.877316 19747 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d1535707ae4fa89a605a551c5cfb9e with delete_type TABLET_DATA_DELETED (replaced by tablet 7801c623930d4e4eaf24c5c424b06d26) from {username='slave'} at 127.0.0.1:44964
W20260928 01:55:21.877889 19960 consensus_queue.cc:1175] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a3ee288ca1464d20a715673422a214a0" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260928 01:55:21.880422 19908 ts_tablet_manager.cc:1916] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.877594 19890 tablet_bootstrap.cc:654] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.889307 19746 tablet_service.cc:1558] Processing DeleteTablet for tablet 29bf124261034ebf8595eeaae9d96d73 with delete_type TABLET_DATA_DELETED (replaced by tablet c8bbb627a14a477c9362d2b250f27c1e) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:21.890213 19746 tablet_service.cc:1558] Processing DeleteTablet for tablet b98e030c427e4d64b5887d42d21c6411 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:21.891958 19746 tablet_service.cc:1558] Processing DeleteTablet for tablet 5380b2b4da1c476b959a11cd8a20bf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:21.893674 19746 tablet_service.cc:1558] Processing DeleteTablet for tablet 2120beacbd764f418a559189b7d06c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:21 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:21.894322 19907 tablet_replica.cc:333] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:21.894939 19907 raft_consensus.cc:2243] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:21.895357 19907 raft_consensus.cc:2272] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.897642 19894 tablet_bootstrap.cc:492] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:21.898053 19894 ts_tablet_manager.cc:1403] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.076s	user 0.007s	sys 0.007s
I20260928 01:55:21.898404 19890 tablet_bootstrap.cc:492] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:21.898828 19890 ts_tablet_manager.cc:1403] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.058s	user 0.005s	sys 0.005s
I20260928 01:55:21.899709 19907 ts_tablet_manager.cc:1916] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.901237 19890 raft_consensus.cc:359] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.901898 19890 raft_consensus.cc:385] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.908476 19747 tablet_service.cc:1558] Processing DeleteTablet for tablet d54979e5a0f74cc2a281792669506fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:21.875156 19909 tablet_replica.cc:333] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:21.899340 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet 2120beacbd764f418a559189b7d06c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:21 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:21.899645 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet ab702ddf7caf4c5eab5d0cea49724121 (table default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]) successfully deleted
W20260928 01:55:21.910277 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 31d1535707ae4fa89a605a551c5cfb9e because the tablet was not found. No further retry: Not found: Tablet not found: 31d1535707ae4fa89a605a551c5cfb9e
I20260928 01:55:21.910154 19894 raft_consensus.cc:359] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.910813 19894 raft_consensus.cc:385] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:21.902155 19890 raft_consensus.cc:740] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
W20260928 01:55:21.911334 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 29bf124261034ebf8595eeaae9d96d73 because the tablet was not found. No further retry: Not found: Tablet not found: 29bf124261034ebf8595eeaae9d96d73
W20260928 01:55:21.911976 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet b98e030c427e4d64b5887d42d21c6411 because the tablet was not found. No further retry: Not found: Tablet not found: b98e030c427e4d64b5887d42d21c6411
W20260928 01:55:21.912611 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 5380b2b4da1c476b959a11cd8a20bf2d because the tablet was not found. No further retry: Not found: Tablet not found: 5380b2b4da1c476b959a11cd8a20bf2d
I20260928 01:55:21.918608 19909 raft_consensus.cc:2243] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:21.916329 19896 ts_tablet_manager.cc:1434] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260928 01:55:21.919117 19909 raft_consensus.cc:2272] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:21.919988 19896 tablet_bootstrap.cc:492] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:21.911177 19894 raft_consensus.cc:740] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:21.921391 19909 ts_tablet_manager.cc:1916] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:21.923203 19894 consensus_queue.cc:260] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.928305 19896 tablet_bootstrap.cc:654] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.913270 19890 consensus_queue.cc:260] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.930051 19890 ts_tablet_manager.cc:1434] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260928 01:55:21.933913 19894 ts_tablet_manager.cc:1434] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.003s
I20260928 01:55:21.947154 19910 raft_consensus.cc:493] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:21.947670 19910 raft_consensus.cc:515] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.949946 19910 leader_election.cc:290] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:21.930912 19890 tablet_bootstrap.cc:492] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:21.951973 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f08e6838341436f8a85d6dbafc805df" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:21.952438 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f08e6838341436f8a85d6dbafc805df" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:21.952670 19621 raft_consensus.cc:2468] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:21.954206 19704 leader_election.cc:304] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:21.955004 19703 leader_election.cc:343] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:21.955837 19910 raft_consensus.cc:2804] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:21.956233 19910 raft_consensus.cc:493] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:21.956553 19910 raft_consensus.cc:3060] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:21.956700 19908 ts_tablet_manager.cc:1929] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:21.957058 19908 log.cc:1199] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/2120beacbd764f418a559189b7d06c00
I20260928 01:55:21.957813 19908 ts_tablet_manager.cc:1950] T 2120beacbd764f418a559189b7d06c00 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:21.960474 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 2120beacbd764f418a559189b7d06c00 (table default.Table_a8beedb7e2f3499cba462a232332880a [id=723cb039487b46c7887ec8a10626b0cd]) successfully deleted
I20260928 01:55:21.969017 19909 ts_tablet_manager.cc:1929] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:21.970701 19894 tablet_bootstrap.cc:492] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:21.978339 19118 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 3f08e6838341436f8a85d6dbafc805df (table default.Table_e72befab9eb14455817f899a410e6f0b [id=e17a4562755a46b6922715042f9d07d3]). Expected version 1 got 0
I20260928 01:55:21.980154 19747 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd4743c49314e8b8d86e1c6e553b13e (DEFAULT_TABLE table=default.Table_ba101536dd544f75a023727ab9ef2ac7 [id=c9816a660a324eb9a6eeb87f2f1e9422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.981451 19747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd4743c49314e8b8d86e1c6e553b13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.963958 19910 raft_consensus.cc:515] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:21.986701 19601 tablet_service.cc:1558] Processing DeleteTablet for tablet 2120beacbd764f418a559189b7d06c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:21 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:21.988075 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd4743c49314e8b8d86e1c6e553b13e (DEFAULT_TABLE table=default.Table_ba101536dd544f75a023727ab9ef2ac7 [id=c9816a660a324eb9a6eeb87f2f1e9422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.989343 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd4743c49314e8b8d86e1c6e553b13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:21.993026 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_e00defcfcf9b4b74a81aae492a4ab74c"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:21.994174 19894 tablet_bootstrap.cc:654] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:21.994292 19117 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_ef58636bc26841e2b545339d5674d8c8" } new_table_name: "default.Table_de632f40c91243848f008af01906cc16" modify_external_catalogs: true
W20260928 01:55:21.994830 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e00defcfcf9b4b74a81aae492a4ab74c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:21.996564 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_a47ad43bf23c4fa8b30c2aa4a8d66767"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:21.998075 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f08e6838341436f8a85d6dbafc805df" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:21.998327 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a47ad43bf23c4fa8b30c2aa4a8d66767 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:21.998694 19621 raft_consensus.cc:3060] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:22.000613 19942 raft_consensus.cc:493] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:22.000805 19115 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_542dd0839d9f40ed942c4e1ab3e12098"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:22.001056 19942 raft_consensus.cc:515] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:22.002467 19115 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_542dd0839d9f40ed942c4e1ab3e12098 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:22.003036 19942 leader_election.cc:290] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:22.007954 19110 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 3f08e6838341436f8a85d6dbafc805df (table default.Table_e72befab9eb14455817f899a410e6f0b [id=e17a4562755a46b6922715042f9d07d3]). Expected version 1 got 0
I20260928 01:55:22.009351 19621 raft_consensus.cc:2468] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:22.010603 19704 leader_election.cc:304] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:22.010675 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb7f3e609144f5a9dcc8b40d21dbb2" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:22.011777 19768 raft_consensus.cc:2468] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:22.013360 19553 leader_election.cc:304] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:22.014309 19942 raft_consensus.cc:2804] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:22.014681 19942 raft_consensus.cc:493] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:22.014987 19942 raft_consensus.cc:3060] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:22.017838 19910 leader_election.cc:290] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:22.018473 19890 tablet_bootstrap.cc:654] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.018407 19910 raft_consensus.cc:2804] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:22.018826 19910 raft_consensus.cc:697] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
W20260928 01:55:22.021132 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 2120beacbd764f418a559189b7d06c00 because the tablet was not found. No further retry: Not found: Tablet not found: 2120beacbd764f418a559189b7d06c00
I20260928 01:55:21.981977 19454 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd4743c49314e8b8d86e1c6e553b13e (DEFAULT_TABLE table=default.Table_ba101536dd544f75a023727ab9ef2ac7 [id=c9816a660a324eb9a6eeb87f2f1e9422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:21.987157 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f08e6838341436f8a85d6dbafc805df" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:21.992391 19903 raft_consensus.cc:493] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:22.025134 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd4743c49314e8b8d86e1c6e553b13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.025303 19903 raft_consensus.cc:515] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:22.027664 19903 leader_election.cc:290] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:22.004989 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb7f3e609144f5a9dcc8b40d21dbb2" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:22.030055 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2120beacbd764f418a559189b7d06c00" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:22.030056 19703 leader_election.cc:343] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:22.032155 19409 leader_election.cc:343] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: Tablet not RUNNING: STOPPED
W20260928 01:55:22.035117 19412 leader_election.cc:343] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 2120beacbd764f418a559189b7d06c00
I20260928 01:55:22.035666 19909 log.cc:1199] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/d83b071a5ec24eefb9bae5e75faf6d5b
W20260928 01:55:22.036118 19556 leader_election.cc:343] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:22.035569 19412 leader_election.cc:304] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:22.037302 19903 raft_consensus.cc:2749] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:22.019631 19910 consensus_queue.cc:237] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:22.038594 19909 ts_tablet_manager.cc:1950] T d83b071a5ec24eefb9bae5e75faf6d5b P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:22.039316 19907 ts_tablet_manager.cc:1929] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:22.039678 19907 log.cc:1199] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/2120beacbd764f418a559189b7d06c00
I20260928 01:55:22.040304 19907 ts_tablet_manager.cc:1950] T 2120beacbd764f418a559189b7d06c00 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:22.041673 19118 master_service.cc:960] ReplaceTablet: received request to replace tablet b98e030c427e4d64b5887d42d21c6411 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:22.041991 19116 master_service.cc:960] ReplaceTablet: received request to replace tablet ab702ddf7caf4c5eab5d0cea49724121 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:22.042455 19110 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_88ced5d20fea41538f5221b8f4367570" } modify_external_catalogs: true
I20260928 01:55:22.044749 19110 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_88ced5d20fea41538f5221b8f4367570" } modify_external_catalogs: true
I20260928 01:55:22.051617 19909 tablet_replica.cc:333] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:22.052320 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet d83b071a5ec24eefb9bae5e75faf6d5b (table default.Table_f045c1706de24bcdb20184c345632404 [id=67a5a466dfa54e2384f915271a66a8b8]) successfully deleted
I20260928 01:55:22.065060 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 2120beacbd764f418a559189b7d06c00 (table default.Table_a8beedb7e2f3499cba462a232332880a [id=723cb039487b46c7887ec8a10626b0cd]) successfully deleted
W20260928 01:55:22.065868 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet d54979e5a0f74cc2a281792669506fdb because the tablet was not found. No further retry: Not found: Tablet not found: d54979e5a0f74cc2a281792669506fdb
I20260928 01:55:22.066006 19894 tablet_bootstrap.cc:492] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:22.066421 19894 ts_tablet_manager.cc:1403] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.096s	user 0.007s	sys 0.006s
I20260928 01:55:22.070130 19894 raft_consensus.cc:359] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.070791 19894 raft_consensus.cc:385] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.071050 19894 raft_consensus.cc:740] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.072261 19890 tablet_bootstrap.cc:492] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:22.072788 19890 ts_tablet_manager.cc:1403] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.142s	user 0.005s	sys 0.006s
W20260928 01:55:22.073603 19117 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a5d78f6a3c14931b0033ef5ab76f701 consensus state has no leader
I20260928 01:55:22.076287 19894 consensus_queue.cc:260] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.079622 19890 raft_consensus.cc:359] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.080327 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 0e902da355b641868c207fc26578b739 (DEFAULT_TABLE table=default.Table_a2a87b5badd741caa9c92c3a137b0a2d [id=136676f3aa8a473699bc8c172b81929a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.081075 19909 raft_consensus.cc:2243] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:22.081492 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e902da355b641868c207fc26578b739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.083765 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 952df055998942f89baabb341e204f43 (DEFAULT_TABLE table=default.Table_88ced5d20fea41538f5221b8f4367570 [id=d09064e0c8664ffd9e2fbf72f49b8e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.086621 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952df055998942f89baabb341e204f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.088910 19896 tablet_bootstrap.cc:492] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:22.089347 19896 ts_tablet_manager.cc:1403] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.170s	user 0.012s	sys 0.000s
I20260928 01:55:22.092962 19896 raft_consensus.cc:359] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:22.081658 19909 raft_consensus.cc:2272] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:22.096031 19894 ts_tablet_manager.cc:1434] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260928 01:55:22.093585 19896 raft_consensus.cc:385] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.097110 19896 raft_consensus.cc:740] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.097471 19746 tablet_service.cc:1511] Processing CreateTablet for tablet 0e902da355b641868c207fc26578b739 (DEFAULT_TABLE table=default.Table_a2a87b5badd741caa9c92c3a137b0a2d [id=136676f3aa8a473699bc8c172b81929a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.097735 19896 consensus_queue.cc:260] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:22.082154 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 0e902da355b641868c207fc26578b739 (DEFAULT_TABLE table=default.Table_a2a87b5badd741caa9c92c3a137b0a2d [id=136676f3aa8a473699bc8c172b81929a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.098626 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e902da355b641868c207fc26578b739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.099239 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e902da355b641868c207fc26578b739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.106835 19896 ts_tablet_manager.cc:1434] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260928 01:55:22.110824 19896 tablet_bootstrap.cc:492] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:22.087508 19942 raft_consensus.cc:515] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:22.113406 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb7f3e609144f5a9dcc8b40d21dbb2" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:22.113637 19942 leader_election.cc:290] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:22.114950 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb7f3e609144f5a9dcc8b40d21dbb2" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:55:22.115124 19556 leader_election.cc:343] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:22.115604 19768 raft_consensus.cc:3060] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:22.117223 19890 raft_consensus.cc:385] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.117533 19890 raft_consensus.cc:740] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.118216 19890 consensus_queue.cc:260] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.125218 19909 ts_tablet_manager.cc:1916] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:22.126432 19768 raft_consensus.cc:2468] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:22.127964 19553 leader_election.cc:304] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:22.129544 19899 raft_consensus.cc:2804] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:22.130077 19899 raft_consensus.cc:697] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:22.130968 19899 consensus_queue.cc:237] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:22.134613 19896 tablet_bootstrap.cc:654] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.144245 19890 ts_tablet_manager.cc:1434] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.001s
I20260928 01:55:22.148269 19896 tablet_bootstrap.cc:492] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:22.151041 19112 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 8a5d78f6a3c14931b0033ef5ab76f701 (table default.Table_de632f40c91243848f008af01906cc16 [id=b40893608e4a4237ae1f2b14101fc2a9]). Expected version 1 got 0
I20260928 01:55:22.151960 19896 ts_tablet_manager.cc:1403] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260928 01:55:22.155932 19969 raft_consensus.cc:493] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:22.156740 19890 tablet_bootstrap.cc:492] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:22.156468 19969 raft_consensus.cc:515] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:22.159493 19105 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8a5d78f6a3c14931b0033ef5ab76f701 (table default.Table_de632f40c91243848f008af01906cc16 [id=b40893608e4a4237ae1f2b14101fc2a9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8a5d78f6a3c14931b0033ef5ab76f701 consensus state has no leader
I20260928 01:55:22.160561 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5d78f6a3c14931b0033ef5ab76f701" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:22.161253 19621 raft_consensus.cc:2468] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:22.162791 19704 leader_election.cc:304] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:22.164247 19969 leader_election.cc:290] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:22.164991 19890 tablet_bootstrap.cc:654] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.165666 19476 raft_consensus.cc:3060] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:22.172312 19909 ts_tablet_manager.cc:1929] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:22.172768 19909 log.cc:1199] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/31d1535707ae4fa89a605a551c5cfb9e
I20260928 01:55:22.173189 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5d78f6a3c14931b0033ef5ab76f701" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:22.173534 19909 ts_tablet_manager.cc:1950] T 31d1535707ae4fa89a605a551c5cfb9e P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:22.178059 19969 raft_consensus.cc:2804] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:22.178586 19969 raft_consensus.cc:493] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:22.179051 19969 raft_consensus.cc:3060] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:22.179991 19890 tablet_bootstrap.cc:492] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:22.180464 19890 ts_tablet_manager.cc:1403] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.004s
W20260928 01:55:22.181602 19104 consensus_peers.cc:597] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc -> Peer 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095): Couldn't send request to peer 04e48edd841a42d08a480be209f0d294. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260928 01:55:22.182752 19703 leader_election.cc:343] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:22.183527 19890 raft_consensus.cc:359] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.186197 19112 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 8a5d78f6a3c14931b0033ef5ab76f701 (table default.Table_de632f40c91243848f008af01906cc16 [id=b40893608e4a4237ae1f2b14101fc2a9]). Expected version 1 got 0
I20260928 01:55:22.184160 19890 raft_consensus.cc:385] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.187418 19112 catalog_manager.cc:5838] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:55:22.188694 19890 raft_consensus.cc:740] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.190346 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 31d1535707ae4fa89a605a551c5cfb9e (table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]) successfully deleted
I20260928 01:55:22.191501 19909 tablet_replica.cc:333] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:22.191368 19975 consensus_queue.cc:1048] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:22.192427 19909 raft_consensus.cc:2243] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:22.193212 19890 consensus_queue.cc:260] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.198076 19909 raft_consensus.cc:2272] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:22.199087 19890 ts_tablet_manager.cc:1434] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260928 01:55:22.203114 19890 tablet_bootstrap.cc:492] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:22.210592 19909 ts_tablet_manager.cc:1916] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:22.213827 19890 tablet_bootstrap.cc:654] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.222167 19896 raft_consensus.cc:359] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.223064 19969 raft_consensus.cc:515] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.237596 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_0ccbac9e2d8946229a807195f0c6de64"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:22.239416 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ccbac9e2d8946229a807195f0c6de64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:22.252440 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 952df055998942f89baabb341e204f43 (DEFAULT_TABLE table=default.Table_88ced5d20fea41538f5221b8f4367570 [id=d09064e0c8664ffd9e2fbf72f49b8e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.253736 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952df055998942f89baabb341e204f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.253595 19116 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_de632f40c91243848f008af01906cc16" } modify_external_catalogs: true
I20260928 01:55:22.254168 19116 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_de632f40c91243848f008af01906cc16" } modify_external_catalogs: true
I20260928 01:55:22.255313 19896 raft_consensus.cc:385] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.255610 19896 raft_consensus.cc:740] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.256685 19118 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_e72befab9eb14455817f899a410e6f0b" } new_table_name: "default.Table_4a2d24baaa4742b0aa00abd564613b46" modify_external_catalogs: true
I20260928 01:55:22.259477 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5d78f6a3c14931b0033ef5ab76f701" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:22.259284 19113 catalog_manager.cc:5838] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
W20260928 01:55:22.261077 19703 leader_election.cc:343] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:22.261255 19113 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 3f08e6838341436f8a85d6dbafc805df (table default.Table_e72befab9eb14455817f899a410e6f0b [id=e17a4562755a46b6922715042f9d07d3]). Expected version 1 got 0
I20260928 01:55:22.264834 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5d78f6a3c14931b0033ef5ab76f701" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:22.265467 19621 raft_consensus.cc:3060] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:22.238749 19909 ts_tablet_manager.cc:1929] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:22.248590 19903 raft_consensus.cc:493] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:22.270332 19903 raft_consensus.cc:515] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.272496 19903 leader_election.cc:290] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:22.272847 19621 raft_consensus.cc:2468] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:22.274120 19704 leader_election.cc:304] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
W20260928 01:55:22.275346 19412 leader_election.cc:343] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: b98e030c427e4d64b5887d42d21c6411
I20260928 01:55:22.275619 19910 raft_consensus.cc:2804] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:22.276064 19909 log.cc:1199] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/5380b2b4da1c476b959a11cd8a20bf2d
I20260928 01:55:22.276068 19910 raft_consensus.cc:697] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:22.276937 19909 ts_tablet_manager.cc:1950] T 5380b2b4da1c476b959a11cd8a20bf2d P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:22.278578 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 5380b2b4da1c476b959a11cd8a20bf2d (table default.Table_6426312da3e54b60856f51d856be63a6 [id=a7ba65289ffb41f99d1744f084739dda]) successfully deleted
W20260928 01:55:22.280652 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet d54979e5a0f74cc2a281792669506fdb because the tablet was not found. No further retry: Not found: Tablet not found: d54979e5a0f74cc2a281792669506fdb
I20260928 01:55:22.282332 19909 tablet_replica.cc:333] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:22.276908 19910 consensus_queue.cc:237] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.286789 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 7801c623930d4e4eaf24c5c424b06d26 (DEFAULT_TABLE table=default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.288115 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7801c623930d4e4eaf24c5c424b06d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.286368 19975 consensus_queue.cc:1048] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:22.299417 19969 leader_election.cc:290] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:22.284911 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 7801c623930d4e4eaf24c5c424b06d26 (DEFAULT_TABLE table=default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:22.303817 19409 leader_election.cc:343] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: b98e030c427e4d64b5887d42d21c6411
I20260928 01:55:22.304627 19409 leader_election.cc:304] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:22.305306 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7801c623930d4e4eaf24c5c424b06d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.306053 19903 raft_consensus.cc:2749] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:22.291597 19454 tablet_service.cc:1511] Processing CreateTablet for tablet c8bbb627a14a477c9362d2b250f27c1e (DEFAULT_TABLE table=default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.309186 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8bbb627a14a477c9362d2b250f27c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.311079 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 952df055998942f89baabb341e204f43 (DEFAULT_TABLE table=default.Table_88ced5d20fea41538f5221b8f4367570 [id=d09064e0c8664ffd9e2fbf72f49b8e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.312268 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952df055998942f89baabb341e204f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.312085 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 7801c623930d4e4eaf24c5c424b06d26 (DEFAULT_TABLE table=default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.313199 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7801c623930d4e4eaf24c5c424b06d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.328658 19910 raft_consensus.cc:493] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:22.329169 19910 raft_consensus.cc:515] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:22.331451 19910 leader_election.cc:290] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:22.332619 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa8a7589d314c25aeccf678c938ecf0" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:22.334658 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa8a7589d314c25aeccf678c938ecf0" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:22.335316 19621 raft_consensus.cc:2468] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:22.336418 19894 tablet_bootstrap.cc:492] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:22.262244 19896 consensus_queue.cc:260] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:22.341203 19703 leader_election.cc:343] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:22.343356 19896 ts_tablet_manager.cc:1434] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.191s	user 0.005s	sys 0.000s
I20260928 01:55:22.344072 19704 leader_election.cc:304] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:22.345844 19111 master_service.cc:960] ReplaceTablet: received request to replace tablet 8a5d78f6a3c14931b0033ef5ab76f701 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:22.349557 19896 tablet_bootstrap.cc:492] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:22.358394 19979 raft_consensus.cc:2804] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:22.359658 19110 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 952df055998942f89baabb341e204f43
I20260928 01:55:22.362696 19115 master_service.cc:960] ReplaceTablet: received request to replace tablet b98e030c427e4d64b5887d42d21c6411 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:22.363169 19599 tablet_service.cc:1558] Processing DeleteTablet for tablet 952df055998942f89baabb341e204f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:22.365367 19455 tablet_service.cc:1558] Processing DeleteTablet for tablet 952df055998942f89baabb341e204f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:22.366089 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 952df055998942f89baabb341e204f43 because the tablet was not found. No further retry: Not found: Tablet not found: 952df055998942f89baabb341e204f43
I20260928 01:55:22.350476 19909 raft_consensus.cc:2243] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:22.368786 19909 raft_consensus.cc:2272] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:22.370718 19909 ts_tablet_manager.cc:1916] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:22.364162 19894 tablet_bootstrap.cc:654] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.375527 19903 raft_consensus.cc:493] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:22.376017 19903 raft_consensus.cc:515] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.378226 19903 leader_election.cc:290] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:22.378654 19979 raft_consensus.cc:493] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:22.379045 19979 raft_consensus.cc:3060] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:22.381564 19409 leader_election.cc:343] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: ab702ddf7caf4c5eab5d0cea49724121
W20260928 01:55:22.383785 19412 leader_election.cc:343] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: ab702ddf7caf4c5eab5d0cea49724121
I20260928 01:55:22.384262 19412 leader_election.cc:304] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:22.385411 19903 raft_consensus.cc:2749] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:22.392917 19118 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3f08e6838341436f8a85d6dbafc805df consensus state has no leader
I20260928 01:55:22.397940 19109 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_3fd91eebe68a4037a65ad0c88be99393" } new_table_name: "default.Table_6af97903dc5d4f8a98ae918c9f3374a7" modify_external_catalogs: true
I20260928 01:55:22.396551 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_2afe705bbbf54cf89ddd625de776e846"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:22.401387 19455 tablet_service.cc:1558] Processing DeleteTablet for tablet 5380b2b4da1c476b959a11cd8a20bf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:20 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:22.403053 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2afe705bbbf54cf89ddd625de776e846 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:22.406132 19979 raft_consensus.cc:515] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:22.408408 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 61655.1us
I20260928 01:55:22.409164 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa8a7589d314c25aeccf678c938ecf0" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
W20260928 01:55:22.411115 19703 leader_election.cc:343] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:22.411239 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet 952df055998942f89baabb341e204f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:22.413677 19894 tablet_bootstrap.cc:492] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:22.414119 19894 ts_tablet_manager.cc:1403] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.005s
I20260928 01:55:22.417337 19894 raft_consensus.cc:359] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.417996 19894 raft_consensus.cc:385] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.418275 19894 raft_consensus.cc:740] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.419008 19599 tablet_service.cc:1511] Processing CreateTablet for tablet c8bbb627a14a477c9362d2b250f27c1e (DEFAULT_TABLE table=default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.420466 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8bbb627a14a477c9362d2b250f27c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.421154 19894 consensus_queue.cc:260] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.429718 19894 ts_tablet_manager.cc:1434] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260928 01:55:22.431744 19909 ts_tablet_manager.cc:1929] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:22.432147 19909 log.cc:1199] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/b98e030c427e4d64b5887d42d21c6411
I20260928 01:55:22.432845 19909 ts_tablet_manager.cc:1950] T b98e030c427e4d64b5887d42d21c6411 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:22.434644 19894 tablet_bootstrap.cc:492] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:22.435369 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet b98e030c427e4d64b5887d42d21c6411 (table default.Table_de8e96d7d6d24f81bf383241fad9f8cc [id=37c493e25b6a4468842a5ca467a82329]) successfully deleted
I20260928 01:55:22.444667 19894 tablet_bootstrap.cc:654] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.446261 19890 tablet_bootstrap.cc:492] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:22.446693 19890 ts_tablet_manager.cc:1403] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.247s	user 0.030s	sys 0.009s
I20260928 01:55:22.448419 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa8a7589d314c25aeccf678c938ecf0" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:22.448998 19620 raft_consensus.cc:3060] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:22.449189 19890 raft_consensus.cc:359] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.449796 19890 raft_consensus.cc:385] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.450055 19890 raft_consensus.cc:740] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.450902 19890 consensus_queue.cc:260] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.456598 19620 raft_consensus.cc:2468] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:22.457418 19890 ts_tablet_manager.cc:1434] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260928 01:55:22.457798 19704 leader_election.cc:304] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:22.458599 19910 raft_consensus.cc:2804] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:22.459141 19910 raft_consensus.cc:697] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:22.458770 19979 leader_election.cc:290] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:22.459983 19910 consensus_queue.cc:237] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:22.460883 19909 tablet_replica.cc:333] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:22.469509 19890 tablet_bootstrap.cc:492] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:22.474632 19890 tablet_bootstrap.cc:654] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.474897 19909 raft_consensus.cc:2243] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:22.475807 19909 raft_consensus.cc:2272] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:22.477413 19899 raft_consensus.cc:493] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:22.477846 19899 raft_consensus.cc:515] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.479796 19899 leader_election.cc:290] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:22.480422 19909 ts_tablet_manager.cc:1916] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:22.481069 19746 tablet_service.cc:1511] Processing CreateTablet for tablet c8bbb627a14a477c9362d2b250f27c1e (DEFAULT_TABLE table=default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.481732 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e902da355b641868c207fc26578b739" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:22.482366 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8bbb627a14a477c9362d2b250f27c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.483656 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e902da355b641868c207fc26578b739" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:22.484853 19556 leader_election.cc:343] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:22.486008 19553 leader_election.cc:343] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:22.486451 19553 leader_election.cc:304] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:22.487646 19899 raft_consensus.cc:2749] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:22.495328 19894 tablet_bootstrap.cc:492] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:22.495782 19894 ts_tablet_manager.cc:1403] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.061s	user 0.006s	sys 0.003s
I20260928 01:55:22.498786 19894 raft_consensus.cc:359] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.499432 19894 raft_consensus.cc:385] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.499665 19894 raft_consensus.cc:740] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.501202 19894 consensus_queue.cc:260] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.502030 19910 raft_consensus.cc:493] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:22.502498 19910 raft_consensus.cc:515] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.504711 19910 leader_election.cc:290] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:22.506994 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952df055998942f89baabb341e204f43" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:22.508888 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952df055998942f89baabb341e204f43" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:22.510908 19704 leader_election.cc:343] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:22.511737 19909 ts_tablet_manager.cc:1929] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:22.512115 19909 log.cc:1199] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/ab702ddf7caf4c5eab5d0cea49724121
W20260928 01:55:22.512127 19703 leader_election.cc:343] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:22.512610 19703 leader_election.cc:304] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:22.513481 19979 raft_consensus.cc:493] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:22.513870 19910 raft_consensus.cc:2749] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:22.513928 19979 raft_consensus.cc:515] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.515053 19896 tablet_bootstrap.cc:654] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:22.515538 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 952df055998942f89baabb341e204f43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 952df055998942f89baabb341e204f43 already in progress: creating tablet
I20260928 01:55:22.516072 19979 leader_election.cc:290] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:22.517719 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd4743c49314e8b8d86e1c6e553b13e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:22.518362 19620 raft_consensus.cc:2468] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:22.518610 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd4743c49314e8b8d86e1c6e553b13e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:22.519838 19704 leader_election.cc:304] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:22.520710 19979 raft_consensus.cc:2804] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:22.521234 19979 raft_consensus.cc:493] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:22.521595 19979 raft_consensus.cc:3060] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:22.528504 19909 ts_tablet_manager.cc:1950] T ab702ddf7caf4c5eab5d0cea49724121 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
W20260928 01:55:22.529914 19703 leader_election.cc:343] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:22.532246 19894 ts_tablet_manager.cc:1434] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260928 01:55:22.537360 19894 tablet_bootstrap.cc:492] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:22.540454 19909 tablet_replica.cc:333] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:22.541226 19909 raft_consensus.cc:2243] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:22.541785 19909 raft_consensus.cc:2272] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:22.540560 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet ab702ddf7caf4c5eab5d0cea49724121 (table default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]) successfully deleted
I20260928 01:55:22.543529 19909 ts_tablet_manager.cc:1916] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:22.546936 19890 tablet_bootstrap.cc:492] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:22.547689 19890 ts_tablet_manager.cc:1403] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.000s
I20260928 01:55:22.549060 19979 raft_consensus.cc:515] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.560078 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd4743c49314e8b8d86e1c6e553b13e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:22.562546 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd4743c49314e8b8d86e1c6e553b13e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:22.563213 19620 raft_consensus.cc:3060] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:22.563239 19703 leader_election.cc:343] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:22.568365 19621 raft_consensus.cc:1275] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260928 01:55:22.569849 19703 consensus_peers.cc:597] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:22.570335 19983 consensus_queue.cc:1048] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:22.572183 19894 tablet_bootstrap.cc:654] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.566643 19890 raft_consensus.cc:359] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.573949 19890 raft_consensus.cc:385] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.574251 19890 raft_consensus.cc:740] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.575492 19890 consensus_queue.cc:260] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.584192 19890 ts_tablet_manager.cc:1434] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.000s
I20260928 01:55:22.585079 19620 raft_consensus.cc:2468] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:22.585757 19979 leader_election.cc:290] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:22.585912 19890 tablet_bootstrap.cc:492] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:22.587150 19109 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3bccc8b0045456fa7f16e984b3c5bf5 has no consensus state
I20260928 01:55:22.588079 19704 leader_election.cc:304] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:22.589576 19979 raft_consensus.cc:2804] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:22.592677 19979 raft_consensus.cc:697] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:22.594269 19979 consensus_queue.cc:237] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.601428 19890 tablet_bootstrap.cc:654] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.600348 19894 tablet_bootstrap.cc:492] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:22.618589 19110 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_6af97903dc5d4f8a98ae918c9f3374a7" } new_table_name: "default.Table_1d40de09d743485db2f538534e097074" modify_external_catalogs: true
I20260928 01:55:22.618992 19894 ts_tablet_manager.cc:1403] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.005s
I20260928 01:55:22.629101 19894 raft_consensus.cc:359] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.629837 19894 raft_consensus.cc:385] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.630090 19894 raft_consensus.cc:740] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.630968 19894 consensus_queue.cc:260] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.637080 19894 ts_tablet_manager.cc:1434] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260928 01:55:22.636924 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_c9b8cc5045734f0c8720e704b8391c0f"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:22.639603 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9b8cc5045734f0c8720e704b8391c0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:22.640132 19996 tablet.cc:1751] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:22.642313 19894 tablet_bootstrap.cc:492] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:22.652132 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_81d3425d966643d9a809d91d9d5a432c"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:22.654354 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81d3425d966643d9a809d91d9d5a432c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:22.660341 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_093f704b2e6048d39a32fa2d5a763633"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:22.662289 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_093f704b2e6048d39a32fa2d5a763633 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:22.652411 19995 tablet.cc:1751] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:22.665148 19894 tablet_bootstrap.cc:654] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.673137 19890 tablet_bootstrap.cc:492] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:22.673578 19890 ts_tablet_manager.cc:1403] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.005s
I20260928 01:55:22.675966 19118 master_service.cc:960] ReplaceTablet: received request to replace tablet 7dd4743c49314e8b8d86e1c6e553b13e from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:22.676309 19890 raft_consensus.cc:359] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.676939 19890 raft_consensus.cc:385] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.677290 19890 raft_consensus.cc:740] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.678031 19890 consensus_queue.cc:260] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.680636 19890 ts_tablet_manager.cc:1434] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260928 01:55:22.681507 19890 tablet_bootstrap.cc:492] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:22.682334 19896 tablet_bootstrap.cc:492] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:22.682737 19896 ts_tablet_manager.cc:1403] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.333s	user 0.014s	sys 0.012s
I20260928 01:55:22.685217 19896 raft_consensus.cc:359] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:22.685887 19896 raft_consensus.cc:385] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.686141 19896 raft_consensus.cc:740] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.692478 19115 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_f8fbaf65902f43be8bbe856cd5e13599" } modify_external_catalogs: true
I20260928 01:55:22.693202 19115 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_f8fbaf65902f43be8bbe856cd5e13599" } modify_external_catalogs: true
I20260928 01:55:22.696781 19894 tablet_bootstrap.cc:492] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:22.697522 19894 ts_tablet_manager.cc:1403] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.000s
I20260928 01:55:22.698299 19909 ts_tablet_manager.cc:1929] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:22.699512 19909 log.cc:1199] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/2120beacbd764f418a559189b7d06c00
I20260928 01:55:22.700266 19909 ts_tablet_manager.cc:1950] T 2120beacbd764f418a559189b7d06c00 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:22.704820 19894 raft_consensus.cc:359] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.708173 19894 raft_consensus.cc:385] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.709306 19894 raft_consensus.cc:740] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.701954 19896 consensus_queue.cc:260] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:22.713615 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 2120beacbd764f418a559189b7d06c00 (table default.Table_a8beedb7e2f3499cba462a232332880a [id=723cb039487b46c7887ec8a10626b0cd]) successfully deleted
I20260928 01:55:22.712246 19894 consensus_queue.cc:260] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.715602 19890 tablet_bootstrap.cc:654] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.716578 19896 ts_tablet_manager.cc:1434] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260928 01:55:22.719105 19896 tablet_bootstrap.cc:492] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:22.720625 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 952df055998942f89baabb341e204f43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 952df055998942f89baabb341e204f43 already in progress: creating tablet
I20260928 01:55:22.728317 19894 ts_tablet_manager.cc:1434] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.005s
W20260928 01:55:22.730825 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 5380b2b4da1c476b959a11cd8a20bf2d because the tablet was not found. No further retry: Not found: Tablet not found: 5380b2b4da1c476b959a11cd8a20bf2d
I20260928 01:55:22.731199 19896 tablet_bootstrap.cc:654] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.736500 19980 mvcc.cc:204] Tried to move back new op lower bound from 7334135900414775296 to 7334135898319454208. Current Snapshot: MvccSnapshot[applied={T|T < 7334135900414775296}]
I20260928 01:55:22.750245 19995 tablet.cc:1746] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da: Skipping requested alter to schema version 2, tablet already version 2
I20260928 01:55:22.753377 19996 tablet.cc:1746] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0: Skipping requested alter to schema version 2, tablet already version 2
I20260928 01:55:22.754338 19894 tablet_bootstrap.cc:492] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:22.770529 19894 tablet_bootstrap.cc:654] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.775353 19899 raft_consensus.cc:493] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:22.775821 19899 raft_consensus.cc:515] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.777844 19899 leader_election.cc:290] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:22.779735 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8bbb627a14a477c9362d2b250f27c1e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:22.781965 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8bbb627a14a477c9362d2b250f27c1e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:22.783890 19556 leader_election.cc:343] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:22.784736 19553 leader_election.cc:343] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:22.785158 19553 leader_election.cc:304] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:22.786252 19899 raft_consensus.cc:2749] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:22.788494 19890 tablet_bootstrap.cc:492] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:22.788908 19890 ts_tablet_manager.cc:1403] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.009s
I20260928 01:55:22.791289 19890 raft_consensus.cc:359] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.791927 19890 raft_consensus.cc:385] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.792178 19890 raft_consensus.cc:740] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.793203 19890 consensus_queue.cc:260] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.794128 19894 tablet_bootstrap.cc:492] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:22.795076 19894 ts_tablet_manager.cc:1403] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.002s
I20260928 01:55:22.798713 19896 tablet_bootstrap.cc:492] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:22.799489 19890 ts_tablet_manager.cc:1434] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260928 01:55:22.799144 19896 ts_tablet_manager.cc:1403] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.000s
I20260928 01:55:22.801362 19894 raft_consensus.cc:359] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.804723 19896 raft_consensus.cc:359] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:22.805521 19896 raft_consensus.cc:385] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.805598 19894 raft_consensus.cc:385] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:22.805773 19896 raft_consensus.cc:740] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.805938 19894 raft_consensus.cc:740] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:22.806752 19894 consensus_queue.cc:260] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:22.813319 19896 consensus_queue.cc:260] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:22.816948 19894 ts_tablet_manager.cc:1434] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.004s
W20260928 01:55:22.822364 19110 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3bccc8b0045456fa7f16e984b3c5bf5 has no consensus state
W20260928 01:55:22.847455 19881 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
I20260928 01:55:22.853345 19475 raft_consensus.cc:3060] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:22.854965 19896 ts_tablet_manager.cc:1434] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260928 01:55:22.857007 19896 tablet_bootstrap.cc:492] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:22.859490 19110 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_2afe705bbbf54cf89ddd625de776e846" } new_table_name: "default.Table_361dd359d4a94951a2addad1cb55ea43" modify_external_catalogs: true
I20260928 01:55:22.863936 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_d686d68698c1457e99e7c7d80eaaf7c3"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:22.865736 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d686d68698c1457e99e7c7d80eaaf7c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:22.869207 19881 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:55:22.870007 19881 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260928 01:55:22.896137 19111 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 3f08e6838341436f8a85d6dbafc805df (table default.Table_4a2d24baaa4742b0aa00abd564613b46 [id=e17a4562755a46b6922715042f9d07d3]). Expected version 2 got 0
I20260928 01:55:22.902218 19113 catalog_manager.cc:5838] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:22.900750 20007 tablet.cc:1751] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:22.904426 19896 tablet_bootstrap.cc:654] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.906225 19456 tablet_service.cc:1511] Processing CreateTablet for tablet ea77f3197ee5496d9624cc76b3361ace (DEFAULT_TABLE table=default.Table_0ccbac9e2d8946229a807195f0c6de64 [id=061fd785787a42ad89ff507723fe0cba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.907591 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea77f3197ee5496d9624cc76b3361ace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.916940 19116 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 8a5d78f6a3c14931b0033ef5ab76f701
I20260928 01:55:22.922683 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5d78f6a3c14931b0033ef5ab76f701 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:22.923705 19599 tablet_service.cc:1511] Processing CreateTablet for tablet ea77f3197ee5496d9624cc76b3361ace (DEFAULT_TABLE table=default.Table_0ccbac9e2d8946229a807195f0c6de64 [id=061fd785787a42ad89ff507723fe0cba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.925192 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea77f3197ee5496d9624cc76b3361ace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.926177 19746 tablet_service.cc:1511] Processing CreateTablet for tablet ea77f3197ee5496d9624cc76b3361ace (DEFAULT_TABLE table=default.Table_0ccbac9e2d8946229a807195f0c6de64 [id=061fd785787a42ad89ff507723fe0cba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.927429 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea77f3197ee5496d9624cc76b3361ace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.930857 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5d78f6a3c14931b0033ef5ab76f701 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:22.930733 19601 tablet_service.cc:1511] Processing CreateTablet for tablet d66eeaf33aa943c09f52b74360e2332d (DEFAULT_TABLE table=default.Table_542dd0839d9f40ed942c4e1ab3e12098 [id=5a381f54e00c4bcf843ddfd1a97b1a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.932025 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66eeaf33aa943c09f52b74360e2332d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:22.933578 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 8a5d78f6a3c14931b0033ef5ab76f701 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a5d78f6a3c14931b0033ef5ab76f701 already in progress: creating tablet
I20260928 01:55:22.929836 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5d78f6a3c14931b0033ef5ab76f701 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:22.940357 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 05f875e126f04415a108f778a76bb0f5 (DEFAULT_TABLE table=default.Table_e00defcfcf9b4b74a81aae492a4ab74c [id=10dc4468b0ce4b2c87cecd4c66cc5300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.943578 19747 tablet_service.cc:1511] Processing CreateTablet for tablet d66eeaf33aa943c09f52b74360e2332d (DEFAULT_TABLE table=default.Table_542dd0839d9f40ed942c4e1ab3e12098 [id=5a381f54e00c4bcf843ddfd1a97b1a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.944990 19747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66eeaf33aa943c09f52b74360e2332d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.953771 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f875e126f04415a108f778a76bb0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.953823 19597 tablet_service.cc:1511] Processing CreateTablet for tablet 05f875e126f04415a108f778a76bb0f5 (DEFAULT_TABLE table=default.Table_e00defcfcf9b4b74a81aae492a4ab74c [id=10dc4468b0ce4b2c87cecd4c66cc5300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.955154 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f875e126f04415a108f778a76bb0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.956322 19454 tablet_service.cc:1511] Processing CreateTablet for tablet d66eeaf33aa943c09f52b74360e2332d (DEFAULT_TABLE table=default.Table_542dd0839d9f40ed942c4e1ab3e12098 [id=5a381f54e00c4bcf843ddfd1a97b1a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.957516 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66eeaf33aa943c09f52b74360e2332d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.971124 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 05f875e126f04415a108f778a76bb0f5 (DEFAULT_TABLE table=default.Table_e00defcfcf9b4b74a81aae492a4ab74c [id=10dc4468b0ce4b2c87cecd4c66cc5300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:22.972498 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f875e126f04415a108f778a76bb0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:22.984866 19890 tablet_bootstrap.cc:492] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:22.991624 19890 tablet_bootstrap.cc:654] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:22.998699 20005 mvcc.cc:204] Tried to move back new op lower bound from 7334135901120585728 to 7334135898319454208. Current Snapshot: MvccSnapshot[applied={T|T < 7334135901120585728}]
I20260928 01:55:22.999379 19111 master_service.cc:960] ReplaceTablet: received request to replace tablet c8bbb627a14a477c9362d2b250f27c1e from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:22.999924 20011 tablet.cc:1746] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614: Skipping requested alter to schema version 2, tablet already version 2
I20260928 01:55:23.000726 19890 tablet_bootstrap.cc:492] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:23.001163 19890 ts_tablet_manager.cc:1403] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.005s
I20260928 01:55:23.003907 19890 raft_consensus.cc:359] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.004642 19890 raft_consensus.cc:385] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:23.004930 19890 raft_consensus.cc:740] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:23.011011 19452 tablet_service.cc:1511] Processing CreateTablet for tablet dfc63ccbe4e84373aabe3009cc3d2568 (DEFAULT_TABLE table=default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.012405 19452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc63ccbe4e84373aabe3009cc3d2568. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:23.013065 19110 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2d1238d0a2d45c0a708442fd0b17291 has no consensus state
I20260928 01:55:23.016024 19597 tablet_service.cc:1511] Processing CreateTablet for tablet dfc63ccbe4e84373aabe3009cc3d2568 (DEFAULT_TABLE table=default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.017416 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc63ccbe4e84373aabe3009cc3d2568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.018448 19453 tablet_service.cc:1511] Processing CreateTablet for tablet 027f99abaacc4c169661e7db08512ebd (DEFAULT_TABLE table=default.Table_26116cab8a164e2cb26e73efbde6d923 [id=00aeb9f1892b4b009a69e32f201b081a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.019874 19453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 027f99abaacc4c169661e7db08512ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.024055 19745 tablet_service.cc:1511] Processing CreateTablet for tablet dfc63ccbe4e84373aabe3009cc3d2568 (DEFAULT_TABLE table=default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.025558 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc63ccbe4e84373aabe3009cc3d2568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.017958 19890 consensus_queue.cc:260] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.032183 19890 ts_tablet_manager.cc:1434] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260928 01:55:23.034821 19599 tablet_service.cc:1511] Processing CreateTablet for tablet 027f99abaacc4c169661e7db08512ebd (DEFAULT_TABLE table=default.Table_26116cab8a164e2cb26e73efbde6d923 [id=00aeb9f1892b4b009a69e32f201b081a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.036342 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 027f99abaacc4c169661e7db08512ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.042706 19115 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 457837143b0f4763a4b91bb25b580477
I20260928 01:55:23.049479 19598 tablet_service.cc:1558] Processing DeleteTablet for tablet 457837143b0f4763a4b91bb25b580477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:23.050858 19451 tablet_service.cc:1558] Processing DeleteTablet for tablet 457837143b0f4763a4b91bb25b580477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:23.052379 19598 tablet_service.cc:1511] Processing CreateTablet for tablet e3bccc8b0045456fa7f16e984b3c5bf5 (DEFAULT_TABLE table=default.Table_1d40de09d743485db2f538534e097074 [id=c314147c39ca4ef695e61de1652cf804]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.054083 19598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3bccc8b0045456fa7f16e984b3c5bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.054505 19451 tablet_service.cc:1511] Processing CreateTablet for tablet e3bccc8b0045456fa7f16e984b3c5bf5 (DEFAULT_TABLE table=default.Table_1d40de09d743485db2f538534e097074 [id=c314147c39ca4ef695e61de1652cf804]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.060600 19890 tablet_bootstrap.cc:492] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:23.062752 19595 tablet_service.cc:1511] Processing CreateTablet for tablet a43cfb32bd0043049cbdb2faaf10409f (DEFAULT_TABLE table=default.Table_a47ad43bf23c4fa8b30c2aa4a8d66767 [id=63a3b65b060345c8811e85383a3d6dbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.064627 19595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43cfb32bd0043049cbdb2faaf10409f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.066334 19596 tablet_service.cc:1511] Processing CreateTablet for tablet 457837143b0f4763a4b91bb25b580477 (DEFAULT_TABLE table=default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.072822 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457837143b0f4763a4b91bb25b580477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.074259 19451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3bccc8b0045456fa7f16e984b3c5bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.075675 19979 raft_consensus.cc:493] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:23.076540 19979 raft_consensus.cc:515] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.085564 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7801c623930d4e4eaf24c5c424b06d26" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:23.086766 19979 leader_election.cc:290] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:23.087893 19703 leader_election.cc:343] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:23.089649 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 457837143b0f4763a4b91bb25b580477 (DEFAULT_TABLE table=default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.096180 19743 tablet_service.cc:1511] Processing CreateTablet for tablet 027f99abaacc4c169661e7db08512ebd (DEFAULT_TABLE table=default.Table_26116cab8a164e2cb26e73efbde6d923 [id=00aeb9f1892b4b009a69e32f201b081a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.098309 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 027f99abaacc4c169661e7db08512ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.089810 19456 tablet_service.cc:1511] Processing CreateTablet for tablet a43cfb32bd0043049cbdb2faaf10409f (DEFAULT_TABLE table=default.Table_a47ad43bf23c4fa8b30c2aa4a8d66767 [id=63a3b65b060345c8811e85383a3d6dbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.102126 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43cfb32bd0043049cbdb2faaf10409f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.091301 19450 tablet_service.cc:1511] Processing CreateTablet for tablet ad62475da6e74fb4971837a018e77c1c (DEFAULT_TABLE table=default.Table_7be970fbb13745978e6b90a9a7d84fb7 [id=8b8c2a287da9417fb0cb7f12a676abcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.105247 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad62475da6e74fb4971837a018e77c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.105298 19742 tablet_service.cc:1558] Processing DeleteTablet for tablet 457837143b0f4763a4b91bb25b580477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:23.108052 19742 tablet_service.cc:1511] Processing CreateTablet for tablet e3bccc8b0045456fa7f16e984b3c5bf5 (DEFAULT_TABLE table=default.Table_1d40de09d743485db2f538534e097074 [id=c314147c39ca4ef695e61de1652cf804]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.110095 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3bccc8b0045456fa7f16e984b3c5bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.124944 19601 tablet_service.cc:1511] Processing CreateTablet for tablet ad62475da6e74fb4971837a018e77c1c (DEFAULT_TABLE table=default.Table_7be970fbb13745978e6b90a9a7d84fb7 [id=8b8c2a287da9417fb0cb7f12a676abcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.126052 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad62475da6e74fb4971837a018e77c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.127503 19741 tablet_service.cc:1511] Processing CreateTablet for tablet 457837143b0f4763a4b91bb25b580477 (DEFAULT_TABLE table=default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.129678 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457837143b0f4763a4b91bb25b580477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.135916 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457837143b0f4763a4b91bb25b580477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.123263 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7801c623930d4e4eaf24c5c424b06d26" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:23.137867 19620 raft_consensus.cc:2468] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:23.140668 19704 leader_election.cc:304] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:23.142537 19979 raft_consensus.cc:2804] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:23.143064 19979 raft_consensus.cc:493] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:23.142939 19740 tablet_service.cc:1511] Processing CreateTablet for tablet a43cfb32bd0043049cbdb2faaf10409f (DEFAULT_TABLE table=default.Table_a47ad43bf23c4fa8b30c2aa4a8d66767 [id=63a3b65b060345c8811e85383a3d6dbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.143561 19979 raft_consensus.cc:3060] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:23.146224 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43cfb32bd0043049cbdb2faaf10409f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.146548 19890 tablet_bootstrap.cc:654] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:23.087110 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 457837143b0f4763a4b91bb25b580477 because the tablet was not found. No further retry: Not found: Tablet not found: 457837143b0f4763a4b91bb25b580477
W20260928 01:55:23.164961 19104 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 77919.1us
I20260928 01:55:23.170147 19739 tablet_service.cc:1511] Processing CreateTablet for tablet ad62475da6e74fb4971837a018e77c1c (DEFAULT_TABLE table=default.Table_7be970fbb13745978e6b90a9a7d84fb7 [id=8b8c2a287da9417fb0cb7f12a676abcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.171849 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad62475da6e74fb4971837a018e77c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.177480 19903 raft_consensus.cc:493] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:23.177966 19903 raft_consensus.cc:515] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:23.178701 19556 consensus_peers.cc:597] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:23.181845 19903 leader_election.cc:290] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:23.184093 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa8a7589d314c25aeccf678c938ecf0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:23.185278 19620 raft_consensus.cc:2393] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
W20260928 01:55:23.195230 19105 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8a5d78f6a3c14931b0033ef5ab76f701 (table default.Table_de632f40c91243848f008af01906cc16 [id=b40893608e4a4237ae1f2b14101fc2a9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8a5d78f6a3c14931b0033ef5ab76f701 consensus state has no leader
I20260928 01:55:23.201095 19983 consensus_queue.cc:1048] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:23.204886 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa8a7589d314c25aeccf678c938ecf0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:23.205765 19899 raft_consensus.cc:493] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:23.206390 19899 raft_consensus.cc:515] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.209436 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_bd232d1bc78e49f4a9925680a33c9caa"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:23.210932 19899 leader_election.cc:290] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:23.212011 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:23.212944 19115 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_681519b5f7f6410db9f306d4a16596cc"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:23.213934 19556 leader_election.cc:343] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:23.217002 19109 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_a2a87b5badd741caa9c92c3a137b0a2d" } modify_external_catalogs: true
I20260928 01:55:23.217742 19109 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_a2a87b5badd741caa9c92c3a137b0a2d" } modify_external_catalogs: true
W20260928 01:55:23.215641 19115 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_681519b5f7f6410db9f306d4a16596cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:23.211779 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_944ae66f379b4d43964c05fad29a0868"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:23.226003 19114 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_e00defcfcf9b4b74a81aae492a4ab74c" } new_table_name: "default.Table_a4827d0104f94435be09b3173ff52905" modify_external_catalogs: true
W20260928 01:55:23.227237 19881 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 01:55:23.228708 19881 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:55:23.229751 19881 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 01:55:23.230705 19881 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
W20260928 01:55:23.232743 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_944ae66f379b4d43964c05fad29a0868 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:23.237563 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd232d1bc78e49f4a9925680a33c9caa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:23.249290 19409 leader_election.cc:304] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:23.250638 19896 tablet_bootstrap.cc:492] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:23.251109 19896 ts_tablet_manager.cc:1403] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.394s	user 0.023s	sys 0.030s
I20260928 01:55:23.251319 19903 raft_consensus.cc:3060] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:23.255782 19896 raft_consensus.cc:359] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:23.256553 19896 raft_consensus.cc:385] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:23.256835 19896 raft_consensus.cc:740] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:23.257668 19896 consensus_queue.cc:260] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:23.267187 19903 raft_consensus.cc:2749] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:23.293013 19890 tablet_bootstrap.cc:492] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:23.293439 19890 ts_tablet_manager.cc:1403] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.245s	user 0.013s	sys 0.035s
I20260928 01:55:23.273307 19896 ts_tablet_manager.cc:1434] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.000s
I20260928 01:55:23.294472 19896 tablet_bootstrap.cc:492] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:23.303987 19896 tablet_bootstrap.cc:654] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:23.308888 19890 raft_consensus.cc:359] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.309597 19890 raft_consensus.cc:385] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:23.309871 19890 raft_consensus.cc:740] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:23.310671 19890 consensus_queue.cc:260] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.312865 19890 ts_tablet_manager.cc:1434] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260928 01:55:23.316116 19111 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet c8bbb627a14a477c9362d2b250f27c1e
I20260928 01:55:23.319780 19599 tablet_service.cc:1558] Processing DeleteTablet for tablet c8bbb627a14a477c9362d2b250f27c1e with delete_type TABLET_DATA_DELETED (replaced by tablet 90d40050f85a4d6c90a4ce35cf15d134) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:23.320192 19899 raft_consensus.cc:493] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:23.307029 19113 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_ba101536dd544f75a023727ab9ef2ac7" } new_table_name: "default.Table_b713dc73dad84f5bafa62a44927e914b" modify_external_catalogs: true
I20260928 01:55:23.320863 19899 raft_consensus.cc:515] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:23.324370 19104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 57378.6us
I20260928 01:55:23.324666 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952df055998942f89baabb341e204f43" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:23.326105 19111 catalog_manager.cc:6934] ReplaceTablet: tablet c8bbb627a14a477c9362d2b250f27c1e deleted and replaced by tablet 90d40050f85a4d6c90a4ce35cf15d134
W20260928 01:55:23.326227 19556 leader_election.cc:343] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:23.326845 19455 tablet_service.cc:1558] Processing DeleteTablet for tablet c8bbb627a14a477c9362d2b250f27c1e with delete_type TABLET_DATA_DELETED (replaced by tablet 90d40050f85a4d6c90a4ce35cf15d134) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:23.327014 19899 leader_election.cc:290] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:23.327371 19111 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_2720a066cdca41b4998342e7fb48de23"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:23.331346 19111 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2720a066cdca41b4998342e7fb48de23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:23.344653 20008 tablet_replica.cc:333] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:23.346004 20008 raft_consensus.cc:2243] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:23.346661 20008 pending_rounds.cc:70] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0: Trying to abort 1 pending ops.
I20260928 01:55:23.348250 20008 pending_rounds.cc:77] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135899348082688 op_type: NO_OP noop_request { }
I20260928 01:55:23.348753 20008 raft_consensus.cc:2889] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:23.349311 20008 raft_consensus.cc:2272] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:23.355274 20008 ts_tablet_manager.cc:1916] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:23.334995 19115 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_093f704b2e6048d39a32fa2d5a763633" } modify_external_catalogs: true
I20260928 01:55:23.356902 19115 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_093f704b2e6048d39a32fa2d5a763633" } modify_external_catalogs: true
I20260928 01:55:23.353089 19890 tablet_bootstrap.cc:492] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:23.387092 19896 tablet_bootstrap.cc:492] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:23.387562 19896 ts_tablet_manager.cc:1403] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.004s
I20260928 01:55:23.390857 19896 raft_consensus.cc:359] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:23.395993 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 61602.3us
I20260928 01:55:23.398723 19738 tablet_service.cc:1558] Processing DeleteTablet for tablet 952df055998942f89baabb341e204f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:23.391515 19896 raft_consensus.cc:385] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:23.410292 19896 raft_consensus.cc:740] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:23.415038 19896 consensus_queue.cc:260] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.423919 19903 raft_consensus.cc:493] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:23.424636 19903 raft_consensus.cc:515] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.432389 19903 leader_election.cc:290] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:23.433918 19703 consensus_peers.cc:597] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:23.437747 19896 ts_tablet_manager.cc:1434] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.050s	user 0.002s	sys 0.006s
W20260928 01:55:23.439024 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet c8bbb627a14a477c9362d2b250f27c1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8bbb627a14a477c9362d2b250f27c1e already in progress: creating tablet
I20260928 01:55:23.426214 20010 tablet_replica.cc:333] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:23.443473 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5d78f6a3c14931b0033ef5ab76f701" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:23.444993 19890 tablet_bootstrap.cc:654] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:23.452534 19412 leader_election.cc:343] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: Tablet not RUNNING: STOPPED
I20260928 01:55:23.438809 19896 tablet_bootstrap.cc:492] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:23.460542 19114 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05f875e126f04415a108f778a76bb0f5 consensus state has no leader
I20260928 01:55:23.462358 19118 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 7dd4743c49314e8b8d86e1c6e553b13e
I20260928 01:55:23.463963 19118 catalog_manager.cc:6934] ReplaceTablet: tablet 7dd4743c49314e8b8d86e1c6e553b13e deleted and replaced by tablet 33e1cc46939b4932a344b81c3bc8ca82
I20260928 01:55:23.472584 19596 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dd4743c49314e8b8d86e1c6e553b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 33e1cc46939b4932a344b81c3bc8ca82) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:23.473338 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dd4743c49314e8b8d86e1c6e553b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 33e1cc46939b4932a344b81c3bc8ca82) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:23.473757 19899 raft_consensus.cc:493] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:23.474246 19899 raft_consensus.cc:515] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:23.475519 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7dd4743c49314e8b8d86e1c6e553b13e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dd4743c49314e8b8d86e1c6e553b13e already in progress: creating tablet
I20260928 01:55:23.477540 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f875e126f04415a108f778a76bb0f5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:23.478639 19890 tablet_bootstrap.cc:492] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:23.479112 19890 ts_tablet_manager.cc:1403] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.126s	user 0.007s	sys 0.007s
W20260928 01:55:23.479200 19556 leader_election.cc:343] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:23.480829 19899 leader_election.cc:290] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:23.482091 20008 ts_tablet_manager.cc:1929] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:23.484158 20008 log.cc:1199] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/8a5d78f6a3c14931b0033ef5ab76f701
I20260928 01:55:23.486094 20008 ts_tablet_manager.cc:1950] T 8a5d78f6a3c14931b0033ef5ab76f701 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:23.488953 20030 raft_consensus.cc:493] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:23.490127 20030 raft_consensus.cc:515] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.496639 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 8a5d78f6a3c14931b0033ef5ab76f701 (table default.Table_de632f40c91243848f008af01906cc16 [id=b40893608e4a4237ae1f2b14101fc2a9]) successfully deleted
I20260928 01:55:23.487702 19890 raft_consensus.cc:359] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.498468 19890 raft_consensus.cc:385] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:23.499151 19890 raft_consensus.cc:740] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:23.500629 19890 consensus_queue.cc:260] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.501109 19881 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:32911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.18.161.62:38511,127.18.161.61:43775,127.18.161.60:39095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.60:39095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.161.60
--webserver_port=34303
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:55:23.501817 19896 tablet_bootstrap.cc:654] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:23.503157 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 457837143b0f4763a4b91bb25b580477 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 457837143b0f4763a4b91bb25b580477 already in progress: creating tablet
I20260928 01:55:23.504323 20008 tablet_replica.cc:333] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:23.507639 20008 raft_consensus.cc:2243] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:23.508304 20008 raft_consensus.cc:2272] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:23.511304 20008 ts_tablet_manager.cc:1916] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:23.504087 19747 tablet_service.cc:1558] Processing DeleteTablet for tablet c8bbb627a14a477c9362d2b250f27c1e with delete_type TABLET_DATA_DELETED (replaced by tablet 90d40050f85a4d6c90a4ce35cf15d134) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:23.492268 20029 tablet_bootstrap.cc:492] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:23.502900 19983 raft_consensus.cc:493] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:23.531571 19983 raft_consensus.cc:515] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.539330 19903 raft_consensus.cc:493] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:23.539963 19903 raft_consensus.cc:515] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:23.541181 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_f9fd93a6752f44cab502812f0217d67c"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:23.544587 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb7f3e609144f5a9dcc8b40d21dbb2" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:23.548488 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9fd93a6752f44cab502812f0217d67c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:23.550305 19881 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:55:23.562371 19881 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260928 01:55:23.563316 19903 leader_election.cc:290] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:23.559916 20008 ts_tablet_manager.cc:1929] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:23.566303 20008 log.cc:1199] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/c8bbb627a14a477c9362d2b250f27c1e
I20260928 01:55:23.569207 19890 ts_tablet_manager.cc:1434] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.001s
I20260928 01:55:23.570384 19890 tablet_bootstrap.cc:492] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:23.393965 19979 raft_consensus.cc:515] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.512562 20010 raft_consensus.cc:2243] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:23.580592 20010 raft_consensus.cc:2272] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:23.531543 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952df055998942f89baabb341e204f43" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:23.581598 19767 raft_consensus.cc:2468] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
W20260928 01:55:23.582708 19748 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.005s	sys 0.013s
W20260928 01:55:23.583189 19748 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.005s	sys 0.013s
I20260928 01:55:23.589509 20030 leader_election.cc:290] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:23.590111 19115 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 98cdcef22c9f4194bafa6cd06336e945
I20260928 01:55:23.590713 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_939a932b08754e3a82655a7da68b403a"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:23.604807 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_939a932b08754e3a82655a7da68b403a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:23.484413 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 47304.3us
W20260928 01:55:23.618409 19553 leader_election.cc:343] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: ea77f3197ee5496d9624cc76b3361ace
I20260928 01:55:23.619144 19553 leader_election.cc:304] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:23.620489 19899 raft_consensus.cc:2749] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:23.633246 20010 ts_tablet_manager.cc:1916] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:23.638955 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8bbb627a14a477c9362d2b250f27c1e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:23.568020 20008 ts_tablet_manager.cc:1950] T c8bbb627a14a477c9362d2b250f27c1e P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:23.643370 19979 leader_election.cc:290] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:23.643194 19983 leader_election.cc:290] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:23.657589 19704 leader_election.cc:343] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: Tablet not RUNNING: STOPPED
I20260928 01:55:23.661011 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e902da355b641868c207fc26578b739" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:23.661741 19621 raft_consensus.cc:2468] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:23.663400 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7801c623930d4e4eaf24c5c424b06d26" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:23.666556 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet c8bbb627a14a477c9362d2b250f27c1e (table default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]) successfully deleted
I20260928 01:55:23.664145 19620 raft_consensus.cc:3060] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:23.674239 20008 tablet_replica.cc:333] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:23.676086 20008 raft_consensus.cc:2243] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:23.679533 19117 master_service.cc:960] ReplaceTablet: received request to replace tablet dfc63ccbe4e84373aabe3009cc3d2568 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:23.680945 19896 tablet_bootstrap.cc:492] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:23.681448 19896 ts_tablet_manager.cc:1403] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.243s	user 0.011s	sys 0.011s
I20260928 01:55:23.700176 19115 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_0ccbac9e2d8946229a807195f0c6de64" } new_table_name: "default.Table_1b5bf73ffb5545d29ca961fb3c2108a7" modify_external_catalogs: true
I20260928 01:55:23.701164 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_3150a3877264403b9dc7b41be25b80f5"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:23.704559 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3150a3877264403b9dc7b41be25b80f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:23.683640 19899 consensus_queue.cc:1048] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:23.710842 20008 raft_consensus.cc:2272] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:23.712193 19890 tablet_bootstrap.cc:654] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:23.712069 20035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:55:23.707067 19620 raft_consensus.cc:2468] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:23.718371 20008 ts_tablet_manager.cc:1916] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:23.726624 19116 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 0e902da355b641868c207fc26578b739 (table default.Table_a2a87b5badd741caa9c92c3a137b0a2d [id=136676f3aa8a473699bc8c172b81929a]). Expected version 1 got 0
I20260928 01:55:23.727020 19454 tablet_service.cc:1511] Processing CreateTablet for tablet e2d1238d0a2d45c0a708442fd0b17291 (DEFAULT_TABLE table=default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.728267 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d1238d0a2d45c0a708442fd0b17291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.728681 19596 tablet_service.cc:1511] Processing CreateTablet for tablet e2d1238d0a2d45c0a708442fd0b17291 (DEFAULT_TABLE table=default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.728267 19896 raft_consensus.cc:359] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.729853 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d1238d0a2d45c0a708442fd0b17291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.729332 19896 raft_consensus.cc:385] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:23.732496 19896 raft_consensus.cc:740] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:23.733629 19597 tablet_service.cc:1511] Processing CreateTablet for tablet ce41f63df46f4d0493ca22a13daadb4f (DEFAULT_TABLE table=default.Table_81d3425d966643d9a809d91d9d5a432c [id=9e114860728146b097bcfce77a95f9d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.734272 19455 tablet_service.cc:1511] Processing CreateTablet for tablet ce41f63df46f4d0493ca22a13daadb4f (DEFAULT_TABLE table=default.Table_81d3425d966643d9a809d91d9d5a432c [id=9e114860728146b097bcfce77a95f9d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.735136 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce41f63df46f4d0493ca22a13daadb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.735481 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce41f63df46f4d0493ca22a13daadb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.738210 19451 tablet_service.cc:1511] Processing CreateTablet for tablet e8f6ce7612d4463ebe95e07557bca4e7 (DEFAULT_TABLE table=default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.739401 19451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f6ce7612d4463ebe95e07557bca4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.739459 19599 tablet_service.cc:1511] Processing CreateTablet for tablet e8f6ce7612d4463ebe95e07557bca4e7 (DEFAULT_TABLE table=default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.740638 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f6ce7612d4463ebe95e07557bca4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.742268 19450 tablet_service.cc:1511] Processing CreateTablet for tablet eaa1e9b7119d46a2ba2652a893877c8c (DEFAULT_TABLE table=default.Table_d686d68698c1457e99e7c7d80eaaf7c3 [id=2961b396aa0e488e8440ed77d774588c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.743391 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa1e9b7119d46a2ba2652a893877c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.658032 19983 consensus_queue.cc:1048] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260928 01:55:23.696583 19704 leader_election.cc:304] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:23.747608 19113 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33e1cc46939b4932a344b81c3bc8ca82 has no consensus state
I20260928 01:55:23.749181 19112 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: default.Table_4a2d24baaa4742b0aa00abd564613b46 [id=e17a4562755a46b6922715042f9d07d3] alter complete (version 2)
W20260928 01:55:23.750475 19112 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 26) took 814 ms (client timeout 1000 ms). Trace:
I20260928 01:55:23.755080 19896 consensus_queue.cc:260] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.755668 19600 tablet_service.cc:1511] Processing CreateTablet for tablet eaa1e9b7119d46a2ba2652a893877c8c (DEFAULT_TABLE table=default.Table_d686d68698c1457e99e7c7d80eaaf7c3 [id=2961b396aa0e488e8440ed77d774588c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.756927 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa1e9b7119d46a2ba2652a893877c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.758412 20008 ts_tablet_manager.cc:1929] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:23.758781 20008 log.cc:1199] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/7dd4743c49314e8b8d86e1c6e553b13e
I20260928 01:55:23.759426 20008 ts_tablet_manager.cc:1950] T 7dd4743c49314e8b8d86e1c6e553b13e P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:23.762447 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 7dd4743c49314e8b8d86e1c6e553b13e (table default.Table_b713dc73dad84f5bafa62a44927e914b [id=c9816a660a324eb9a6eeb87f2f1e9422]) successfully deleted
W20260928 01:55:23.750842 19112 rpcz_store.cc:269] 0928 01:55:22.936244 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:22.948966 (+ 12722us) service_pool.cc:224] Handling call
0928 01:55:23.006653 (+ 57687us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:23.750404 (+743751us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:23.392166 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:23.392598 (+   432us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:23.392621 (+    23us) write_op.cc:435] Acquired schema lock
0928 01:55:23.392632 (+    11us) tablet.cc:662] Decoding operations
0928 01:55:23.392891 (+   259us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:23.392926 (+    35us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:23.392947 (+    21us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:23.393095 (+   148us) tablet.cc:701] Row locks acquired
0928 01:55:23.393110 (+    15us) write_op.cc:260] PREPARE: finished
0928 01:55:23.393227 (+   117us) write_op.cc:270] Start()
0928 01:55:23.393327 (+   100us) write_op.cc:276] Timestamp: P: 1790560523393169 usec, L: 0
0928 01:55:23.393342 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:23.445078 (+ 51736us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b5400030d20. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b6aa1 00007f19fd6caa50 00007f19fd754302 00007f19fd749727 00007f19fd749564 00007f19fdbd9791 00007f19fdbd8f68 00007f19fdbddc01 00007f19fdbddbb9 00007f19fdbddb49 00007f19fdbddb11
0928 01:55:23.445592 (+   514us) log.cc:844] Serialized 355 byte log entry
0928 01:55:23.489339 (+ 43747us) op_driver.cc:464] REPLICATION: finished
0928 01:55:23.489878 (+   539us) write_op.cc:301] APPLY: starting
0928 01:55:23.489939 (+    61us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:23.490037 (+    98us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:23.490055 (+    18us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:23.490225 (+   170us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:23.490349 (+   124us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:23.490391 (+    42us) write_op.cc:312] APPLY: finished
0928 01:55:23.490673 (+   282us) log.cc:844] Serialized 22 byte log entry
0928 01:55:23.490844 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:23.490907 (+    63us) write_op.cc:454] Released schema lock
0928 01:55:23.490944 (+    37us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:23.491209 (+   265us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:23.491235 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":128698112,"child_traces":[["op",{"apply.queue_time_us":265,"apply.run_cpu_time_us":1304,"apply.run_wall_time_us":1304,"num_ops":1,"prepare.queue_time_us":67585,"prepare.run_cpu_time_us":3056,"prepare.run_wall_time_us":67798,"raft.queue_time_us":28503,"raft.run_cpu_time_us":17,"raft.run_wall_time_us":18,"replication_time_us":95877,"spinlock_wait_cycles":116968320}]]}
I20260928 01:55:23.774107 19890 tablet_bootstrap.cc:492] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:23.774669 19890 ts_tablet_manager.cc:1403] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.205s	user 0.011s	sys 0.002s
I20260928 01:55:23.777549 19890 raft_consensus.cc:359] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.778235 19890 raft_consensus.cc:385] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:23.778520 19890 raft_consensus.cc:740] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:23.779201 19890 consensus_queue.cc:260] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.786942 19890 ts_tablet_manager.cc:1434] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260928 01:55:23.799249 19115 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea77f3197ee5496d9624cc76b3361ace consensus state has no leader
I20260928 01:55:23.808810 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5d78f6a3c14931b0033ef5ab76f701" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:23.809994 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb7f3e609144f5a9dcc8b40d21dbb2" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:23.810802 19768 raft_consensus.cc:2393] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:23.811569 19746 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dd4743c49314e8b8d86e1c6e553b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 33e1cc46939b4932a344b81c3bc8ca82) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:23.812856 19745 tablet_service.cc:1511] Processing CreateTablet for tablet e2d1238d0a2d45c0a708442fd0b17291 (DEFAULT_TABLE table=default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.814026 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d1238d0a2d45c0a708442fd0b17291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.814323 19890 tablet_bootstrap.cc:492] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:23.816884 19896 ts_tablet_manager.cc:1434] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.000s
I20260928 01:55:23.820683 19118 master_service.cc:960] ReplaceTablet: received request to replace tablet e3bccc8b0045456fa7f16e984b3c5bf5 from {username='slave'} at 127.0.0.1:51212
W20260928 01:55:23.795485 19744 consensus_meta.cc:287] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent flushing consensus metadata: real 0.629s	user 0.013s	sys 0.000s
W20260928 01:55:23.829341 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 143012us
I20260928 01:55:23.833148 19748 tablet_service.cc:1511] Processing CreateTablet for tablet ce41f63df46f4d0493ca22a13daadb4f (DEFAULT_TABLE table=default.Table_81d3425d966643d9a809d91d9d5a432c [id=9e114860728146b097bcfce77a95f9d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.834414 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce41f63df46f4d0493ca22a13daadb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:23.834722 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8bbb627a14a477c9362d2b250f27c1e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:23.835997 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e902da355b641868c207fc26578b739" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:23.836757 19474 raft_consensus.cc:2468] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:23.837755 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7801c623930d4e4eaf24c5c424b06d26" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:23.845463 19896 tablet_bootstrap.cc:492] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:23.852232 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_3d4ef2c3012a4e4db1e9f4a7c6f1f84e"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:23.861390 19703 leader_election.cc:343] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:23.861853 19703 leader_election.cc:304] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:23.868069 19890 tablet_bootstrap.cc:654] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:23.878175 19409 leader_election.cc:343] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: Tablet not RUNNING: STOPPED
I20260928 01:55:23.878686 19409 leader_election.cc:304] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:55:23.878832 19553 leader_election.cc:343] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: 05f875e126f04415a108f778a76bb0f5
I20260928 01:55:23.879256 19553 leader_election.cc:304] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:23.880013 19409 leader_election.cc:304] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:23.880434 19553 leader_election.cc:304] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:23.881103 19899 raft_consensus.cc:2749] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:23.881875 19899 raft_consensus.cc:2804] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:23.881902 19903 raft_consensus.cc:2749] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:23.882172 19899 raft_consensus.cc:493] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:23.882480 19899 raft_consensus.cc:3060] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:23.882506 19903 raft_consensus.cc:3060] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:23.888381 20022 raft_consensus.cc:2749] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:23.853982 19983 raft_consensus.cc:2804] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:23.892618 19983 raft_consensus.cc:493] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:23.893030 19983 raft_consensus.cc:3060] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:23.893514 19903 raft_consensus.cc:2749] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:23.899788 19744 tablet_service.cc:1511] Processing CreateTablet for tablet e8f6ce7612d4463ebe95e07557bca4e7 (DEFAULT_TABLE table=default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.901290 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f6ce7612d4463ebe95e07557bca4e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:23.863696 19703 leader_election.cc:343] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:23.903874 20026 consensus_queue.cc:1048] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260928 01:55:23.907202 19704 leader_election.cc:304] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:23.887898 20029 tablet_bootstrap.cc:654] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:23.908478 19979 raft_consensus.cc:2804] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:23.909058 19979 raft_consensus.cc:697] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:23.914453 19899 raft_consensus.cc:515] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.921856 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_1109ca51476d45c0a4aad60c01bc222b"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:23.924813 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1109ca51476d45c0a4aad60c01bc222b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:23.931320 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d4ef2c3012a4e4db1e9f4a7c6f1f84e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:23.931491 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_d6ec5f8939f84de7994041a54bdbe36b"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:23.933967 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6ec5f8939f84de7994041a54bdbe36b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:23.937672 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952df055998942f89baabb341e204f43" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:23.938104 19896 tablet_bootstrap.cc:654] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:23.940896 19556 leader_election.cc:343] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:23.941325 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 61402.2us
W20260928 01:55:23.929780 19704 consensus_peers.cc:597] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7dd4743c49314e8b8d86e1c6e553b13e. This is attempt 1: this message will repeat every 5th retry.
W20260928 01:55:23.943246 19739 consensus_meta.cc:287] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.003s
I20260928 01:55:23.945634 19111 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_a47ad43bf23c4fa8b30c2aa4a8d66767" } modify_external_catalogs: true
I20260928 01:55:23.952667 19979 consensus_queue.cc:237] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.953517 19741 tablet_service.cc:1511] Processing CreateTablet for tablet eaa1e9b7119d46a2ba2652a893877c8c (DEFAULT_TABLE table=default.Table_d686d68698c1457e99e7c7d80eaaf7c3 [id=2961b396aa0e488e8440ed77d774588c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:23.954761 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa1e9b7119d46a2ba2652a893877c8c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:23.943873 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 80206.6us
W20260928 01:55:23.965049 19703 consensus_peers.cc:597] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:23.966153 20010 ts_tablet_manager.cc:1929] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:23.966567 20010 log.cc:1199] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/8a5d78f6a3c14931b0033ef5ab76f701
I20260928 01:55:23.967388 20010 ts_tablet_manager.cc:1950] T 8a5d78f6a3c14931b0033ef5ab76f701 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:23.968798 19983 raft_consensus.cc:515] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:23.948407 19111 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_a47ad43bf23c4fa8b30c2aa4a8d66767" } modify_external_catalogs: true
I20260928 01:55:23.975188 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e902da355b641868c207fc26578b739" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:23.975864 19619 raft_consensus.cc:3060] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:23.986732 19899 leader_election.cc:290] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:23.990818 19619 raft_consensus.cc:2468] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:23.994395 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952df055998942f89baabb341e204f43" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:23.994369 19704 leader_election.cc:304] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:23.995009 19117 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet dfc63ccbe4e84373aabe3009cc3d2568
I20260928 01:55:23.995198 19767 raft_consensus.cc:3060] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:23.984483 19983 leader_election.cc:290] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:23.999456 20032 raft_consensus.cc:2804] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:24.001277 19896 tablet_bootstrap.cc:492] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:24.001720 19896 ts_tablet_manager.cc:1403] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.156s	user 0.008s	sys 0.030s
I20260928 01:55:24.008356 20032 raft_consensus.cc:697] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:24.010404 19890 tablet_bootstrap.cc:492] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:24.009245 20032 consensus_queue.cc:237] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.014197 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e902da355b641868c207fc26578b739" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:24.014817 19474 raft_consensus.cc:3060] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:24.023721 19896 raft_consensus.cc:359] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.024461 19896 raft_consensus.cc:385] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.024734 19896 raft_consensus.cc:740] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.025554 19890 ts_tablet_manager.cc:1403] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.211s	user 0.010s	sys 0.001s
I20260928 01:55:24.028151 19890 raft_consensus.cc:359] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.028836 19890 raft_consensus.cc:385] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.029100 19890 raft_consensus.cc:740] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.032347 19896 consensus_queue.cc:260] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.044574 19890 consensus_queue.cc:260] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.046051 19896 ts_tablet_manager.cc:1434] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260928 01:55:24.046113 19474 raft_consensus.cc:2468] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:24.052520 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet dfc63ccbe4e84373aabe3009cc3d2568 with delete_type TABLET_DATA_DELETED (replaced by tablet f7b78eb499d6418f8877bf3b59bbbec2) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:24.057770 19890 ts_tablet_manager.cc:1434] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.032s	user 0.001s	sys 0.005s
I20260928 01:55:24.058559 19896 tablet_bootstrap.cc:492] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:24.063508 19597 tablet_service.cc:1558] Processing DeleteTablet for tablet dfc63ccbe4e84373aabe3009cc3d2568 with delete_type TABLET_DATA_DELETED (replaced by tablet f7b78eb499d6418f8877bf3b59bbbec2) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:24.065308 19896 tablet_bootstrap.cc:654] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:24.066736 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet dfc63ccbe4e84373aabe3009cc3d2568 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfc63ccbe4e84373aabe3009cc3d2568 already in progress: creating tablet
I20260928 01:55:24.071040 19117 catalog_manager.cc:6934] ReplaceTablet: tablet dfc63ccbe4e84373aabe3009cc3d2568 deleted and replaced by tablet f7b78eb499d6418f8877bf3b59bbbec2
I20260928 01:55:24.075716 19890 tablet_bootstrap.cc:492] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:24.077708 19455 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5d78f6a3c14931b0033ef5ab76f701 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:24.081210 19890 tablet_bootstrap.cc:654] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:24.092916 19896 tablet_bootstrap.cc:492] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:24.093362 19896 ts_tablet_manager.cc:1403] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.000s
I20260928 01:55:24.100952 20029 tablet_bootstrap.cc:492] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:24.101460 20029 ts_tablet_manager.cc:1403] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.609s	user 0.013s	sys 0.005s
I20260928 01:55:24.102840 19890 tablet_bootstrap.cc:492] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:24.103269 19890 ts_tablet_manager.cc:1403] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.000s
I20260928 01:55:24.106236 19890 raft_consensus.cc:359] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.106561 19745 tablet_service.cc:1558] Processing DeleteTablet for tablet dfc63ccbe4e84373aabe3009cc3d2568 with delete_type TABLET_DATA_DELETED (replaced by tablet f7b78eb499d6418f8877bf3b59bbbec2) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:24.106943 19890 raft_consensus.cc:385] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.107227 19890 raft_consensus.cc:740] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.091059 20010 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 37) took 1164 ms. Trace:
I20260928 01:55:24.111624 20010 rpcz_store.cc:276] 0928 01:55:22.924883 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:22.929603 (+  4720us) service_pool.cc:224] Handling call
0928 01:55:23.397193 (+467590us) ts_tablet_manager.cc:1151] Deleting tablet 8a5d78f6a3c14931b0033ef5ab76f701
0928 01:55:23.398112 (+   919us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:23.871419 (+473307us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:23.966017 (+ 94598us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:24.088735 (+122718us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62951,"tablet-delete.queue_time_us":457252,"thread_start_us":648707,"threads_started":1}
I20260928 01:55:24.113744 20010 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 43) took 1009 ms. Trace:
I20260928 01:55:24.114105 20010 rpcz_store.cc:276] 0928 01:55:23.104946 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:23.105108 (+   162us) service_pool.cc:224] Handling call
0928 01:55:24.113334 (+1008226us) ts_tablet_manager.cc:1151] Deleting tablet 457837143b0f4763a4b91bb25b580477
0928 01:55:24.113387 (+    53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:24.113678 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1007371}
I20260928 01:55:24.115232 20010 tablet_replica.cc:333] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:24.114939 19896 raft_consensus.cc:359] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.115656 19896 raft_consensus.cc:385] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.115916 19896 raft_consensus.cc:740] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.118908 19896 consensus_queue.cc:260] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.120923 19896 ts_tablet_manager.cc:1434] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260928 01:55:24.121824 19896 tablet_bootstrap.cc:492] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:24.088039 19767 raft_consensus.cc:2468] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:24.107867 19890 consensus_queue.cc:260] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.133112 19553 leader_election.cc:304] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:24.133920 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 8a5d78f6a3c14931b0033ef5ab76f701 (table default.Table_de632f40c91243848f008af01906cc16 [id=b40893608e4a4237ae1f2b14101fc2a9]) successfully deleted
W20260928 01:55:24.134881 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 457837143b0f4763a4b91bb25b580477 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 457837143b0f4763a4b91bb25b580477 already in progress: creating tablet
I20260928 01:55:24.142067 19112 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_81d3425d966643d9a809d91d9d5a432c" } new_table_name: "default.Table_6cf661a2ac0041cf96e63f24fe950f60" modify_external_catalogs: true
I20260928 01:55:24.144867 20010 raft_consensus.cc:2243] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:24.147265 19896 tablet_bootstrap.cc:654] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:24.157651 20029 raft_consensus.cc:359] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.158586 20029 raft_consensus.cc:385] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.159534 20010 raft_consensus.cc:2272] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:24.158902 20029 raft_consensus.cc:740] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.162385 20010 ts_tablet_manager.cc:1916] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:24.168943 20029 consensus_queue.cc:260] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.182176 20029 ts_tablet_manager.cc:1434] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.002s
I20260928 01:55:24.183317 20029 tablet_bootstrap.cc:492] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:55:24.207806 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet dfc63ccbe4e84373aabe3009cc3d2568 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfc63ccbe4e84373aabe3009cc3d2568 already in progress: creating tablet
W20260928 01:55:24.209782 19103 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e2d1238d0a2d45c0a708442fd0b17291 consensus state has no leader
I20260928 01:55:24.209183 20056 tablet_replica.cc:333] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:24.211841 20056 raft_consensus.cc:2243] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:24.212507 20056 raft_consensus.cc:2272] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:24.212453 20066 raft_consensus.cc:2804] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:24.214632 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_bf23f63a04b0482b90316c68c5638c2f"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:24.216800 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf23f63a04b0482b90316c68c5638c2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:24.221361 20029 tablet_bootstrap.cc:654] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:24.223786 19110 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_f9fd93a6752f44cab502812f0217d67c" } new_table_name: "default.Table_9d2c34bd356c4efa9ec1f1e11ab42a67" modify_external_catalogs: true
I20260928 01:55:24.224223 20066 raft_consensus.cc:697] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:24.225171 20066 consensus_queue.cc:237] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.249073 20064 raft_consensus.cc:493] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:24.270515 20029 tablet_bootstrap.cc:492] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:24.271008 20029 ts_tablet_manager.cc:1403] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.001s
I20260928 01:55:24.275141 20029 raft_consensus.cc:359] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.273998 20066 raft_consensus.cc:493] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:24.276892 20066 raft_consensus.cc:515] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.295629 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad62475da6e74fb4971837a018e77c1c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:24.298812 19553 leader_election.cc:343] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:24.276098 20029 raft_consensus.cc:385] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.303309 20029 raft_consensus.cc:740] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.316967 20029 consensus_queue.cc:260] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.228297 20045 raft_consensus.cc:493] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:24.281162 19896 tablet_bootstrap.cc:492] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:24.336457 20029 ts_tablet_manager.cc:1434] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.065s	user 0.012s	sys 0.001s
I20260928 01:55:24.336705 19896 ts_tablet_manager.cc:1403] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.215s	user 0.027s	sys 0.015s
I20260928 01:55:24.315711 20010 ts_tablet_manager.cc:1929] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:24.336642 20045 raft_consensus.cc:515] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.337325 20010 log.cc:1199] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/952df055998942f89baabb341e204f43
I20260928 01:55:24.338580 20010 ts_tablet_manager.cc:1950] T 952df055998942f89baabb341e204f43 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:24.284533 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad62475da6e74fb4971837a018e77c1c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:24.341317 19896 raft_consensus.cc:359] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.342042 19896 raft_consensus.cc:385] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.342379 19896 raft_consensus.cc:740] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.343089 20045 leader_election.cc:290] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:24.343101 19896 consensus_queue.cc:260] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:24.344774 19409 leader_election.cc:343] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: 952df055998942f89baabb341e204f43
I20260928 01:55:24.352166 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 952df055998942f89baabb341e204f43 (table default.Table_88ced5d20fea41538f5221b8f4367570 [id=d09064e0c8664ffd9e2fbf72f49b8e31]) successfully deleted
I20260928 01:55:24.358886 20029 tablet_bootstrap.cc:492] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:24.365211 19896 ts_tablet_manager.cc:1434] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260928 01:55:24.368865 19896 tablet_bootstrap.cc:492] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:24.370136 20010 tablet_replica.cc:333] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:24.371200 20010 raft_consensus.cc:2243] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:24.371809 20010 raft_consensus.cc:2272] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:24.373840 20010 ts_tablet_manager.cc:1916] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:24.378532 19896 tablet_bootstrap.cc:654] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:24.379079 20056 ts_tablet_manager.cc:1916] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:24.283025 20062 raft_consensus.cc:493] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:24.249856 20064 raft_consensus.cc:515] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.302570 20066 leader_election.cc:290] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:24.398327 19896 tablet_bootstrap.cc:492] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:24.398842 19896 ts_tablet_manager.cc:1403] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.016s
I20260928 01:55:24.402005 19896 raft_consensus.cc:359] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.402702 19896 raft_consensus.cc:385] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.402976 19896 raft_consensus.cc:740] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.403612 19896 consensus_queue.cc:260] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.407764 19111 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet a43cfb32bd0043049cbdb2faaf10409f
I20260928 01:55:24.413437 19896 ts_tablet_manager.cc:1434] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260928 01:55:24.416939 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet a43cfb32bd0043049cbdb2faaf10409f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:24.418023 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet a43cfb32bd0043049cbdb2faaf10409f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:24.418978 20029 tablet_bootstrap.cc:654] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:24.421442 20056 ts_tablet_manager.cc:1929] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:24.422300 19896 tablet_bootstrap.cc:492] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:24.430349 19896 tablet_bootstrap.cc:654] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:24.433527 20056 log.cc:1199] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/8a5d78f6a3c14931b0033ef5ab76f701
I20260928 01:55:24.434429 20056 ts_tablet_manager.cc:1950] T 8a5d78f6a3c14931b0033ef5ab76f701 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:24.436395 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 8a5d78f6a3c14931b0033ef5ab76f701 (table default.Table_de632f40c91243848f008af01906cc16 [id=b40893608e4a4237ae1f2b14101fc2a9]) successfully deleted
I20260928 01:55:24.394876 20062 raft_consensus.cc:515] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:24.438607 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet a43cfb32bd0043049cbdb2faaf10409f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a43cfb32bd0043049cbdb2faaf10409f already in progress: creating tablet
I20260928 01:55:24.439600 19896 tablet_bootstrap.cc:492] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:24.440096 19896 ts_tablet_manager.cc:1403] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.003s
I20260928 01:55:24.443005 19896 raft_consensus.cc:359] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.443750 19896 raft_consensus.cc:385] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.444020 19896 raft_consensus.cc:740] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.444905 19896 consensus_queue.cc:260] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.458292 19896 ts_tablet_manager.cc:1434] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260928 01:55:24.464632 20045 raft_consensus.cc:493] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:24.465346 20045 raft_consensus.cc:515] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.467607 20045 leader_election.cc:290] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:24.470611 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8bbb627a14a477c9362d2b250f27c1e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:24.473117 19409 leader_election.cc:343] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: Tablet not RUNNING: STOPPED
I20260928 01:55:24.472934 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_2f8387344a7b436e9f8c612413234c82"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:24.475154 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f8387344a7b436e9f8c612413234c82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:24.484537 19896 tablet_bootstrap.cc:492] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:24.486822 20028 raft_consensus.cc:493] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:24.487398 20028 raft_consensus.cc:515] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.489710 20028 leader_election.cc:290] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:24.491261 19896 tablet_bootstrap.cc:654] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:24.491300 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:24.499233 19890 ts_tablet_manager.cc:1434] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.396s	user 0.090s	sys 0.099s
I20260928 01:55:24.506498 20029 tablet_bootstrap.cc:492] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:24.507198 20029 ts_tablet_manager.cc:1403] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.149s	user 0.005s	sys 0.007s
I20260928 01:55:24.509068 19890 tablet_bootstrap.cc:492] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:24.513834 20029 raft_consensus.cc:359] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.514864 20029 raft_consensus.cc:385] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.515215 20029 raft_consensus.cc:740] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.516117 20029 consensus_queue.cc:260] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.518990 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:24.519832 19619 raft_consensus.cc:2468] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:24.522315 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:24.523159 19767 raft_consensus.cc:2468] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:24.524456 20029 ts_tablet_manager.cc:1434] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.005s
W20260928 01:55:24.508055 19703 leader_election.cc:343] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:24.525847 19553 leader_election.cc:304] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:24.526247 20029 tablet_bootstrap.cc:492] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:24.527648 19704 leader_election.cc:304] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:24.529320 20028 raft_consensus.cc:2804] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:24.529788 20028 raft_consensus.cc:493] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:24.530284 20028 raft_consensus.cc:3060] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:24.534427 19896 tablet_bootstrap.cc:492] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:24.534976 19896 ts_tablet_manager.cc:1403] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.008s
W20260928 01:55:24.500901 19556 leader_election.cc:343] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:24.539673 19556 leader_election.cc:304] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:24.541047 20062 leader_election.cc:290] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:24.541929 19896 raft_consensus.cc:359] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.542768 19896 raft_consensus.cc:385] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.543056 19896 raft_consensus.cc:740] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.544528 20064 leader_election.cc:290] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:24.543777 19896 consensus_queue.cc:260] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.547770 19896 ts_tablet_manager.cc:1434] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.004s
I20260928 01:55:24.550707 19896 tablet_bootstrap.cc:492] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:24.550631 20059 raft_consensus.cc:2804] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:24.551229 20059 raft_consensus.cc:493] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:24.551718 20059 raft_consensus.cc:3060] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:24.552696 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 117236us
I20260928 01:55:24.554147 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952df055998942f89baabb341e204f43" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:24.557003 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bccc8b0045456fa7f16e984b3c5bf5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:24.557955 19412 leader_election.cc:343] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: c8bbb627a14a477c9362d2b250f27c1e
I20260928 01:55:24.558554 19412 leader_election.cc:304] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:24.559136 19597 tablet_service.cc:1558] Processing DeleteTablet for tablet a43cfb32bd0043049cbdb2faaf10409f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:24.560770 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:24.562399 20062 raft_consensus.cc:2749] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:24.562599 20045 raft_consensus.cc:2749] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:24.574312 19896 tablet_bootstrap.cc:654] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:24.576589 19104 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260928 01:55:24.579059 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet a43cfb32bd0043049cbdb2faaf10409f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a43cfb32bd0043049cbdb2faaf10409f already in progress: creating tablet
I20260928 01:55:24.579625 19412 leader_election.cc:304] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:24.581744 19903 raft_consensus.cc:2749] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:24.582052 19556 leader_election.cc:343] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:24.582724 19556 leader_election.cc:343] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:24.587496 19890 tablet_bootstrap.cc:654] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:24.584559 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bccc8b0045456fa7f16e984b3c5bf5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:24.593439 19553 leader_election.cc:343] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:24.594060 20029 tablet_bootstrap.cc:654] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:24.594107 19553 leader_election.cc:304] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:24.596096 20062 raft_consensus.cc:2749] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:24.597939 19896 tablet_bootstrap.cc:492] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:24.598476 19896 ts_tablet_manager.cc:1403] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.009s
I20260928 01:55:24.606184 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_2fbaba56e6074d2caa5b8a3603cc5ff9"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:24.608180 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2fbaba56e6074d2caa5b8a3603cc5ff9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:24.610512 20059 raft_consensus.cc:515] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.617121 19118 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet e3bccc8b0045456fa7f16e984b3c5bf5
I20260928 01:55:24.619262 19118 catalog_manager.cc:6934] ReplaceTablet: tablet e3bccc8b0045456fa7f16e984b3c5bf5 deleted and replaced by tablet f3741aec215343468b2d7bc952da03c8
I20260928 01:55:24.620072 19118 master_service.cc:960] ReplaceTablet: received request to replace tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:24.637745 19896 raft_consensus.cc:359] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.638652 19896 raft_consensus.cc:385] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.638964 19896 raft_consensus.cc:740] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.639744 19896 consensus_queue.cc:260] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.647948 19903 raft_consensus.cc:493] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:24.648469 19903 raft_consensus.cc:515] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.650415 19903 leader_election.cc:290] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:24.650550 19104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 73977.3us
I20260928 01:55:24.653147 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet e3bccc8b0045456fa7f16e984b3c5bf5 with delete_type TABLET_DATA_DELETED (replaced by tablet f3741aec215343468b2d7bc952da03c8) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:24.655606 19896 ts_tablet_manager.cc:1434] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.004s
I20260928 01:55:24.656595 19896 tablet_bootstrap.cc:492] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:24.662040 19896 tablet_bootstrap.cc:654] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:24.664961 19110 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f887fe10461d40ee9363ce97ebbedd4f has no consensus state
W20260928 01:55:24.668051 19112 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce41f63df46f4d0493ca22a13daadb4f consensus state has no leader
I20260928 01:55:24.674633 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_63f36a8d22184eac8a38565457441d09"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:24.675194 19597 tablet_service.cc:1558] Processing DeleteTablet for tablet e3bccc8b0045456fa7f16e984b3c5bf5 with delete_type TABLET_DATA_DELETED (replaced by tablet f3741aec215343468b2d7bc952da03c8) from {username='slave'} at 127.0.0.1:47670
W20260928 01:55:24.676738 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63f36a8d22184eac8a38565457441d09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:24.677273 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7801c623930d4e4eaf24c5c424b06d26" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:24.679111 19619 raft_consensus.cc:2393] T 7801c623930d4e4eaf24c5c424b06d26 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:24.683372 19110 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_7be970fbb13745978e6b90a9a7d84fb7" } modify_external_catalogs: true
I20260928 01:55:24.689872 19110 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_7be970fbb13745978e6b90a9a7d84fb7" } modify_external_catalogs: true
I20260928 01:55:24.704584 20008 tablet_replica.cc:333] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:24.705884 20008 raft_consensus.cc:2243] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:24.706583 20008 raft_consensus.cc:2272] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:24.709233 20008 ts_tablet_manager.cc:1916] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:24.715435 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:24.715680 20059 leader_election.cc:290] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:24.716995 19556 leader_election.cc:343] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:24.726627 19890 tablet_bootstrap.cc:492] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:24.729035 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:24.730650 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet e3bccc8b0045456fa7f16e984b3c5bf5 with delete_type TABLET_DATA_DELETED (replaced by tablet f3741aec215343468b2d7bc952da03c8) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:24.731475 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7801c623930d4e4eaf24c5c424b06d26" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:24.733428 19409 leader_election.cc:304] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:24.734640 19903 raft_consensus.cc:3060] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:24.739610 20010 ts_tablet_manager.cc:1929] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:24.743119 19903 raft_consensus.cc:2749] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:24.744395 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 236383us
I20260928 01:55:24.746186 19896 tablet_bootstrap.cc:492] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:24.746814 19896 ts_tablet_manager.cc:1403] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.090s	user 0.030s	sys 0.024s
I20260928 01:55:24.747113 19890 ts_tablet_manager.cc:1403] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.238s	user 0.040s	sys 0.035s
I20260928 01:55:24.749581 19896 raft_consensus.cc:359] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.750346 19896 raft_consensus.cc:385] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.750641 19896 raft_consensus.cc:740] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.751230 19979 consensus_queue.cc:1048] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:24.751331 19896 consensus_queue.cc:260] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.754489 19890 raft_consensus.cc:359] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.758879 19890 raft_consensus.cc:385] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.760035 19890 raft_consensus.cc:740] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.767374 19896 ts_tablet_manager.cc:1434] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260928 01:55:24.740097 20010 log.cc:1199] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/c8bbb627a14a477c9362d2b250f27c1e
I20260928 01:55:24.774681 20010 ts_tablet_manager.cc:1950] T c8bbb627a14a477c9362d2b250f27c1e P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:24.775952 19890 consensus_queue.cc:260] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.791023 19896 tablet_bootstrap.cc:492] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:24.808339 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_ef217ae2f1514ce99c1f8993333e2ec6"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:24.810375 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef217ae2f1514ce99c1f8993333e2ec6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:24.810962 20059 raft_consensus.cc:493] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:24.811497 20059 raft_consensus.cc:515] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.813627 20059 leader_election.cc:290] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:24.816087 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027f99abaacc4c169661e7db08512ebd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:24.816973 19474 raft_consensus.cc:2468] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:24.818085 20028 raft_consensus.cc:515] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.818538 19556 leader_election.cc:304] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:24.819751 20059 raft_consensus.cc:2804] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:24.820153 20059 raft_consensus.cc:493] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:24.820812 20059 raft_consensus.cc:3060] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:24.832876 19890 ts_tablet_manager.cc:1434] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.006s
I20260928 01:55:24.840629 19896 tablet_bootstrap.cc:654] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:24.848660 19890 tablet_bootstrap.cc:492] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:24.856597 20059 raft_consensus.cc:515] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.860718 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027f99abaacc4c169661e7db08512ebd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:24.861527 19474 raft_consensus.cc:3060] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:24.842806 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet e3bccc8b0045456fa7f16e984b3c5bf5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3bccc8b0045456fa7f16e984b3c5bf5 already in progress: creating tablet
I20260928 01:55:24.869938 20059 leader_election.cc:290] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:24.872411 19474 raft_consensus.cc:2468] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:24.874665 19556 leader_election.cc:304] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:24.817983 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027f99abaacc4c169661e7db08512ebd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:24.876912 19553 leader_election.cc:343] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:24.878517 19767 raft_consensus.cc:2393] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:24.878647 19896 tablet_bootstrap.cc:492] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:24.879156 19896 ts_tablet_manager.cc:1403] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.001s
I20260928 01:55:24.882186 19896 raft_consensus.cc:359] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.882886 19896 raft_consensus.cc:385] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.883143 19896 raft_consensus.cc:740] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.883539 19118 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet a6fb7f3e609144f5a9dcc8b40d21dbb2
I20260928 01:55:24.883780 19896 consensus_queue.cc:260] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.885596 19553 leader_election.cc:304] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:24.885828 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 90b3c947794c48daaacc299a7d2dd4a9) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:24.886587 20056 tablet_replica.cc:333] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:24.887420 20056 raft_consensus.cc:2243] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:24.888026 20062 raft_consensus.cc:2804] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:24.888151 20028 leader_election.cc:290] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:24.888533 20062 raft_consensus.cc:697] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:24.889341 20062 consensus_queue.cc:237] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.891372 20064 raft_consensus.cc:2749] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:24.891719 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:24.842598 20010 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 49) took 1393 ms. Trace:
I20260928 01:55:24.871641 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027f99abaacc4c169661e7db08512ebd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:55:24.893800 19553 leader_election.cc:343] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:24.894659 20010 rpcz_store.cc:276] 0928 01:55:23.497074 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:23.503946 (+  6872us) service_pool.cc:224] Handling call
0928 01:55:24.369909 (+865963us) ts_tablet_manager.cc:1151] Deleting tablet c8bbb627a14a477c9362d2b250f27c1e
0928 01:55:24.369970 (+    61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:24.423501 (+ 53531us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:24.739438 (+315937us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:24.842507 (+103069us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":843744}
I20260928 01:55:24.896862 20010 tablet_replica.cc:333] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:24.897897 20010 raft_consensus.cc:2243] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
W20260928 01:55:24.898268 19703 leader_election.cc:343] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:24.898861 19113 master_service.cc:960] ReplaceTablet: received request to replace tablet 457837143b0f4763a4b91bb25b580477 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:24.899935 20087 consensus_queue.cc:1048] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:24.901815 20087 consensus_queue.cc:1048] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:24.904654 20056 raft_consensus.cc:2272] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:24.905718 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 90b3c947794c48daaacc299a7d2dd4a9) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:24.905308 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet c8bbb627a14a477c9362d2b250f27c1e (table default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]) successfully deleted
I20260928 01:55:24.906586 19896 ts_tablet_manager.cc:1434] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260928 01:55:24.907560 19896 tablet_bootstrap.cc:492] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:24.909243 20056 ts_tablet_manager.cc:1916] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:24.909276 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:24.910012 19619 raft_consensus.cc:2393] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:24.913477 19979 raft_consensus.cc:493] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:24.914085 19979 raft_consensus.cc:515] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.913990 19113 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_b713dc73dad84f5bafa62a44927e914b" } new_table_name: "default.Table_1a6a047e1e8f4430a6756891154a5e3b" modify_external_catalogs: true
I20260928 01:55:24.916458 19979 leader_election.cc:290] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:24.919642 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc63ccbe4e84373aabe3009cc3d2568" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:24.935667 19112 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_681519b5f7f6410db9f306d4a16596cc" } new_table_name: "default.Table_6e5d3bc7faaa43e6acaa07748a4c110c" modify_external_catalogs: true
I20260928 01:55:24.937954 19896 tablet_bootstrap.cc:654] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:24.918143 19704 leader_election.cc:304] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:24.948848 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc63ccbe4e84373aabe3009cc3d2568" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:24.949724 19474 raft_consensus.cc:2468] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:24.950759 20086 raft_consensus.cc:2749] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 01:55:24.957037 19704 leader_election.cc:343] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:24.957358 20008 ts_tablet_manager.cc:1929] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:24.958266 20008 log.cc:1199] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/e3bccc8b0045456fa7f16e984b3c5bf5
I20260928 01:55:24.960170 19903 raft_consensus.cc:493] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:24.960707 19903 raft_consensus.cc:515] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.962657 19903 leader_election.cc:290] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:24.964849 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd4743c49314e8b8d86e1c6e553b13e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:24.942165 20029 tablet_bootstrap.cc:492] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:24.946703 20010 pending_rounds.cc:70] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da: Trying to abort 1 pending ops.
I20260928 01:55:24.966341 20010 pending_rounds.cc:77] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135900602261504 op_type: NO_OP noop_request { }
I20260928 01:55:24.967000 20010 raft_consensus.cc:2889] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260928 01:55:24.967233 19412 leader_election.cc:343] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 7dd4743c49314e8b8d86e1c6e553b13e
I20260928 01:55:24.967684 19412 leader_election.cc:304] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:24.968770 19903 raft_consensus.cc:2749] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:24.969508 20010 raft_consensus.cc:2272] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:24.975471 20010 ts_tablet_manager.cc:1916] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:24.981876 19896 tablet_bootstrap.cc:492] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:24.966028 20029 ts_tablet_manager.cc:1403] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.440s	user 0.018s	sys 0.006s
I20260928 01:55:24.982354 19896 ts_tablet_manager.cc:1403] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.000s
I20260928 01:55:24.985284 20029 raft_consensus.cc:359] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.985616 19896 raft_consensus.cc:359] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.986267 19896 raft_consensus.cc:385] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.986531 19896 raft_consensus.cc:740] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.987442 20029 raft_consensus.cc:385] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:24.987303 19896 consensus_queue.cc:260] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:24.988058 20029 raft_consensus.cc:740] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:24.970826 19703 leader_election.cc:304] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:24.991871 19979 raft_consensus.cc:2804] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:24.992645 19979 raft_consensus.cc:493] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:24.993104 19979 raft_consensus.cc:3060] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:24.998622 19896 ts_tablet_manager.cc:1434] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260928 01:55:25.004597 19890 tablet_bootstrap.cc:654] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:25.007325 20087 consensus_queue.cc:1048] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:25.017365 19896 tablet_bootstrap.cc:492] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:25.018409 19118 catalog_manager.cc:6934] ReplaceTablet: tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 deleted and replaced by tablet 90b3c947794c48daaacc299a7d2dd4a9
I20260928 01:55:25.018520 19597 tablet_service.cc:1558] Processing DeleteTablet for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 90b3c947794c48daaacc299a7d2dd4a9) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:25.024706 20029 consensus_queue.cc:260] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.031991 20029 ts_tablet_manager.cc:1434] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260928 01:55:25.049738 19896 tablet_bootstrap.cc:654] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:25.052798 19903 raft_consensus.cc:493] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:25.053301 19903 raft_consensus.cc:515] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.055507 19903 leader_election.cc:290] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:25.064632 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:25.065316 19620 raft_consensus.cc:2468] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:25.066938 19412 leader_election.cc:304] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:25.068413 19903 raft_consensus.cc:2804] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:25.068881 19903 raft_consensus.cc:493] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:25.069310 19903 raft_consensus.cc:3060] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:25.077916 19896 tablet_bootstrap.cc:492] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:25.078441 19896 ts_tablet_manager.cc:1403] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.002s
I20260928 01:55:25.076260 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:25.080291 19903 raft_consensus.cc:515] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.081055 19766 raft_consensus.cc:2468] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:25.081650 20008 ts_tablet_manager.cc:1950] T e3bccc8b0045456fa7f16e984b3c5bf5 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:25.087072 20087 raft_consensus.cc:493] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:25.087550 20087 raft_consensus.cc:515] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.091707 20087 leader_election.cc:290] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:25.098726 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:25.099354 19620 raft_consensus.cc:2468] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:25.101847 19704 leader_election.cc:304] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:25.102916 20028 raft_consensus.cc:2804] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:25.103356 20028 raft_consensus.cc:493] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:25.103871 20028 raft_consensus.cc:3060] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:25.048729 19979 raft_consensus.cc:515] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.116058 20029 tablet_bootstrap.cc:492] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:55:25.118192 19112 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 219b7dad56a64a3b813344e0ed9bdbdc has no consensus state
I20260928 01:55:25.090481 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:25.124681 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet e3bccc8b0045456fa7f16e984b3c5bf5 (table default.Table_1d40de09d743485db2f538534e097074 [id=c314147c39ca4ef695e61de1652cf804]) successfully deleted
I20260928 01:55:25.133571 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc63ccbe4e84373aabe3009cc3d2568" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:25.135221 19704 leader_election.cc:343] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:25.136317 19979 leader_election.cc:290] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:25.136551 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_f8b9950aa8284139a842273931f64732"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:25.138795 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8b9950aa8284139a842273931f64732 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:25.133934 20008 tablet_replica.cc:333] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:25.143940 20008 raft_consensus.cc:2243] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:25.155277 19473 raft_consensus.cc:2393] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:25.155021 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc63ccbe4e84373aabe3009cc3d2568" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:25.149820 20028 raft_consensus.cc:515] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.156013 19474 raft_consensus.cc:3060] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:25.163381 19896 raft_consensus.cc:359] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.164714 20029 tablet_bootstrap.cc:654] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:25.164606 19474 raft_consensus.cc:2468] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:25.164841 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:25.166110 19896 raft_consensus.cc:385] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:25.166497 19896 raft_consensus.cc:740] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:25.166566 19703 leader_election.cc:304] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:25.167232 19896 consensus_queue.cc:260] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.168079 19903 leader_election.cc:290] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:25.169313 19979 raft_consensus.cc:2804] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:25.170457 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:25.171222 19766 raft_consensus.cc:2393] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:25.172351 20008 raft_consensus.cc:2272] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:25.147305 19890 tablet_bootstrap.cc:492] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:25.175022 19890 ts_tablet_manager.cc:1403] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.327s	user 0.007s	sys 0.004s
I20260928 01:55:25.164009 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:25.175598 19619 raft_consensus.cc:3060] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:25.167932 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:25.181011 19412 leader_election.cc:304] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:25.181442 20059 raft_consensus.cc:493] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:25.181843 20100 raft_consensus.cc:2749] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:25.181879 20059 raft_consensus.cc:515] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.184064 20059 leader_election.cc:290] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:25.185688 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43cfb32bd0043049cbdb2faaf10409f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:25.186170 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43cfb32bd0043049cbdb2faaf10409f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:25.186430 19473 raft_consensus.cc:2468] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:25.187770 19556 leader_election.cc:304] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:25.189023 19553 leader_election.cc:343] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:25.189333 19890 raft_consensus.cc:359] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.189973 19890 raft_consensus.cc:385] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:25.191833 19896 ts_tablet_manager.cc:1434] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.113s	user 0.009s	sys 0.002s
I20260928 01:55:25.195122 19619 raft_consensus.cc:2468] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:25.196808 19979 raft_consensus.cc:697] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:25.197818 19979 consensus_queue.cc:237] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.196123 20059 raft_consensus.cc:2804] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:25.202286 19896 tablet_bootstrap.cc:492] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:25.202338 20059 raft_consensus.cc:493] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:25.202997 20059 raft_consensus.cc:3060] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:25.210479 20028 leader_election.cc:290] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:25.217047 19704 leader_election.cc:304] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:25.218783 20056 ts_tablet_manager.cc:1929] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:25.219274 20056 log.cc:1199] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/a6fb7f3e609144f5a9dcc8b40d21dbb2
W20260928 01:55:25.219901 19104 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet ce41f63df46f4d0493ca22a13daadb4f (table default.Table_6cf661a2ac0041cf96e63f24fe950f60 [id=9e114860728146b097bcfce77a95f9d0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ce41f63df46f4d0493ca22a13daadb4f consensus state has no leader
I20260928 01:55:25.220973 20056 ts_tablet_manager.cc:1950] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:25.222831 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 (table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]) successfully deleted
I20260928 01:55:25.223479 20010 ts_tablet_manager.cc:1929] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:25.190228 19890 raft_consensus.cc:740] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:25.223886 20010 log.cc:1199] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/7dd4743c49314e8b8d86e1c6e553b13e
I20260928 01:55:25.224706 20010 ts_tablet_manager.cc:1950] T 7dd4743c49314e8b8d86e1c6e553b13e P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:25.226106 19890 consensus_queue.cc:260] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.229364 20059 raft_consensus.cc:515] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.244314 19476 raft_consensus.cc:3060] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:25.244870 20059 leader_election.cc:290] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:25.247030 19896 tablet_bootstrap.cc:654] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:25.248867 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43cfb32bd0043049cbdb2faaf10409f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:25.249503 19473 raft_consensus.cc:3060] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:25.253319 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43cfb32bd0043049cbdb2faaf10409f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:55:25.255353 19553 leader_election.cc:343] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:25.257112 20028 raft_consensus.cc:2804] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:25.261363 20100 raft_consensus.cc:493] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:25.261847 20100 raft_consensus.cc:515] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.262355 20028 raft_consensus.cc:697] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:25.263985 20100 leader_election.cc:290] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:25.265952 19412 leader_election.cc:343] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: e3bccc8b0045456fa7f16e984b3c5bf5
I20260928 01:55:25.263350 20028 consensus_queue.cc:237] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.266155 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bccc8b0045456fa7f16e984b3c5bf5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:25.268194 19409 leader_election.cc:343] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:25.268893 19409 leader_election.cc:304] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:25.270517 20100 raft_consensus.cc:2749] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:25.174554 20008 ts_tablet_manager.cc:1916] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:25.277557 20010 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 50) took 1470 ms. Trace:
I20260928 01:55:25.278100 20010 rpcz_store.cc:276] 0928 01:55:23.807263 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:23.811403 (+  4140us) service_pool.cc:224] Handling call
0928 01:55:24.896675 (+1085272us) ts_tablet_manager.cc:1151] Deleting tablet 7dd4743c49314e8b8d86e1c6e553b13e
0928 01:55:24.896727 (+    52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:25.119077 (+222350us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:25.223334 (+104257us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:25.277466 (+ 54132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1084651}
I20260928 01:55:25.281002 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 7dd4743c49314e8b8d86e1c6e553b13e (table default.Table_b713dc73dad84f5bafa62a44927e914b [id=c9816a660a324eb9a6eeb87f2f1e9422]) successfully deleted
I20260928 01:55:25.272501 19473 raft_consensus.cc:2468] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:25.283042 20059 consensus_queue.cc:1048] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:25.275382 19890 ts_tablet_manager.cc:1434] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.001s
I20260928 01:55:25.292268 19556 leader_election.cc:304] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:25.295017 20059 raft_consensus.cc:2804] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:25.295738 20059 raft_consensus.cc:697] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:25.296816 20100 raft_consensus.cc:493] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:25.296989 20059 consensus_queue.cc:237] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.297451 20100 raft_consensus.cc:515] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.301028 19896 tablet_bootstrap.cc:492] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:25.301678 19896 ts_tablet_manager.cc:1403] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.001s
I20260928 01:55:25.301623 20100 leader_election.cc:290] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:25.303835 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f875e126f04415a108f778a76bb0f5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:25.305225 19896 raft_consensus.cc:359] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.305898 19896 raft_consensus.cc:385] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:25.306798 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f875e126f04415a108f778a76bb0f5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:25.307796 19619 raft_consensus.cc:2468] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:25.306128 19896 raft_consensus.cc:740] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
W20260928 01:55:25.311044 19409 leader_election.cc:343] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:25.311623 19896 consensus_queue.cc:260] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.314358 20029 tablet_bootstrap.cc:492] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:25.323022 20029 ts_tablet_manager.cc:1403] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.221s	user 0.014s	sys 0.005s
I20260928 01:55:25.324010 20010 tablet_replica.cc:333] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:25.316248 19896 ts_tablet_manager.cc:1434] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260928 01:55:25.329154 19454 tablet_service.cc:1511] Processing CreateTablet for tablet f887fe10461d40ee9363ce97ebbedd4f (DEFAULT_TABLE table=default.Table_9d2c34bd356c4efa9ec1f1e11ab42a67 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.330914 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f887fe10461d40ee9363ce97ebbedd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.331595 20010 raft_consensus.cc:2243] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:25.332831 20010 pending_rounds.cc:70] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da: Trying to abort 1 pending ops.
I20260928 01:55:25.333197 20010 pending_rounds.cc:77] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135911265239040 op_type: NO_OP noop_request { }
I20260928 01:55:25.333734 20010 raft_consensus.cc:2889] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:25.334268 20010 raft_consensus.cc:2272] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:25.336659 19896 tablet_bootstrap.cc:492] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:25.342083 19118 catalog_manager.cc:5838] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:55:25.345486 19412 leader_election.cc:304] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:25.347023 20100 raft_consensus.cc:2804] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:25.347522 20100 raft_consensus.cc:493] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:25.348016 20100 raft_consensus.cc:3060] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:25.349454 20029 raft_consensus.cc:359] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.353170 20010 ts_tablet_manager.cc:1916] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:25.355471 20029 raft_consensus.cc:385] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:25.355969 20029 raft_consensus.cc:740] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:25.356679 19896 tablet_bootstrap.cc:654] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:25.361043 19597 tablet_service.cc:1511] Processing CreateTablet for tablet f887fe10461d40ee9363ce97ebbedd4f (DEFAULT_TABLE table=default.Table_9d2c34bd356c4efa9ec1f1e11ab42a67 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.364243 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 77c1f247486548ee9747403f7f80e3dc (DEFAULT_TABLE table=default.Table_bd232d1bc78e49f4a9925680a33c9caa [id=328e52a4270e476faf1b10d89af3a56c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.365696 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f887fe10461d40ee9363ce97ebbedd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.365967 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c1f247486548ee9747403f7f80e3dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.374087 19118 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_1b5bf73ffb5545d29ca961fb3c2108a7 [id=061fd785787a42ad89ff507723fe0cba]). Expected version 1 got 0
W20260928 01:55:25.375862 19113 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33e1cc46939b4932a344b81c3bc8ca82 consensus state has no leader
I20260928 01:55:25.385272 20100 raft_consensus.cc:515] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.388834 19744 tablet_service.cc:1511] Processing CreateTablet for tablet f887fe10461d40ee9363ce97ebbedd4f (DEFAULT_TABLE table=default.Table_9d2c34bd356c4efa9ec1f1e11ab42a67 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.390767 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f887fe10461d40ee9363ce97ebbedd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.401562 20028 raft_consensus.cc:493] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:25.401664 19741 tablet_service.cc:1511] Processing CreateTablet for tablet 77c1f247486548ee9747403f7f80e3dc (DEFAULT_TABLE table=default.Table_bd232d1bc78e49f4a9925680a33c9caa [id=328e52a4270e476faf1b10d89af3a56c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.402884 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c1f247486548ee9747403f7f80e3dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.399358 19599 tablet_service.cc:1511] Processing CreateTablet for tablet 77c1f247486548ee9747403f7f80e3dc (DEFAULT_TABLE table=default.Table_bd232d1bc78e49f4a9925680a33c9caa [id=328e52a4270e476faf1b10d89af3a56c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.405614 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c1f247486548ee9747403f7f80e3dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.402136 20028 raft_consensus.cc:515] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.420552 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027f99abaacc4c169661e7db08512ebd" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:25.429563 19890 tablet_bootstrap.cc:492] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:25.430465 20028 leader_election.cc:290] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:25.446923 19553 consensus_peers.cc:597] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 952df055998942f89baabb341e204f43. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:25.430197 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "027f99abaacc4c169661e7db08512ebd" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:25.460592 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f875e126f04415a108f778a76bb0f5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:25.461689 19619 raft_consensus.cc:3060] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:25.462121 19473 raft_consensus.cc:2393] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:25.464946 19703 leader_election.cc:304] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:25.467907 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f875e126f04415a108f778a76bb0f5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:25.471920 19896 tablet_bootstrap.cc:492] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
W20260928 01:55:25.475684 19409 leader_election.cc:343] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:25.477010 19896 ts_tablet_manager.cc:1403] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.003s
I20260928 01:55:25.361630 20029 consensus_queue.cc:260] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.477845 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 219b7dad56a64a3b813344e0ed9bdbdc (DEFAULT_TABLE table=default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.480233 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219b7dad56a64a3b813344e0ed9bdbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.488457 20100 leader_election.cc:290] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:25.510113 19896 raft_consensus.cc:359] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.510790 19896 raft_consensus.cc:385] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:25.511075 19896 raft_consensus.cc:740] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:25.516615 19896 consensus_queue.cc:260] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.527436 19451 tablet_service.cc:1511] Processing CreateTablet for tablet ef752c3b4b22490ab42292f61278da52 (DEFAULT_TABLE table=default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.532460 19451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef752c3b4b22490ab42292f61278da52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.531745 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 219b7dad56a64a3b813344e0ed9bdbdc (DEFAULT_TABLE table=default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.534101 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219b7dad56a64a3b813344e0ed9bdbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.540854 19979 raft_consensus.cc:3060] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:25.545521 20029 ts_tablet_manager.cc:1434] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.222s	user 0.009s	sys 0.005s
I20260928 01:55:25.549949 19896 ts_tablet_manager.cc:1434] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.004s
I20260928 01:55:25.573416 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:25.574738 19619 raft_consensus.cc:2468] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:25.576665 19412 leader_election.cc:304] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:25.578440 20100 raft_consensus.cc:2804] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:25.578379 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 219b7dad56a64a3b813344e0ed9bdbdc (DEFAULT_TABLE table=default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.578909 20100 raft_consensus.cc:697] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:25.580248 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219b7dad56a64a3b813344e0ed9bdbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.580317 20100 consensus_queue.cc:237] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.588183 19896 tablet_bootstrap.cc:492] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:25.593321 20029 tablet_bootstrap.cc:492] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:55:25.595611 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:25.651932 20100 raft_consensus.cc:493] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:25.652125 19596 tablet_service.cc:1511] Processing CreateTablet for tablet ef752c3b4b22490ab42292f61278da52 (DEFAULT_TABLE table=default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.652621 20100 raft_consensus.cc:515] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.660933 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 33e1cc46939b4932a344b81c3bc8ca82 (DEFAULT_TABLE table=default.Table_1a6a047e1e8f4430a6756891154a5e3b [id=c9816a660a324eb9a6eeb87f2f1e9422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.662810 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e1cc46939b4932a344b81c3bc8ca82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.667269 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad62475da6e74fb4971837a018e77c1c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:25.668373 19620 raft_consensus.cc:2468] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:25.671092 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad62475da6e74fb4971837a018e77c1c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:25.675194 19412 leader_election.cc:304] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:25.678395 19903 raft_consensus.cc:2804] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 01:55:25.680831 19409 leader_election.cc:343] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:25.679309 19903 raft_consensus.cc:493] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:25.685047 19903 raft_consensus.cc:3060] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:25.689095 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef752c3b4b22490ab42292f61278da52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.701354 20086 raft_consensus.cc:493] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:25.702397 20086 raft_consensus.cc:515] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.706379 19741 tablet_service.cc:1511] Processing CreateTablet for tablet ef752c3b4b22490ab42292f61278da52 (DEFAULT_TABLE table=default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.711064 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43cfb32bd0043049cbdb2faaf10409f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:25.714028 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef752c3b4b22490ab42292f61278da52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.662832 20100 leader_election.cc:290] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:25.721225 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43cfb32bd0043049cbdb2faaf10409f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:25.726368 19476 raft_consensus.cc:2393] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:25.734790 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 33e1cc46939b4932a344b81c3bc8ca82 (DEFAULT_TABLE table=default.Table_1a6a047e1e8f4430a6756891154a5e3b [id=c9816a660a324eb9a6eeb87f2f1e9422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.737506 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e1cc46939b4932a344b81c3bc8ca82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.745260 19896 tablet_bootstrap.cc:700] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614: Time spent opening tablet: real 0.135s	user 0.004s	sys 0.000s
I20260928 01:55:25.746750 19896 tablet_bootstrap.cc:654] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:25.707985 20086 leader_election.cc:290] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:25.648043 19979 raft_consensus.cc:2749] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:25.729887 19703 leader_election.cc:304] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:25.738654 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 33e1cc46939b4932a344b81c3bc8ca82 (DEFAULT_TABLE table=default.Table_1a6a047e1e8f4430a6756891154a5e3b [id=c9816a660a324eb9a6eeb87f2f1e9422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.781320 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e1cc46939b4932a344b81c3bc8ca82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.788774 19979 raft_consensus.cc:3060] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:25.797590 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 67956.6us
I20260928 01:55:25.814715 19599 tablet_service.cc:1511] Processing CreateTablet for tablet 90d40050f85a4d6c90a4ce35cf15d134 (DEFAULT_TABLE table=default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.819028 19903 raft_consensus.cc:515] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:25.828790 19117 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 05f875e126f04415a108f778a76bb0f5 (table default.Table_a4827d0104f94435be09b3173ff52905 [id=10dc4468b0ce4b2c87cecd4c66cc5300]). Expected version 1 got 0
I20260928 01:55:25.829789 19117 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_1b5bf73ffb5545d29ca961fb3c2108a7 [id=061fd785787a42ad89ff507723fe0cba]). Expected version 1 got 0
I20260928 01:55:25.830430 19454 tablet_service.cc:1511] Processing CreateTablet for tablet 90d40050f85a4d6c90a4ce35cf15d134 (DEFAULT_TABLE table=default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.831928 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d40050f85a4d6c90a4ce35cf15d134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.833794 20029 tablet_bootstrap.cc:654] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:25.837832 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d40050f85a4d6c90a4ce35cf15d134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.838645 19896 tablet_bootstrap.cc:492] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:25.839114 19896 ts_tablet_manager.cc:1403] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.251s	user 0.008s	sys 0.008s
I20260928 01:55:25.839982 19114 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 05f875e126f04415a108f778a76bb0f5 (table default.Table_a4827d0104f94435be09b3173ff52905 [id=10dc4468b0ce4b2c87cecd4c66cc5300]). Expected version 1 got 0
I20260928 01:55:25.842197 19114 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_1b5bf73ffb5545d29ca961fb3c2108a7 [id=061fd785787a42ad89ff507723fe0cba]). Expected version 1 got 0
I20260928 01:55:25.843761 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 63a3540d1441404092db723b7e5cb61a (DEFAULT_TABLE table=default.Table_2720a066cdca41b4998342e7fb48de23 [id=58b8eec416eb437f92897594371a012f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.844923 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a3540d1441404092db723b7e5cb61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.843812 19114 catalog_manager.cc:5838] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:25.853860 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 90d40050f85a4d6c90a4ce35cf15d134 (DEFAULT_TABLE table=default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.856091 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d40050f85a4d6c90a4ce35cf15d134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.871047 19903 leader_election.cc:290] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:25.878800 20067 consensus_queue.cc:1048] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:25.881028 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad62475da6e74fb4971837a018e77c1c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:25.888607 19104 consensus_peers.cc:597] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc -> Peer 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095): Couldn't send request to peer 04e48edd841a42d08a480be209f0d294. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260928 01:55:25.896401 19619 raft_consensus.cc:3060] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:25.901396 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad62475da6e74fb4971837a018e77c1c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:25.886767 19890 tablet_bootstrap.cc:654] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:25.906322 19409 leader_election.cc:343] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:25.904611 20010 ts_tablet_manager.cc:1929] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:25.907609 20010 log.cc:1199] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/dfc63ccbe4e84373aabe3009cc3d2568
I20260928 01:55:25.909080 20010 ts_tablet_manager.cc:1950] T dfc63ccbe4e84373aabe3009cc3d2568 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:25.915298 19896 raft_consensus.cc:359] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:25.918649 20117 consensus_queue.cc:1048] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:25.926388 20008 ts_tablet_manager.cc:1929] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:25.926970 20008 log.cc:1199] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/a6fb7f3e609144f5a9dcc8b40d21dbb2
I20260928 01:55:25.956874 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 63a3540d1441404092db723b7e5cb61a (DEFAULT_TABLE table=default.Table_2720a066cdca41b4998342e7fb48de23 [id=58b8eec416eb437f92897594371a012f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.957445 19456 tablet_service.cc:1511] Processing CreateTablet for tablet ed6d3c1d99cc40febd285d0a8f5c3196 (DEFAULT_TABLE table=default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.958865 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a3540d1441404092db723b7e5cb61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.965935 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed6d3c1d99cc40febd285d0a8f5c3196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.916121 19896 raft_consensus.cc:385] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:25.976715 19896 raft_consensus.cc:740] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:25.928040 20008 ts_tablet_manager.cc:1950] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:25.987958 19896 consensus_queue.cc:260] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:25.993610 19896 ts_tablet_manager.cc:1434] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.154s	user 0.004s	sys 0.005s
I20260928 01:55:25.992374 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 63a3540d1441404092db723b7e5cb61a (DEFAULT_TABLE table=default.Table_2720a066cdca41b4998342e7fb48de23 [id=58b8eec416eb437f92897594371a012f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:25.999547 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a3540d1441404092db723b7e5cb61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:25.992239 20029 tablet_bootstrap.cc:492] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:26.002660 20029 ts_tablet_manager.cc:1403] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.410s	user 0.016s	sys 0.014s
I20260928 01:55:26.003336 19596 tablet_service.cc:1511] Processing CreateTablet for tablet ed6d3c1d99cc40febd285d0a8f5c3196 (DEFAULT_TABLE table=default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:26.007493 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed6d3c1d99cc40febd285d0a8f5c3196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:26.021957 20029 raft_consensus.cc:359] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.022950 20029 raft_consensus.cc:385] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:26.023366 20029 raft_consensus.cc:740] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:26.035233 20010 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 55) took 1946 ms. Trace:
I20260928 01:55:26.035648 20010 rpcz_store.cc:276] 0928 01:55:24.103388 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:24.106361 (+  2973us) service_pool.cc:224] Handling call
0928 01:55:25.323717 (+1217356us) ts_tablet_manager.cc:1151] Deleting tablet dfc63ccbe4e84373aabe3009cc3d2568
0928 01:55:25.323801 (+    84us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:25.700116 (+376315us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:25.904406 (+204290us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:26.035167 (+130761us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1215090}
I20260928 01:55:26.037055 20010 tablet_replica.cc:333] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:26.043001 19979 raft_consensus.cc:2749] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:26.035473 20029 consensus_queue.cc:260] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.056375 20029 ts_tablet_manager.cc:1434] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.053s	user 0.002s	sys 0.010s
I20260928 01:55:26.059513 19896 tablet_bootstrap.cc:492] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:26.069051 19896 tablet_bootstrap.cc:654] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:26.069253 19741 tablet_service.cc:1511] Processing CreateTablet for tablet ed6d3c1d99cc40febd285d0a8f5c3196 (DEFAULT_TABLE table=default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:26.075646 19890 tablet_bootstrap.cc:492] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:26.076448 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed6d3c1d99cc40febd285d0a8f5c3196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:26.076166 19890 ts_tablet_manager.cc:1403] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.647s	user 0.015s	sys 0.007s
I20260928 01:55:26.087131 20029 tablet_bootstrap.cc:492] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:26.078445 20008 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 51) took 1060 ms. Trace:
I20260928 01:55:26.092726 20008 rpcz_store.cc:276] 0928 01:55:25.018196 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:25.018348 (+   152us) service_pool.cc:224] Handling call
0928 01:55:25.133762 (+115414us) ts_tablet_manager.cc:1151] Deleting tablet a6fb7f3e609144f5a9dcc8b40d21dbb2
0928 01:55:25.133810 (+    48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:25.709800 (+575990us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:25.926212 (+216412us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:26.078352 (+152140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8448,"tablet-delete.queue_time_us":114791}
I20260928 01:55:26.113528 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_cd70497bd2534ceb8f3d11a934050d49"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:26.114820 19903 raft_consensus.cc:493] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:26.115566 19903 raft_consensus.cc:515] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.120289 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457837143b0f4763a4b91bb25b580477" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:26.084048 19890 raft_consensus.cc:359] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.126741 19890 raft_consensus.cc:385] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:26.127028 19890 raft_consensus.cc:740] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:26.129158 19896 tablet_bootstrap.cc:492] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:26.129722 19896 ts_tablet_manager.cc:1403] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.004s
I20260928 01:55:26.133461 19896 raft_consensus.cc:359] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:26.134192 19896 raft_consensus.cc:385] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:26.134490 19896 raft_consensus.cc:740] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:26.135172 19896 consensus_queue.cc:260] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:26.127867 19890 consensus_queue.cc:260] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.141424 19620 raft_consensus.cc:2468] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:26.149070 20086 raft_consensus.cc:493] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:26.149809 20086 raft_consensus.cc:515] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.151445 19890 ts_tablet_manager.cc:1434] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.001s
I20260928 01:55:26.153213 20010 raft_consensus.cc:2243] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:26.156080 20100 raft_consensus.cc:493] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:26.156785 20100 raft_consensus.cc:515] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.161537 19412 leader_election.cc:304] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:26.164418 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:26.165299 20010 raft_consensus.cc:2272] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:26.165552 19620 raft_consensus.cc:2393] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:26.159788 20100 leader_election.cc:290] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:26.169658 20127 raft_consensus.cc:2804] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:26.170128 20127 raft_consensus.cc:493] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:26.170022 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:26.170464 20127 raft_consensus.cc:3060] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:26.171054 19767 raft_consensus.cc:2393] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:26.174755 20010 ts_tablet_manager.cc:1916] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:26.178550 19896 ts_tablet_manager.cc:1434] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.004s
I20260928 01:55:26.179661 20067 raft_consensus.cc:493] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:26.180339 20067 raft_consensus.cc:515] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.183409 19890 tablet_bootstrap.cc:492] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:26.187759 19896 tablet_bootstrap.cc:492] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:26.188899 19619 raft_consensus.cc:2468] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:26.192449 20029 tablet_bootstrap.cc:654] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:26.197536 19553 leader_election.cc:343] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: dfc63ccbe4e84373aabe3009cc3d2568
I20260928 01:55:26.201818 19890 tablet_bootstrap.cc:654] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:26.215628 20086 leader_election.cc:290] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:26.120656 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 (table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]) successfully deleted
W20260928 01:55:26.220728 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd70497bd2534ceb8f3d11a934050d49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:26.220937 19105 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 100310us
I20260928 01:55:26.204372 20067 leader_election.cc:290] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:26.216636 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f875e126f04415a108f778a76bb0f5" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:26.222852 19619 raft_consensus.cc:2393] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:26.227975 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet dfc63ccbe4e84373aabe3009cc3d2568 (table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]) successfully deleted
I20260928 01:55:26.239529 19890 tablet_bootstrap.cc:492] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:26.240026 19890 ts_tablet_manager.cc:1403] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.057s	user 0.003s	sys 0.012s
I20260928 01:55:26.243060 20029 tablet_bootstrap.cc:492] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:26.243949 20029 ts_tablet_manager.cc:1403] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.157s	user 0.009s	sys 0.014s
I20260928 01:55:26.244484 19890 raft_consensus.cc:359] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:26.245280 19890 raft_consensus.cc:385] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:26.245559 19890 raft_consensus.cc:740] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:26.247100 19890 consensus_queue.cc:260] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:26.258292 20029 raft_consensus.cc:359] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.259140 20086 consensus_queue.cc:1048] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:26.262521 19890 ts_tablet_manager.cc:1434] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260928 01:55:26.263688 19890 tablet_bootstrap.cc:492] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:26.259310 20029 raft_consensus.cc:385] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:26.265337 20029 raft_consensus.cc:740] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:26.266441 20029 consensus_queue.cc:260] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.270097 20010 ts_tablet_manager.cc:1929] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:26.272677 20010 log.cc:1199] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/a43cfb32bd0043049cbdb2faaf10409f
I20260928 01:55:26.273541 20010 ts_tablet_manager.cc:1950] T a43cfb32bd0043049cbdb2faaf10409f P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:26.275817 20010 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 56) took 1858 ms. Trace:
I20260928 01:55:26.276278 20010 rpcz_store.cc:276] 0928 01:55:24.417713 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:24.417857 (+   144us) service_pool.cc:224] Handling call
0928 01:55:26.036858 (+1619001us) ts_tablet_manager.cc:1151] Deleting tablet a43cfb32bd0043049cbdb2faaf10409f
0928 01:55:26.036914 (+    56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:26.164743 (+127829us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001301d4. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a211f5aa1 00007f0a21294b22 00007f0a216d555c 00007f0a2233ec3a 00007f0a2236f960 00007f0a22355e6d 00007f0a22355e19 00007f0a22355da9 00007f0a22355d71 00007f0a22354f9d 00000000005bd4e4
0928 01:55:26.224293 (+ 59550us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:26.269953 (+ 45660us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:26.275748 (+  5795us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1507,"spinlock_wait_cycles":260428672,"tablet-delete.queue_time_us":1618263}
I20260928 01:55:26.272172 20029 ts_tablet_manager.cc:1434] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.006s
I20260928 01:55:26.278311 20029 tablet_bootstrap.cc:492] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:26.284263 20117 raft_consensus.cc:493] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:26.284883 20117 raft_consensus.cc:515] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:26.285916 19890 tablet_bootstrap.cc:654] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:26.285923 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet a43cfb32bd0043049cbdb2faaf10409f (table default.Table_a47ad43bf23c4fa8b30c2aa4a8d66767 [id=63a3b65b060345c8811e85383a3d6dbe]) successfully deleted
I20260928 01:55:26.286978 20010 tablet_replica.cc:333] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:26.287783 20010 raft_consensus.cc:2243] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:26.288264 20010 raft_consensus.cc:2272] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:26.293232 20010 ts_tablet_manager.cc:1916] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:26.284897 20029 tablet_bootstrap.cc:654] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:26.307693 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:26.309782 19553 leader_election.cc:343] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:26.310514 20117 leader_election.cc:290] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:26.342336 20029 tablet_bootstrap.cc:492] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:26.343066 20029 ts_tablet_manager.cc:1403] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.009s
I20260928 01:55:26.345902 20029 raft_consensus.cc:359] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.346606 20029 raft_consensus.cc:385] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:26.346879 20029 raft_consensus.cc:740] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:26.359375 20010 ts_tablet_manager.cc:1929] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:26.359767 20010 log.cc:1199] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/e3bccc8b0045456fa7f16e984b3c5bf5
I20260928 01:55:26.367547 19903 leader_election.cc:290] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:26.369047 19412 leader_election.cc:304] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:26.370286 19412 leader_election.cc:304] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:26.372361 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc63ccbe4e84373aabe3009cc3d2568" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:26.373207 19476 raft_consensus.cc:2393] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:26.373198 20029 consensus_queue.cc:260] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.373986 20100 raft_consensus.cc:3060] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:26.377545 19112 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 103) took 1224 ms. Trace:
I20260928 01:55:26.382675 20029 ts_tablet_manager.cc:1434] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.004s
I20260928 01:55:26.377946 19112 rpcz_store.cc:276] 0928 01:55:25.153344 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.112915 (+959571us) service_pool.cc:224] Handling call
0928 01:55:26.221470 (+108555us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:26.224066 (+  2596us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:26.376793 (+152727us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:55:26.377150 (+   357us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:55:26.377475 (+   325us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:26.297844 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:26.298241 (+   397us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:26.298263 (+    22us) write_op.cc:435] Acquired schema lock
0928 01:55:26.298275 (+    12us) tablet.cc:662] Decoding operations
0928 01:55:26.298539 (+   264us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:26.298575 (+    36us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:26.298597 (+    22us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:26.300698 (+  2101us) tablet.cc:701] Row locks acquired
0928 01:55:26.300715 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:55:26.300901 (+   186us) write_op.cc:270] Start()
0928 01:55:26.326062 (+ 25161us) write_op.cc:276] Timestamp: P: 1790560526300839 usec, L: 0
0928 01:55:26.326085 (+    23us) op_driver.cc:348] REPLICATION: starting
0928 01:55:26.326620 (+   535us) log.cc:844] Serialized 432 byte log entry
0928 01:55:26.368146 (+ 41526us) op_driver.cc:464] REPLICATION: finished
0928 01:55:26.371840 (+  3694us) write_op.cc:301] APPLY: starting
0928 01:55:26.371905 (+    65us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:26.372026 (+   121us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:26.372128 (+   102us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:26.375890 (+  3762us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:26.376032 (+   142us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:55:26.376075 (+    43us) write_op.cc:312] APPLY: finished
0928 01:55:26.376312 (+   237us) log.cc:844] Serialized 28 byte log entry
0928 01:55:26.376469 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:26.376548 (+    79us) write_op.cc:454] Released schema lock
0928 01:55:26.376579 (+    31us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3318,"num_ops":2,"prepare.queue_time_us":128,"prepare.run_cpu_time_us":2480,"prepare.run_wall_time_us":29087,"raft.queue_time_us":1231,"raft.run_cpu_time_us":14,"raft.run_wall_time_us":14,"replication_time_us":41949}]]}
I20260928 01:55:26.383018 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457837143b0f4763a4b91bb25b580477" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:26.383671 19767 raft_consensus.cc:2468] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:26.386633 20127 raft_consensus.cc:515] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.388556 20010 ts_tablet_manager.cc:1950] T e3bccc8b0045456fa7f16e984b3c5bf5 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:26.383661 20029 tablet_bootstrap.cc:492] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:26.398908 20010 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 57) took 1671 ms. Trace:
I20260928 01:55:26.399392 20010 rpcz_store.cc:276] 0928 01:55:24.727362 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:24.730477 (+  3115us) service_pool.cc:224] Handling call
0928 01:55:26.286785 (+1556308us) ts_tablet_manager.cc:1151] Deleting tablet e3bccc8b0045456fa7f16e984b3c5bf5
0928 01:55:26.286846 (+    61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:26.313415 (+ 26569us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:26.359230 (+ 45815us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:26.398835 (+ 39605us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7942,"tablet-delete.queue_time_us":1555678}
I20260928 01:55:26.400828 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet e3bccc8b0045456fa7f16e984b3c5bf5 (table default.Table_1d40de09d743485db2f538534e097074 [id=c314147c39ca4ef695e61de1652cf804]) successfully deleted
I20260928 01:55:26.409807 19556 leader_election.cc:304] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:26.411531 20010 tablet_replica.cc:333] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:26.411404 20067 raft_consensus.cc:3060] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:26.413070 20117 consensus_queue.cc:1048] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:26.414788 20010 raft_consensus.cc:2243] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:26.415898 20010 raft_consensus.cc:2272] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:26.404135 19113 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 05f875e126f04415a108f778a76bb0f5 (table default.Table_a4827d0104f94435be09b3173ff52905 [id=10dc4468b0ce4b2c87cecd4c66cc5300]). Expected version 1 got 0
I20260928 01:55:26.423331 20010 ts_tablet_manager.cc:1916] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:26.424443 19113 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_1b5bf73ffb5545d29ca961fb3c2108a7 [id=061fd785787a42ad89ff507723fe0cba]). Expected version 1 got 0
I20260928 01:55:26.388820 19903 raft_consensus.cc:2804] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:26.390298 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f875e126f04415a108f778a76bb0f5" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:26.416386 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:26.428785 19473 raft_consensus.cc:2468] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
W20260928 01:55:26.433940 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 219b7dad56a64a3b813344e0ed9bdbdc consensus state has no leader
I20260928 01:55:26.434813 19703 leader_election.cc:304] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:26.436134 20124 raft_consensus.cc:3060] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:26.442059 19556 leader_election.cc:304] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:26.430598 20029 tablet_bootstrap.cc:654] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:26.432808 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457837143b0f4763a4b91bb25b580477" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:26.444507 20059 raft_consensus.cc:2804] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:26.445039 20059 raft_consensus.cc:493] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:26.445216 19766 raft_consensus.cc:3060] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:26.445555 20059 raft_consensus.cc:3060] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:26.447814 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457837143b0f4763a4b91bb25b580477" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:26.449631 19619 raft_consensus.cc:3060] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:26.458058 19766 raft_consensus.cc:2468] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:26.477198 19896 tablet_bootstrap.cc:700] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614: Time spent opening tablet: real 0.122s	user 0.001s	sys 0.001s
I20260928 01:55:26.491698 19409 leader_election.cc:304] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:26.492815 19896 tablet_bootstrap.cc:654] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:26.495460 20137 raft_consensus.cc:2804] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:26.496295 20137 raft_consensus.cc:697] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:26.497609 19979 consensus_queue.cc:1048] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:26.497637 20137 consensus_queue.cc:237] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.514424 20124 raft_consensus.cc:2749] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:26.505676 20127 leader_election.cc:290] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:26.510762 20100 raft_consensus.cc:2749] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:26.537859 19903 raft_consensus.cc:697] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:26.539563 19903 consensus_queue.cc:237] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:26.552187 19553 consensus_peers.cc:597] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a43cfb32bd0043049cbdb2faaf10409f. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:26.531028 20029 tablet_bootstrap.cc:492] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:26.546149 20010 ts_tablet_manager.cc:1929] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:26.563674 20010 log.cc:1199] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/a6fb7f3e609144f5a9dcc8b40d21dbb2
I20260928 01:55:26.563737 20029 ts_tablet_manager.cc:1403] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.180s	user 0.010s	sys 0.009s
I20260928 01:55:26.564590 20010 ts_tablet_manager.cc:1950] T a6fb7f3e609144f5a9dcc8b40d21dbb2 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:26.567431 20010 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 58) took 1663 ms. Trace:
I20260928 01:55:26.567874 20010 rpcz_store.cc:276] 0928 01:55:24.904495 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:24.905521 (+  1026us) service_pool.cc:224] Handling call
0928 01:55:26.411348 (+1505827us) ts_tablet_manager.cc:1151] Deleting tablet a6fb7f3e609144f5a9dcc8b40d21dbb2
0928 01:55:26.411399 (+    51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:26.510656 (+ 99257us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:26.536120 (+ 25464us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:26.567363 (+ 31243us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1505185}
I20260928 01:55:26.567971 20029 raft_consensus.cc:359] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.569214 20029 raft_consensus.cc:385] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:26.569500 20029 raft_consensus.cc:740] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:26.569572 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 (table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]) successfully deleted
I20260928 01:55:26.570161 20029 consensus_queue.cc:260] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:26.572144 20029 ts_tablet_manager.cc:1434] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260928 01:55:26.573114 20029 tablet_bootstrap.cc:492] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:26.573756 20067 raft_consensus.cc:2749] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:26.577907 20059 raft_consensus.cc:515] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:26.515174 19450 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 57) took 1045 ms. Trace:
I20260928 01:55:26.589669 19450 rpcz_store.cc:276] 0928 01:55:25.469643 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:25.470476 (+   833us) service_pool.cc:224] Handling call
0928 01:55:25.479485 (+  9009us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:25.479613 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:26.392056 (+912443us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:26.514129 (+122073us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:26.515072 (+   943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:26.598744 19112 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 05f875e126f04415a108f778a76bb0f5 (table default.Table_a4827d0104f94435be09b3173ff52905 [id=10dc4468b0ce4b2c87cecd4c66cc5300]). Expected version 1 got 0
I20260928 01:55:26.600183 19112 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_1b5bf73ffb5545d29ca961fb3c2108a7 [id=061fd785787a42ad89ff507723fe0cba]). Expected version 1 got 0
I20260928 01:55:26.601428 19890 tablet_bootstrap.cc:492] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:26.601889 19890 ts_tablet_manager.cc:1403] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.338s	user 0.008s	sys 0.039s
I20260928 01:55:26.602376 19109 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 0e902da355b641868c207fc26578b739
I20260928 01:55:26.602799 20029 tablet_bootstrap.cc:654] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:26.584144 20136 consensus_queue.cc:1048] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:26.605360 19890 raft_consensus.cc:359] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:26.606004 19890 raft_consensus.cc:385] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:26.606248 19890 raft_consensus.cc:740] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:26.606992 19890 consensus_queue.cc:260] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:26.609150 19890 ts_tablet_manager.cc:1434] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260928 01:55:26.608800 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:26.609577 19474 raft_consensus.cc:3060] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:26.610080 19890 tablet_bootstrap.cc:492] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:26.631464 19109 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 75) took 3434 ms. Trace:
I20260928 01:55:26.631736 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e902da355b641868c207fc26578b739 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:26.638978 19890 tablet_bootstrap.cc:654] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:26.640570 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e902da355b641868c207fc26578b739 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:26.641896 20010 tablet_replica.cc:333] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:26.642778 20010 raft_consensus.cc:2243] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:26.643849 20010 raft_consensus.cc:2272] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:26.640429 19450 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e902da355b641868c207fc26578b739 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:26.645956 20010 ts_tablet_manager.cc:1916] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:26.646124 19596 tablet_service.cc:1558] Processing DeleteTablet for tablet 952df055998942f89baabb341e204f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:26.648017 19596 tablet_service.cc:1558] Processing DeleteTablet for tablet c8bbb627a14a477c9362d2b250f27c1e with delete_type TABLET_DATA_DELETED (replaced by tablet 90d40050f85a4d6c90a4ce35cf15d134) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:26.651746 19596 tablet_service.cc:1558] Processing DeleteTablet for tablet e3bccc8b0045456fa7f16e984b3c5bf5 with delete_type TABLET_DATA_DELETED (replaced by tablet f3741aec215343468b2d7bc952da03c8) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:26.656291 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 90b3c947794c48daaacc299a7d2dd4a9) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:26.657464 19745 tablet_service.cc:1558] Processing DeleteTablet for tablet dfc63ccbe4e84373aabe3009cc3d2568 with delete_type TABLET_DATA_DELETED (replaced by tablet f7b78eb499d6418f8877bf3b59bbbec2) from {username='slave'} at 127.0.0.1:44964
W20260928 01:55:26.658846 19118 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 12) took 1685 ms (client timeout 1000 ms). Trace:
I20260928 01:55:26.665596 19745 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dd4743c49314e8b8d86e1c6e553b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 33e1cc46939b4932a344b81c3bc8ca82) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:26.666378 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dd4743c49314e8b8d86e1c6e553b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 33e1cc46939b4932a344b81c3bc8ca82) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:26.667196 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet c8bbb627a14a477c9362d2b250f27c1e with delete_type TABLET_DATA_DELETED (replaced by tablet 90d40050f85a4d6c90a4ce35cf15d134) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:26.668649 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dd4743c49314e8b8d86e1c6e553b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 33e1cc46939b4932a344b81c3bc8ca82) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:26.674841 19596 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dd4743c49314e8b8d86e1c6e553b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 33e1cc46939b4932a344b81c3bc8ca82) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:26.678967 19474 raft_consensus.cc:2468] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
W20260928 01:55:26.677435 19118 rpcz_store.cc:269] 0928 01:55:24.973248 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:25.019026 (+ 45778us) service_pool.cc:224] Handling call
0928 01:55:25.031089 (+ 12063us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:26.658761 (+1627672us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:25.600499 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:25.601029 (+   530us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:25.601066 (+    37us) write_op.cc:435] Acquired schema lock
0928 01:55:25.601078 (+    12us) tablet.cc:662] Decoding operations
0928 01:55:25.620767 (+ 19689us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:25.620812 (+    45us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:25.620837 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:25.621060 (+   223us) tablet.cc:701] Row locks acquired
0928 01:55:25.621075 (+    15us) write_op.cc:260] PREPARE: finished
0928 01:55:25.621244 (+   169us) write_op.cc:270] Start()
0928 01:55:25.621338 (+    94us) write_op.cc:276] Timestamp: P: 1790560525621173 usec, L: 0
0928 01:55:25.621353 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:25.621986 (+   633us) log.cc:844] Serialized 529 byte log entry
0928 01:55:25.814714 (+192728us) op_driver.cc:464] REPLICATION: finished
0928 01:55:25.815069 (+   355us) write_op.cc:301] APPLY: starting
0928 01:55:25.815132 (+    63us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:25.815285 (+   153us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:25.815427 (+   142us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:25.815945 (+   518us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:25.816167 (+   222us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:25.816381 (+   214us) write_op.cc:312] APPLY: finished
0928 01:55:25.816720 (+   339us) log.cc:844] Serialized 22 byte log entry
0928 01:55:25.817590 (+   870us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:25.817692 (+   102us) write_op.cc:454] Released schema lock
0928 01:55:25.817743 (+    51us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:25.818296 (+   553us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:25.818336 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"spinlock_wait_cycles":18183040,"child_traces":[["op",{"apply.queue_time_us":178,"apply.run_cpu_time_us":2218,"apply.run_wall_time_us":3134,"num_ops":1,"prepare.queue_time_us":197444,"prepare.run_cpu_time_us":2660,"prepare.run_wall_time_us":23674,"replication_time_us":193218}]]}
W20260928 01:55:26.662901 19115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 11) took 2819 ms (client timeout 1000 ms). Trace:
I20260928 01:55:26.681209 19556 leader_election.cc:304] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:26.682583 20067 raft_consensus.cc:2804] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 01:55:26.682195 19115 rpcz_store.cc:269] 0928 01:55:23.843158 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:23.843317 (+   159us) service_pool.cc:224] Handling call
0928 01:55:23.931333 (+ 88016us) spinlock_profiling.cc:243] Waited 85.8 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:26.662312 (+2730979us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":197244800}
I20260928 01:55:26.684515 20067 raft_consensus.cc:697] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:26.686216 20067 consensus_queue.cc:237] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:26.668037 19111 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 28) took 2462 ms (client timeout 1000 ms). Trace:
W20260928 01:55:26.688549 19111 rpcz_store.cc:269] 0928 01:55:24.205573 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:24.410099 (+204526us) service_pool.cc:224] Handling call
0928 01:55:24.481870 (+ 71771us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:26.667668 (+2185798us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":161446272}
I20260928 01:55:26.691118 19111 master_service.cc:960] ReplaceTablet: received request to replace tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:26.693420 19111 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51212 (request call id 104) took 1428 ms. Trace:
I20260928 01:55:26.694031 19111 rpcz_store.cc:276] 0928 01:55:25.264712 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.690854 (+1426142us) service_pool.cc:224] Handling call
0928 01:55:26.693302 (+  2448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:26.697077 19110 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet ad62475da6e74fb4971837a018e77c1c
I20260928 01:55:26.699287 20010 ts_tablet_manager.cc:1929] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:26.699676 20010 log.cc:1199] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/0e902da355b641868c207fc26578b739
I20260928 01:55:26.699743 19110 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 95) took 2076 ms. Trace:
I20260928 01:55:26.701697 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet ad62475da6e74fb4971837a018e77c1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:24 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:26.586162 19619 raft_consensus.cc:2468] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:26.709632 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet ad62475da6e74fb4971837a018e77c1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:24 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:26.714511 20010 ts_tablet_manager.cc:1950] T 0e902da355b641868c207fc26578b739 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:26.715581 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet a43cfb32bd0043049cbdb2faaf10409f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:26.717651 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 0e902da355b641868c207fc26578b739 (table default.Table_a2a87b5badd741caa9c92c3a137b0a2d [id=136676f3aa8a473699bc8c172b81929a]) successfully deleted
W20260928 01:55:26.728909 19117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 22) took 2753 ms (client timeout 1000 ms). Trace:
W20260928 01:55:26.729416 19117 rpcz_store.cc:269] 0928 01:55:23.975286 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:24.071885 (+ 96599us) service_pool.cc:224] Handling call
0928 01:55:24.136053 (+ 64168us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:26.650323 (+2514270us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b4c00002f40. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fb3abfe0 00007f19fb3bcfc9 00007f19fb3bd6af 00007f19fb380e9b 00007f19fb3af4fc 00007f19fb3af9be 00007f19fcd46c1b 00007f19ff511391 00007f19ff4b7ba0 00007f19ff4bebbb 00007f19ff5c68de
0928 01:55:26.728820 (+ 78497us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15651,"reported_tablets":10,"spinlock_wait_cycles":188110080}
I20260928 01:55:26.731621 19117 master_service.cc:960] ReplaceTablet: received request to replace tablet e3bccc8b0045456fa7f16e984b3c5bf5 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:26.732879 19117 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51212 (request call id 105) took 1467 ms. Trace:
I20260928 01:55:26.736706 19596 tablet_service.cc:1558] Processing DeleteTablet for tablet a43cfb32bd0043049cbdb2faaf10409f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:26.738118 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet ad62475da6e74fb4971837a018e77c1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:24 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:26.740227 19596 tablet_service.cc:1558] Processing DeleteTablet for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 90b3c947794c48daaacc299a7d2dd4a9) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:26.742615 19117 rpcz_store.cc:276] 0928 01:55:25.265018 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.731437 (+1466419us) service_pool.cc:224] Handling call
0928 01:55:26.732813 (+  1376us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 01:55:26.672081 19116 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 21) took 3730 ms (client timeout 1000 ms). Trace:
W20260928 01:55:26.745757 19116 rpcz_store.cc:269] 0928 01:55:22.940766 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:22.950088 (+  9322us) service_pool.cc:224] Handling call
0928 01:55:23.015637 (+ 65549us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:26.671515 (+3655878us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":7,"spinlock_wait_cycles":146413440}
I20260928 01:55:26.700183 19110 rpcz_store.cc:276] 0928 01:55:24.623533 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:24.665721 (+ 42188us) service_pool.cc:224] Handling call
0928 01:55:24.683233 (+ 17512us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c7876 00007f19fd176b34 00007f19fd176ac2 00007f19fd1769f1 00007f19fd17696c 00007f19fd175c22 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:24.691194 (+  7961us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:24.692555 (+  1361us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:55:24.692734 (+   179us) catalog_manager.cc:2863] Locking tablets
0928 01:55:25.321602 (+628868us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:55:25.744750 (+423148us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:55:25.745644 (+   894us) catalog_manager.cc:2911] Committing in-memory state
0928 01:55:26.696943 (+951299us) catalog_manager.cc:2915] Aborting table tasks
0928 01:55:26.699653 (+  2710us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:25.502224 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:25.502986 (+   762us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:25.503038 (+    52us) write_op.cc:435] Acquired schema lock
0928 01:55:25.555497 (+ 52459us) tablet.cc:662] Decoding operations
0928 01:55:25.556295 (+   798us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:25.556343 (+    48us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:25.556367 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:25.557118 (+   751us) tablet.cc:701] Row locks acquired
0928 01:55:25.557154 (+    36us) write_op.cc:260] PREPARE: finished
0928 01:55:25.557306 (+   152us) write_op.cc:270] Start()
0928 01:55:25.557400 (+    94us) write_op.cc:276] Timestamp: P: 1790560525557239 usec, L: 0
0928 01:55:25.557415 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:25.558473 (+  1058us) log.cc:844] Serialized 727 byte log entry
0928 01:55:25.738496 (+180023us) op_driver.cc:464] REPLICATION: finished
0928 01:55:25.739524 (+  1028us) write_op.cc:301] APPLY: starting
0928 01:55:25.739862 (+   338us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:25.740392 (+   530us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:25.740861 (+   469us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:25.741764 (+   903us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:25.742368 (+   604us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:25.742671 (+   303us) write_op.cc:312] APPLY: finished
0928 01:55:25.743118 (+   447us) log.cc:844] Serialized 28 byte log entry
0928 01:55:25.743373 (+   255us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:25.743467 (+    94us) write_op.cc:454] Released schema lock
0928 01:55:25.743538 (+    71us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:25.743891 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:25.743937 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":32017792,"child_traces":[["op",{"apply.queue_time_us":489,"apply.run_cpu_time_us":4521,"apply.run_wall_time_us":4520,"num_ops":2,"prepare.queue_time_us":153877,"prepare.run_cpu_time_us":4366,"prepare.run_wall_time_us":56704,"replication_time_us":180774}]]}
I20260928 01:55:26.749722 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_882a0296b9ba49ef94e01ab6602cfa6e"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:26.752761 19116 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_1b5bf73ffb5545d29ca961fb3c2108a7" } new_table_name: "default.Table_9f072eb1b00c47a4a86bf2607864b4d4" modify_external_catalogs: true
I20260928 01:55:26.735033 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_15cf8dad1ba94211b8e90f83f991eb22"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:26.735832 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 because the tablet was not found. No further retry: Not found: Tablet not found: a6fb7f3e609144f5a9dcc8b40d21dbb2
I20260928 01:55:26.757004 20010 tablet_replica.cc:333] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:26.756770 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet dfc63ccbe4e84373aabe3009cc3d2568 with delete_type TABLET_DATA_DELETED (replaced by tablet f7b78eb499d6418f8877bf3b59bbbec2) from {username='slave'} at 127.0.0.1:47670
W20260928 01:55:26.758179 19114 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 23) took 1773 ms (client timeout 1000 ms). Trace:
I20260928 01:55:26.736326 19111 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_a4827d0104f94435be09b3173ff52905" } new_table_name: "default.Table_2c6a423a3158495a98d244242381a423" modify_external_catalogs: true
I20260928 01:55:26.632066 19109 rpcz_store.cc:276] 0928 01:55:23.197505 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:23.197644 (+   139us) service_pool.cc:224] Handling call
0928 01:55:23.216864 (+ 19220us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c7876 00007f19fd176b34 00007f19fd176ac2 00007f19fd1769f1 00007f19fd17696c 00007f19fd175c22 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:23.218371 (+  1507us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:23.219156 (+   785us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:55:23.219365 (+   209us) catalog_manager.cc:2863] Locking tablets
0928 01:55:23.761070 (+541705us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:55:24.151400 (+390330us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:55:24.151724 (+   324us) catalog_manager.cc:2911] Committing in-memory state
0928 01:55:26.601798 (+2450074us) catalog_manager.cc:2915] Aborting table tasks
0928 01:55:26.631357 (+ 29559us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:23.863210 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:23.863600 (+   390us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:23.863625 (+    25us) write_op.cc:435] Acquired schema lock
0928 01:55:23.863638 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:23.863945 (+   307us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:23.863981 (+    36us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:23.864004 (+    23us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:23.864337 (+   333us) tablet.cc:701] Row locks acquired
0928 01:55:23.864351 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:23.864468 (+   117us) write_op.cc:270] Start()
0928 01:55:23.864551 (+    83us) write_op.cc:276] Timestamp: P: 1790560523864409 usec, L: 0
0928 01:55:23.864566 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:23.865040 (+   474us) log.cc:844] Serialized 758 byte log entry
0928 01:55:24.149325 (+284285us) op_driver.cc:464] REPLICATION: finished
0928 01:55:24.149606 (+   281us) write_op.cc:301] APPLY: starting
0928 01:55:24.149691 (+    85us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:24.149835 (+   144us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:24.149946 (+   111us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:24.150269 (+   323us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:24.150422 (+   153us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:24.150469 (+    47us) write_op.cc:312] APPLY: finished
0928 01:55:24.150788 (+   319us) log.cc:844] Serialized 28 byte log entry
0928 01:55:24.150966 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:24.151055 (+    89us) write_op.cc:454] Released schema lock
0928 01:55:24.151097 (+    42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":41248640,"child_traces":[["op",{"apply.queue_time_us":96,"apply.run_cpu_time_us":1678,"apply.run_wall_time_us":10606,"num_ops":2,"prepare.queue_time_us":99959,"prepare.run_cpu_time_us":2143,"prepare.run_wall_time_us":3572,"raft.queue_time_us":84,"raft.run_cpu_time_us":11,"raft.run_wall_time_us":12,"replication_time_us":284592}]]}
I20260928 01:55:26.759483 20010 raft_consensus.cc:2243] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:26.759971 20010 raft_consensus.cc:2272] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:26.759704 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:55:26.761633 19553 leader_election.cc:343] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:26.760465 20059 leader_election.cc:290] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:26.764092 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet 952df055998942f89baabb341e204f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:26.771162 20010 ts_tablet_manager.cc:1916] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:26.770361 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_527b8b35bcda4e179459c8909e6ff924"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:26.778501 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_9aeb2b485111496ea1fed85fd4c55531"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:26.781919 19890 tablet_bootstrap.cc:492] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:26.782358 19890 ts_tablet_manager.cc:1403] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.172s	user 0.010s	sys 0.014s
I20260928 01:55:26.782785 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet c8bbb627a14a477c9362d2b250f27c1e with delete_type TABLET_DATA_DELETED (replaced by tablet 90d40050f85a4d6c90a4ce35cf15d134) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:26.786589 19890 raft_consensus.cc:359] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:26.787518 19890 raft_consensus.cc:385] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:26.787956 19890 raft_consensus.cc:740] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:26.788923 19890 consensus_queue.cc:260] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:26.755939 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet dfc63ccbe4e84373aabe3009cc3d2568 because the tablet was not found. No further retry: Not found: Tablet not found: dfc63ccbe4e84373aabe3009cc3d2568
I20260928 01:55:26.791491 19890 ts_tablet_manager.cc:1434] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
W20260928 01:55:26.791647 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 7dd4743c49314e8b8d86e1c6e553b13e because the tablet was not found. No further retry: Not found: Tablet not found: 7dd4743c49314e8b8d86e1c6e553b13e
W20260928 01:55:26.792340 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet c8bbb627a14a477c9362d2b250f27c1e because the tablet was not found. No further retry: Not found: Tablet not found: c8bbb627a14a477c9362d2b250f27c1e
W20260928 01:55:26.792959 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 7dd4743c49314e8b8d86e1c6e553b13e because the tablet was not found. No further retry: Not found: Tablet not found: 7dd4743c49314e8b8d86e1c6e553b13e
W20260928 01:55:26.795899 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15cf8dad1ba94211b8e90f83f991eb22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:26.802866 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 7bfcdfe218414396824a8f3af4d673ff (DEFAULT_TABLE table=default.Table_ef217ae2f1514ce99c1f8993333e2ec6 [id=2a9bea4b8e2a4df68e6bc995f08258b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:26.804847 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bfcdfe218414396824a8f3af4d673ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:26.792717 20147 tablet_replica.cc:333] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:26.804425 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 7bfcdfe218414396824a8f3af4d673ff (DEFAULT_TABLE table=default.Table_ef217ae2f1514ce99c1f8993333e2ec6 [id=2a9bea4b8e2a4df68e6bc995f08258b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:26.820863 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bfcdfe218414396824a8f3af4d673ff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:26.824482 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_882a0296b9ba49ef94e01ab6602cfa6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:26.824834 20029 tablet_bootstrap.cc:492] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:26.825281 20029 ts_tablet_manager.cc:1403] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.252s	user 0.010s	sys 0.023s
W20260928 01:55:26.830116 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9aeb2b485111496ea1fed85fd4c55531 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:26.758742 19114 rpcz_store.cc:269] 0928 01:55:24.984538 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:25.048618 (+ 64080us) service_pool.cc:224] Handling call
0928 01:55:25.091578 (+ 42960us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:26.758089 (+1666511us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:26.240370 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:26.240788 (+   418us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:26.240813 (+    25us) write_op.cc:435] Acquired schema lock
0928 01:55:26.240826 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:26.241113 (+   287us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:26.241167 (+    54us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:26.241198 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:26.241382 (+   184us) tablet.cc:701] Row locks acquired
0928 01:55:26.241397 (+    15us) write_op.cc:260] PREPARE: finished
0928 01:55:26.241529 (+   132us) write_op.cc:270] Start()
0928 01:55:26.241621 (+    92us) write_op.cc:276] Timestamp: P: 1790560526241477 usec, L: 0
0928 01:55:26.241643 (+    22us) op_driver.cc:348] REPLICATION: starting
0928 01:55:26.242256 (+   613us) log.cc:844] Serialized 529 byte log entry
0928 01:55:26.351128 (+108872us) op_driver.cc:464] REPLICATION: finished
0928 01:55:26.351730 (+   602us) write_op.cc:301] APPLY: starting
0928 01:55:26.351791 (+    61us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:26.351893 (+   102us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:26.352002 (+   109us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:26.352190 (+   188us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:26.352336 (+   146us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:26.352378 (+    42us) write_op.cc:312] APPLY: finished
0928 01:55:26.352558 (+   180us) log.cc:844] Serialized 22 byte log entry
0928 01:55:26.352707 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:26.352781 (+    74us) write_op.cc:454] Released schema lock
0928 01:55:26.352811 (+    30us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:26.353041 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:26.353065 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31425,"reported_tablets":14,"spinlock_wait_cycles":92529024,"child_traces":[["op",{"apply.queue_time_us":404,"apply.run_cpu_time_us":1287,"apply.run_wall_time_us":1286,"num_ops":1,"prepare.queue_time_us":188,"prepare.run_cpu_time_us":2115,"prepare.run_wall_time_us":2114,"replication_time_us":109377}]]}
I20260928 01:55:26.839092 20029 raft_consensus.cc:359] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:26.839852 20029 raft_consensus.cc:385] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:26.840137 20029 raft_consensus.cc:740] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:26.840862 20029 consensus_queue.cc:260] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:26.845503 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_527b8b35bcda4e179459c8909e6ff924 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:26.849077 20147 raft_consensus.cc:2243] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:26.850176 20147 raft_consensus.cc:2272] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:26.853392 20147 ts_tablet_manager.cc:1916] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:26.859443 19596 tablet_service.cc:1511] Processing CreateTablet for tablet 78a71904514a488083426f5fe07d12cd (DEFAULT_TABLE table=default.Table_d6ec5f8939f84de7994041a54bdbe36b [id=ab54f23a53744160a4b2437b2b513937]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:26.860749 20029 ts_tablet_manager.cc:1434] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260928 01:55:26.861402 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a71904514a488083426f5fe07d12cd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:26.841355 19113 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 29) took 1631 ms (client timeout 1000 ms). Trace:
I20260928 01:55:26.866463 20029 tablet_bootstrap.cc:492] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:55:26.866055 19113 rpcz_store.cc:269] 0928 01:55:25.209641 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:25.377055 (+167414us) service_pool.cc:224] Handling call
0928 01:55:25.486461 (+109406us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:26.841247 (+1354786us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":14,"spinlock_wait_cycles":230404352}
I20260928 01:55:26.868076 19890 tablet_bootstrap.cc:492] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:26.887526 20059 raft_consensus.cc:493] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:26.888461 20059 raft_consensus.cc:515] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:26.894295 20059 leader_election.cc:290] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:26.891096 20010 ts_tablet_manager.cc:1929] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:26.904956 20010 log.cc:1199] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/ad62475da6e74fb4971837a018e77c1c
I20260928 01:55:26.907025 20010 ts_tablet_manager.cc:1950] T ad62475da6e74fb4971837a018e77c1c P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:26.933921 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet e3bccc8b0045456fa7f16e984b3c5bf5 with delete_type TABLET_DATA_DELETED (replaced by tablet f3741aec215343468b2d7bc952da03c8) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:26.933199 20137 consensus_queue.cc:1048] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260928 01:55:26.954612 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa1e9b7119d46a2ba2652a893877c8c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:26.956959 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 5d9b93f45ccf44e785b00849e49c8294 (DEFAULT_TABLE table=default.Table_63f36a8d22184eac8a38565457441d09 [id=102958783e204ded94a67a96b0dec09b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:26.958055 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9b93f45ccf44e785b00849e49c8294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:26.969336 19114 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_2720a066cdca41b4998342e7fb48de23" } modify_external_catalogs: true
I20260928 01:55:26.970098 19114 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_2720a066cdca41b4998342e7fb48de23" } modify_external_catalogs: true
W20260928 01:55:26.978271 19556 leader_election.cc:343] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:26.981720 20148 tablet_replica.cc:333] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:26.983273 20148 raft_consensus.cc:2243] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:26.984023 20148 raft_consensus.cc:2272] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:26.989704 19903 raft_consensus.cc:493] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:26.990494 20148 ts_tablet_manager.cc:1916] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:26.990425 19903 raft_consensus.cc:515] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:26.997541 19896 tablet_bootstrap.cc:492] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:26.998135 19896 ts_tablet_manager.cc:1403] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.811s	user 0.025s	sys 0.010s
I20260928 01:55:26.998781 19903 leader_election.cc:290] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:27.003631 19896 raft_consensus.cc:359] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.006601 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 90b3c947794c48daaacc299a7d2dd4a9) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:27.013574 19896 raft_consensus.cc:385] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:27.013942 19896 raft_consensus.cc:740] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:27.014607 19896 consensus_queue.cc:260] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.007133 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 7bfcdfe218414396824a8f3af4d673ff (DEFAULT_TABLE table=default.Table_ef217ae2f1514ce99c1f8993333e2ec6 [id=2a9bea4b8e2a4df68e6bc995f08258b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.017051 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bfcdfe218414396824a8f3af4d673ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.018733 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 78a71904514a488083426f5fe07d12cd (DEFAULT_TABLE table=default.Table_d6ec5f8939f84de7994041a54bdbe36b [id=ab54f23a53744160a4b2437b2b513937]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.019901 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a71904514a488083426f5fe07d12cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.004712 19450 tablet_service.cc:1558] Processing DeleteTablet for tablet dfc63ccbe4e84373aabe3009cc3d2568 with delete_type TABLET_DATA_DELETED (replaced by tablet f7b78eb499d6418f8877bf3b59bbbec2) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:26.989495 19890 tablet_bootstrap.cc:654] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:27.033519 20147 ts_tablet_manager.cc:1929] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:27.044219 20147 log.cc:1199] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/0e902da355b641868c207fc26578b739
I20260928 01:55:27.045745 20147 ts_tablet_manager.cc:1950] T 0e902da355b641868c207fc26578b739 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:27.048038 19896 ts_tablet_manager.cc:1434] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260928 01:55:27.049070 19896 tablet_bootstrap.cc:492] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:27.053906 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:27.054319 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 0e902da355b641868c207fc26578b739 (table default.Table_a2a87b5badd741caa9c92c3a137b0a2d [id=136676f3aa8a473699bc8c172b81929a]) successfully deleted
I20260928 01:55:27.054543 19620 raft_consensus.cc:2468] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:27.064986 19896 tablet_bootstrap.cc:654] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:27.052048 20147 tablet_replica.cc:333] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:27.066565 19412 leader_election.cc:304] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:27.069137 20147 raft_consensus.cc:2243] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:27.072679 20147 raft_consensus.cc:2272] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 01:55:27.075148 20155 log.cc:927] Time spent T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260928 01:55:27.084807 19115 catalog_manager.cc:5838] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:55:27.086303 19115 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_1b5bf73ffb5545d29ca961fb3c2108a7 [id=061fd785787a42ad89ff507723fe0cba]). Expected version 1 got 0
I20260928 01:55:27.088194 19890 tablet_bootstrap.cc:492] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:27.088990 19890 ts_tablet_manager.cc:1403] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.255s	user 0.015s	sys 0.000s
I20260928 01:55:27.092739 19890 raft_consensus.cc:359] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.094882 19890 raft_consensus.cc:385] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:27.095611 19890 raft_consensus.cc:740] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
W20260928 01:55:27.097126 19111 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05f875e126f04415a108f778a76bb0f5 consensus state has no leader
I20260928 01:55:27.096673 19890 consensus_queue.cc:260] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.099392 19890 ts_tablet_manager.cc:1434] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260928 01:55:27.100471 19890 tablet_bootstrap.cc:492] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:27.100848 19111 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51212 (request call id 107) took 1710 ms. Trace:
I20260928 01:55:27.101197 19111 rpcz_store.cc:276] 0928 01:55:25.390253 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.735756 (+1345503us) service_pool.cc:224] Handling call
0928 01:55:26.762752 (+ 26996us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:26.776008 (+ 13256us) catalog_manager.cc:3764] Apply alter schema
0928 01:55:26.842257 (+ 66249us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 01:55:26.842949 (+   692us) catalog_manager.cc:3954] Updating metadata on disk
0928 01:55:27.096454 (+253505us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 01:55:27.100760 (+  4306us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:26.904830 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:26.905219 (+   389us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:26.905243 (+    24us) write_op.cc:435] Acquired schema lock
0928 01:55:26.905256 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:26.907702 (+  2446us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:26.907744 (+    42us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:26.907767 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:26.907936 (+   169us) tablet.cc:701] Row locks acquired
0928 01:55:26.907950 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:26.908075 (+   125us) write_op.cc:270] Start()
0928 01:55:26.908160 (+    85us) write_op.cc:276] Timestamp: P: 1790560526907973 usec, L: 0
0928 01:55:26.908176 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:55:26.933908 (+ 25732us) log.cc:844] Serialized 404 byte log entry
0928 01:55:27.090466 (+156558us) op_driver.cc:464] REPLICATION: finished
0928 01:55:27.093985 (+  3519us) write_op.cc:301] APPLY: starting
0928 01:55:27.094045 (+    60us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:27.094149 (+   104us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:27.094240 (+    91us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:27.094415 (+   175us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:27.094548 (+   133us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:27.094591 (+    43us) write_op.cc:312] APPLY: finished
0928 01:55:27.094789 (+   198us) log.cc:844] Serialized 22 byte log entry
0928 01:55:27.094956 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:27.095016 (+    60us) write_op.cc:454] Released schema lock
0928 01:55:27.095049 (+    33us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:27.095280 (+   231us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:27.095304 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3347,"apply.run_cpu_time_us":1259,"apply.run_wall_time_us":1259,"mutex_wait_us":54250,"num_ops":1,"prepare.queue_time_us":59964,"prepare.run_cpu_time_us":4365,"prepare.run_wall_time_us":52209,"raft.queue_time_us":3573,"raft.run_cpu_time_us":16,"raft.run_wall_time_us":17,"replication_time_us":182176}]]}
I20260928 01:55:27.108510 19596 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (DEFAULT_TABLE table=default.Table_2fbaba56e6074d2caa5b8a3603cc5ff9 [id=91b9d48a31cc4cd583ffb7e2cc34faca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.110302 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc9a1c5be7c4e519f1415ba70397f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.110301 19118 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 106) took 1840 ms. Trace:
I20260928 01:55:27.110648 19118 rpcz_store.cc:276] 0928 01:55:25.270421 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.734407 (+1463986us) service_pool.cc:224] Handling call
0928 01:55:26.796529 (+ 62122us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:26.798099 (+  1570us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:27.109467 (+311368us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:55:27.109959 (+   492us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:55:27.110237 (+   278us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:26.957186 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:26.957666 (+   480us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:26.957694 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:55:26.957707 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:26.958042 (+   335us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:26.958080 (+    38us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:26.958104 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:26.958368 (+   264us) tablet.cc:701] Row locks acquired
0928 01:55:26.958382 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:26.958538 (+   156us) write_op.cc:270] Start()
0928 01:55:26.958629 (+    91us) write_op.cc:276] Timestamp: P: 1790560526958430 usec, L: 0
0928 01:55:26.958646 (+    17us) op_driver.cc:348] REPLICATION: starting
0928 01:55:26.959212 (+   566us) log.cc:844] Serialized 432 byte log entry
0928 01:55:27.093448 (+134236us) op_driver.cc:464] REPLICATION: finished
0928 01:55:27.095540 (+  2092us) write_op.cc:301] APPLY: starting
0928 01:55:27.095588 (+    48us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:27.095689 (+   101us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:27.095796 (+   107us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:27.096192 (+   396us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:27.106952 (+ 10760us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:55:27.106999 (+    47us) write_op.cc:312] APPLY: finished
0928 01:55:27.107218 (+   219us) log.cc:844] Serialized 28 byte log entry
0928 01:55:27.107375 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:27.107447 (+    72us) write_op.cc:454] Released schema lock
0928 01:55:27.107482 (+    35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1947,"apply.run_cpu_time_us":1592,"apply.run_wall_time_us":12117,"mutex_wait_us":42815,"num_ops":2,"prepare.queue_time_us":100740,"prepare.run_cpu_time_us":2422,"prepare.run_wall_time_us":21267,"raft.queue_time_us":1403,"raft.run_cpu_time_us":14,"raft.run_wall_time_us":15,"replication_time_us":134705,"threads_started":1}]]}
I20260928 01:55:27.118817 19113 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_cd70497bd2534ceb8f3d11a934050d49" } modify_external_catalogs: true
I20260928 01:55:27.119699 19113 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_cd70497bd2534ceb8f3d11a934050d49" } modify_external_catalogs: true
I20260928 01:55:27.132282 19890 tablet_bootstrap.cc:654] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:27.137879 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee6d48172044c74aacd4b78683efb66 (DEFAULT_TABLE table=default.Table_3d4ef2c3012a4e4db1e9f4a7c6f1f84e [id=80615f0d230c4c50b8c7162d16d54c88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.138964 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee6d48172044c74aacd4b78683efb66. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:27.139860 19116 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea77f3197ee5496d9624cc76b3361ace consensus state has no leader
I20260928 01:55:27.140468 19116 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51212 (request call id 108) took 1545 ms. Trace:
I20260928 01:55:27.140796 19116 rpcz_store.cc:276] 0928 01:55:25.595295 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.748169 (+1152874us) service_pool.cc:224] Handling call
0928 01:55:26.753767 (+  5598us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:26.785750 (+ 31983us) catalog_manager.cc:3764] Apply alter schema
0928 01:55:26.788020 (+  2270us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 01:55:26.788590 (+   570us) catalog_manager.cc:3954] Updating metadata on disk
0928 01:55:26.940520 (+151930us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 01:55:27.140402 (+199882us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:26.899425 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:26.899959 (+   534us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:26.900014 (+    55us) write_op.cc:435] Acquired schema lock
0928 01:55:26.900027 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:26.900377 (+   350us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:26.900420 (+    43us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:26.900443 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:26.900589 (+   146us) tablet.cc:701] Row locks acquired
0928 01:55:26.900736 (+   147us) write_op.cc:260] PREPARE: finished
0928 01:55:26.900886 (+   150us) write_op.cc:270] Start()
0928 01:55:26.900981 (+    95us) write_op.cc:276] Timestamp: P: 1790560526900783 usec, L: 0
0928 01:55:26.900997 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:55:26.901559 (+   562us) log.cc:844] Serialized 404 byte log entry
0928 01:55:26.935244 (+ 33685us) op_driver.cc:464] REPLICATION: finished
0928 01:55:26.935609 (+   365us) write_op.cc:301] APPLY: starting
0928 01:55:26.935680 (+    71us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:26.935835 (+   155us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:26.935956 (+   121us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:26.936193 (+   237us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:26.936426 (+   233us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:26.936501 (+    75us) write_op.cc:312] APPLY: finished
0928 01:55:26.936812 (+   311us) log.cc:844] Serialized 22 byte log entry
0928 01:55:26.937026 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:26.937119 (+    93us) write_op.cc:454] Released schema lock
0928 01:55:26.937166 (+    47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":132,"apply.run_cpu_time_us":1838,"apply.run_wall_time_us":1839,"mutex_wait_us":62266,"num_ops":1,"prepare.queue_time_us":62786,"prepare.run_cpu_time_us":2586,"prepare.run_wall_time_us":5289,"raft.queue_time_us":457,"raft.run_cpu_time_us":1150,"raft.run_wall_time_us":1152,"replication_time_us":34111}]]}
I20260928 01:55:27.154541 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet ad62475da6e74fb4971837a018e77c1c (table default.Table_7be970fbb13745978e6b90a9a7d84fb7 [id=8b8c2a287da9417fb0cb7f12a676abcf]) successfully deleted
I20260928 01:55:27.164748 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee6d48172044c74aacd4b78683efb66 (DEFAULT_TABLE table=default.Table_3d4ef2c3012a4e4db1e9f4a7c6f1f84e [id=80615f0d230c4c50b8c7162d16d54c88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.167121 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee6d48172044c74aacd4b78683efb66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.167928 19890 tablet_bootstrap.cc:492] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:27.168531 19890 ts_tablet_manager.cc:1403] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.001s
I20260928 01:55:27.171104 19890 raft_consensus.cc:359] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.171892 19890 raft_consensus.cc:385] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:27.172235 19890 raft_consensus.cc:740] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:27.173031 19890 consensus_queue.cc:260] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.173547 19741 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (DEFAULT_TABLE table=default.Table_2fbaba56e6074d2caa5b8a3603cc5ff9 [id=91b9d48a31cc4cd583ffb7e2cc34faca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.175217 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc9a1c5be7c4e519f1415ba70397f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.179471 19890 ts_tablet_manager.cc:1434] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260928 01:55:27.180552 19890 tablet_bootstrap.cc:492] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:27.188011 19890 tablet_bootstrap.cc:654] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:27.190474 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 5d9b93f45ccf44e785b00849e49c8294 (DEFAULT_TABLE table=default.Table_63f36a8d22184eac8a38565457441d09 [id=102958783e204ded94a67a96b0dec09b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.191933 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9b93f45ccf44e785b00849e49c8294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.202127 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 78a71904514a488083426f5fe07d12cd (DEFAULT_TABLE table=default.Table_d6ec5f8939f84de7994041a54bdbe36b [id=ab54f23a53744160a4b2437b2b513937]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.203625 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a71904514a488083426f5fe07d12cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.208933 20147 ts_tablet_manager.cc:1916] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:27.216499 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa1e9b7119d46a2ba2652a893877c8c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:27.220057 19553 leader_election.cc:343] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:27.220075 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:27.220621 19553 leader_election.cc:304] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:27.221453 20067 raft_consensus.cc:2749] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:27.223380 19890 tablet_bootstrap.cc:492] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:27.223851 19890 ts_tablet_manager.cc:1403] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.009s
I20260928 01:55:27.228416 19890 raft_consensus.cc:359] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.230470 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 5d9b93f45ccf44e785b00849e49c8294 (DEFAULT_TABLE table=default.Table_63f36a8d22184eac8a38565457441d09 [id=102958783e204ded94a67a96b0dec09b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.238178 20029 tablet_bootstrap.cc:654] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:27.238722 19890 raft_consensus.cc:385] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:27.239001 19890 raft_consensus.cc:740] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:27.237950 20161 raft_consensus.cc:493] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:27.245999 20161 raft_consensus.cc:515] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.246130 19890 consensus_queue.cc:260] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.249239 19890 ts_tablet_manager.cc:1434] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260928 01:55:27.251601 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:27.252996 20147 ts_tablet_manager.cc:1929] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:27.254745 20161 leader_election.cc:290] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:27.255214 20029 tablet_bootstrap.cc:492] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:27.255940 20029 ts_tablet_manager.cc:1403] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.390s	user 0.009s	sys 0.008s
I20260928 01:55:27.270020 20029 raft_consensus.cc:359] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.271135 20029 raft_consensus.cc:385] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:27.271554 20029 raft_consensus.cc:740] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:27.272606 20029 consensus_queue.cc:260] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.253912 19890 tablet_bootstrap.cc:492] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:27.274724 19741 tablet_service.cc:1511] Processing CreateTablet for tablet 599ef1523fcf43d1a1e2a91f03abaa60 (DEFAULT_TABLE table=default.Table_1109ca51476d45c0a4aad60c01bc222b [id=1994729b06be440781cb661b44b2f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.275944 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599ef1523fcf43d1a1e2a91f03abaa60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.276491 20029 ts_tablet_manager.cc:1434] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260928 01:55:27.279419 20029 tablet_bootstrap.cc:492] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:27.280128 20147 log.cc:1199] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/952df055998942f89baabb341e204f43
I20260928 01:55:27.285693 20029 tablet_bootstrap.cc:654] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:27.289912 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_07316c39d6b94592bfd855c58d6259ef"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:27.291700 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07316c39d6b94592bfd855c58d6259ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:27.310456 19118 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_6cf661a2ac0041cf96e63f24fe950f60" } new_table_name: "default.Table_f74d6b5e81d2457b88ab4456aa43c249" modify_external_catalogs: true
I20260928 01:55:27.314610 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 599ef1523fcf43d1a1e2a91f03abaa60 (DEFAULT_TABLE table=default.Table_1109ca51476d45c0a4aad60c01bc222b [id=1994729b06be440781cb661b44b2f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.314965 19114 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 63a3540d1441404092db723b7e5cb61a
I20260928 01:55:27.315742 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599ef1523fcf43d1a1e2a91f03abaa60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.315752 19110 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 109) took 1502 ms. Trace:
I20260928 01:55:27.316177 19110 rpcz_store.cc:276] 0928 01:55:25.812951 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.749096 (+936145us) service_pool.cc:224] Handling call
0928 01:55:26.825248 (+ 76152us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:26.827867 (+  2619us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:27.314912 (+487045us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:55:27.315299 (+   387us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:55:27.315663 (+   364us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:27.101087 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:27.101498 (+   411us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:27.101524 (+    26us) write_op.cc:435] Acquired schema lock
0928 01:55:27.101536 (+    12us) tablet.cc:662] Decoding operations
0928 01:55:27.101812 (+   276us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:27.101847 (+    35us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:27.101869 (+    22us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:27.102061 (+   192us) tablet.cc:701] Row locks acquired
0928 01:55:27.102076 (+    15us) write_op.cc:260] PREPARE: finished
0928 01:55:27.102196 (+   120us) write_op.cc:270] Start()
0928 01:55:27.102284 (+    88us) write_op.cc:276] Timestamp: P: 1790560527102151 usec, L: 0
0928 01:55:27.102300 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:55:27.128333 (+ 26033us) log.cc:844] Serialized 432 byte log entry
0928 01:55:27.129902 (+  1569us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b6aa1 00007f19fd7495e8 00007f19fdbd9791 00007f19fdbd8f68 00007f19fdbddc01 00007f19fdbddbb9 00007f19fdbddb49 00007f19fdbddb11 00007f19fdbdcd3d 00000000005bd4e4 00000000005bd319
0928 01:55:27.311647 (+181745us) op_driver.cc:464] REPLICATION: finished
0928 01:55:27.312186 (+   539us) write_op.cc:301] APPLY: starting
0928 01:55:27.312293 (+   107us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:27.312438 (+   145us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:27.312462 (+    24us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:27.313383 (+   921us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:27.313540 (+   157us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:55:27.313590 (+    50us) write_op.cc:312] APPLY: finished
0928 01:55:27.313797 (+   207us) log.cc:844] Serialized 28 byte log entry
0928 01:55:27.313971 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:27.314047 (+    76us) write_op.cc:454] Released schema lock
0928 01:55:27.314085 (+    38us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:27.314430 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:27.314459 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":334,"apply.run_cpu_time_us":2136,"apply.run_wall_time_us":2136,"num_ops":2,"prepare.queue_time_us":149624,"prepare.run_cpu_time_us":2685,"prepare.run_wall_time_us":29004,"raft.queue_time_us":3212,"raft.run_cpu_time_us":924,"raft.run_wall_time_us":2008,"replication_time_us":209249,"spinlock_wait_cycles":58559744}]]}
I20260928 01:55:27.323431 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_3c69a5708b414cb2bc1ab47056127578"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:27.324980 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a3540d1441404092db723b7e5cb61a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:26 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:27.325129 19596 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a3540d1441404092db723b7e5cb61a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:26 UTC) from {username='slave'} at 127.0.0.1:47670
W20260928 01:55:27.327164 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c69a5708b414cb2bc1ab47056127578 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:27.327653 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_a3b91440da804fed80fd1ad0b6493012"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:27.329486 20067 raft_consensus.cc:493] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:55:27.329893 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3b91440da804fed80fd1ad0b6493012 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:27.329979 20067 raft_consensus.cc:515] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:27.327165 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 63a3540d1441404092db723b7e5cb61a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63a3540d1441404092db723b7e5cb61a already in progress: creating tablet
I20260928 01:55:27.333966 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c1f247486548ee9747403f7f80e3dc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:27.281071 20147 ts_tablet_manager.cc:1950] T 952df055998942f89baabb341e204f43 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
W20260928 01:55:27.336167 19553 leader_election.cc:343] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:27.332031 20067 leader_election.cc:290] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:27.339015 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 952df055998942f89baabb341e204f43 (table default.Table_88ced5d20fea41538f5221b8f4367570 [id=d09064e0c8664ffd9e2fbf72f49b8e31]) successfully deleted
I20260928 01:55:27.349615 19111 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_d686d68698c1457e99e7c7d80eaaf7c3" } new_table_name: "default.Table_643440738a3244078fd46ee9ed79a3bd" modify_external_catalogs: true
I20260928 01:55:27.349664 19741 tablet_service.cc:1511] Processing CreateTablet for tablet ca443386942e49d9a66143e1fde777c5 (DEFAULT_TABLE table=default.Table_f8b9950aa8284139a842273931f64732 [id=4e58aaecd03c4a4ba4c4180c87891b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.351423 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca443386942e49d9a66143e1fde777c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.351492 19890 tablet_bootstrap.cc:654] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:27.357075 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet c8bbb627a14a477c9362d2b250f27c1e because the tablet was not found. No further retry: Not found: Tablet not found: c8bbb627a14a477c9362d2b250f27c1e
W20260928 01:55:27.362736 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet e3bccc8b0045456fa7f16e984b3c5bf5 because the tablet was not found. No further retry: Not found: Tablet not found: e3bccc8b0045456fa7f16e984b3c5bf5
I20260928 01:55:27.365371 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9b93f45ccf44e785b00849e49c8294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.369010 19454 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee6d48172044c74aacd4b78683efb66 (DEFAULT_TABLE table=default.Table_3d4ef2c3012a4e4db1e9f4a7c6f1f84e [id=80615f0d230c4c50b8c7162d16d54c88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.369175 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (DEFAULT_TABLE table=default.Table_2fbaba56e6074d2caa5b8a3603cc5ff9 [id=91b9d48a31cc4cd583ffb7e2cc34faca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.370332 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee6d48172044c74aacd4b78683efb66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.372675 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc9a1c5be7c4e519f1415ba70397f01. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:27.406425 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 7dd4743c49314e8b8d86e1c6e553b13e because the tablet was not found. No further retry: Not found: Tablet not found: 7dd4743c49314e8b8d86e1c6e553b13e
I20260928 01:55:27.427115 19596 tablet_service.cc:1511] Processing CreateTablet for tablet ca443386942e49d9a66143e1fde777c5 (DEFAULT_TABLE table=default.Table_f8b9950aa8284139a842273931f64732 [id=4e58aaecd03c4a4ba4c4180c87891b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.428560 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca443386942e49d9a66143e1fde777c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.440563 20029 tablet_bootstrap.cc:492] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:27.441190 20029 ts_tablet_manager.cc:1403] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.164s	user 0.056s	sys 0.052s
I20260928 01:55:27.388829 19903 raft_consensus.cc:2804] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:27.445633 20029 raft_consensus.cc:359] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.446354 20029 raft_consensus.cc:385] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:27.446640 20029 raft_consensus.cc:740] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:27.447376 20029 consensus_queue.cc:260] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.449548 20029 ts_tablet_manager.cc:1434] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260928 01:55:27.384565 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 318088us
I20260928 01:55:27.453748 20029 tablet_bootstrap.cc:492] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:27.445474 20137 raft_consensus.cc:493] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:27.455009 20137 raft_consensus.cc:515] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.442143 19903 raft_consensus.cc:493] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:27.456446 19903 raft_consensus.cc:3060] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:27.456162 19105 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet ea77f3197ee5496d9624cc76b3361ace consensus state has no leader
I20260928 01:55:27.460669 20029 tablet_bootstrap.cc:654] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:27.477777 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c1f247486548ee9747403f7f80e3dc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:27.479151 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:27.479645 19556 leader_election.cc:343] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:27.480005 19473 raft_consensus.cc:2393] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:27.480123 19556 leader_election.cc:304] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:27.482041 19451 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a3540d1441404092db723b7e5cb61a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:26 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:27.481977 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 599ef1523fcf43d1a1e2a91f03abaa60 (DEFAULT_TABLE table=default.Table_1109ca51476d45c0a4aad60c01bc222b [id=1994729b06be440781cb661b44b2f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.483193 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599ef1523fcf43d1a1e2a91f03abaa60. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:27.483623 19409 leader_election.cc:343] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:27.484458 20067 raft_consensus.cc:2749] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:27.494635 20137 leader_election.cc:290] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:27.497638 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa1e9b7119d46a2ba2652a893877c8c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:27.498594 19619 raft_consensus.cc:2468] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:27.501427 19703 leader_election.cc:304] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:27.503044 20124 raft_consensus.cc:3060] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:27.513476 20147 tablet_replica.cc:333] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:27.514525 19113 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet a62fdf2ca79a49ba96cb0e024240731a
I20260928 01:55:27.514991 20147 raft_consensus.cc:2243] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:27.516446 20147 raft_consensus.cc:2272] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:27.518435 19890 tablet_bootstrap.cc:492] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:27.518867 19890 ts_tablet_manager.cc:1403] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.265s	user 0.005s	sys 0.005s
I20260928 01:55:27.522457 19890 raft_consensus.cc:359] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:27.523180 19890 raft_consensus.cc:385] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:27.523456 19890 raft_consensus.cc:740] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:27.526495 19113 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_ef217ae2f1514ce99c1f8993333e2ec6" } modify_external_catalogs: true
I20260928 01:55:27.527372 19113 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_ef217ae2f1514ce99c1f8993333e2ec6" } modify_external_catalogs: true
I20260928 01:55:27.527916 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:27.529556 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:27.548106 20124 raft_consensus.cc:2749] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:27.500310 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 46056us
I20260928 01:55:27.558192 20148 ts_tablet_manager.cc:1929] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:27.540814 19412 leader_election.cc:304] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:27.559687 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 59456.5us
I20260928 01:55:27.558818 20148 log.cc:1199] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/0e902da355b641868c207fc26578b739
I20260928 01:55:27.561750 20148 ts_tablet_manager.cc:1950] T 0e902da355b641868c207fc26578b739 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:27.559859 20137 raft_consensus.cc:2804] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:27.548506 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 03bbed8181084cb88b7d33976c20fbb8 (DEFAULT_TABLE table=default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.559046 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa1e9b7119d46a2ba2652a893877c8c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:27.575371 19768 raft_consensus.cc:2468] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:27.577737 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bbed8181084cb88b7d33976c20fbb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.579787 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 03bbed8181084cb88b7d33976c20fbb8 (DEFAULT_TABLE table=default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.580981 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bbed8181084cb88b7d33976c20fbb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.584167 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 90b3c947794c48daaacc299a7d2dd4a9 (DEFAULT_TABLE table=default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.585280 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b3c947794c48daaacc299a7d2dd4a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.585914 19890 consensus_queue.cc:260] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:27.593458 20067 raft_consensus.cc:493] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:27.593950 20067 raft_consensus.cc:515] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.599418 19117 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba]). Expected version 2 got 0
I20260928 01:55:27.600449 20067 leader_election.cc:290] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:27.601115 19117 catalog_manager.cc:5838] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:55:27.602242 19890 ts_tablet_manager.cc:1434] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.003s
I20260928 01:55:27.602680 19117 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:27.607170 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e902da355b641868c207fc26578b739 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:27.567929 20137 raft_consensus.cc:493] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:27.609004 20137 raft_consensus.cc:3060] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:27.609014 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 0e902da355b641868c207fc26578b739 because the tablet was not found. No further retry: Not found: Tablet not found: 0e902da355b641868c207fc26578b739
I20260928 01:55:27.610977 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 90b3c947794c48daaacc299a7d2dd4a9) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:27.611722 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 63) took 1001 ms. Trace:
W20260928 01:55:27.612720 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 because the tablet was not found. No further retry: Not found: Tablet not found: a6fb7f3e609144f5a9dcc8b40d21dbb2
I20260928 01:55:27.612083 20148 rpcz_store.cc:276] 0928 01:55:26.610175 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.640031 (+ 29856us) service_pool.cc:224] Handling call
0928 01:55:26.980660 (+340629us) ts_tablet_manager.cc:1151] Deleting tablet 0e902da355b641868c207fc26578b739
0928 01:55:26.980751 (+    91us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:27.369760 (+389009us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:27.558019 (+188259us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:27.611646 (+ 53627us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":333914,"thread_start_us":287795,"threads_started":1}
I20260928 01:55:27.614766 20148 tablet_replica.cc:333] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:27.614939 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet dfc63ccbe4e84373aabe3009cc3d2568 with delete_type TABLET_DATA_DELETED (replaced by tablet f7b78eb499d6418f8877bf3b59bbbec2) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:27.616060 20148 raft_consensus.cc:2243] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:27.615834 19451 tablet_service.cc:1511] Processing CreateTablet for tablet 03bbed8181084cb88b7d33976c20fbb8 (DEFAULT_TABLE table=default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.616500 19741 tablet_service.cc:1558] Processing DeleteTablet for tablet a43cfb32bd0043049cbdb2faaf10409f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:44964
W20260928 01:55:27.616674 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet dfc63ccbe4e84373aabe3009cc3d2568 because the tablet was not found. No further retry: Not found: Tablet not found: dfc63ccbe4e84373aabe3009cc3d2568
I20260928 01:55:27.616724 20148 raft_consensus.cc:2272] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 01:55:27.617931 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet a43cfb32bd0043049cbdb2faaf10409f because the tablet was not found. No further retry: Not found: Tablet not found: a43cfb32bd0043049cbdb2faaf10409f
I20260928 01:55:27.617899 19453 tablet_service.cc:1511] Processing CreateTablet for tablet 90b3c947794c48daaacc299a7d2dd4a9 (DEFAULT_TABLE table=default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.618975 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 0e902da355b641868c207fc26578b739 (table default.Table_a2a87b5badd741caa9c92c3a137b0a2d [id=136676f3aa8a473699bc8c172b81929a]) successfully deleted
I20260928 01:55:27.619437 20148 ts_tablet_manager.cc:1916] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:55:27.619445 19115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 13) took 1357 ms (client timeout 1000 ms). Trace:
I20260928 01:55:27.621325 19896 tablet_bootstrap.cc:492] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:27.621724 19896 ts_tablet_manager.cc:1403] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.573s	user 0.019s	sys 0.004s
I20260928 01:55:27.629294 19896 raft_consensus.cc:359] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.630754 19454 tablet_service.cc:1511] Processing CreateTablet for tablet ca443386942e49d9a66143e1fde777c5 (DEFAULT_TABLE table=default.Table_f8b9950aa8284139a842273931f64732 [id=4e58aaecd03c4a4ba4c4180c87891b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.644893 20136 consensus_queue.cc:1048] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:27.659435 19896 raft_consensus.cc:385] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:27.639664 19903 raft_consensus.cc:515] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:27.619796 19115 rpcz_store.cc:269] 0928 01:55:26.262451 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.684518 (+422067us) service_pool.cc:224] Handling call
0928 01:55:27.619378 (+934860us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:27.349453 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:27.349859 (+   406us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:27.349883 (+    24us) write_op.cc:435] Acquired schema lock
0928 01:55:27.349895 (+    12us) tablet.cc:662] Decoding operations
0928 01:55:27.366247 (+ 16352us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:27.366289 (+    42us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:27.366310 (+    21us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:27.366497 (+   187us) tablet.cc:701] Row locks acquired
0928 01:55:27.366512 (+    15us) write_op.cc:260] PREPARE: finished
0928 01:55:27.366674 (+   162us) write_op.cc:270] Start()
0928 01:55:27.366775 (+   101us) write_op.cc:276] Timestamp: P: 1790560527366610 usec, L: 0
0928 01:55:27.366794 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:55:27.367383 (+   589us) log.cc:844] Serialized 529 byte log entry
0928 01:55:27.587448 (+220065us) op_driver.cc:464] REPLICATION: finished
0928 01:55:27.588179 (+   731us) write_op.cc:301] APPLY: starting
0928 01:55:27.588264 (+    85us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:27.588361 (+    97us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:27.588460 (+    99us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:27.588620 (+   160us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:27.588749 (+   129us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:27.588800 (+    51us) write_op.cc:312] APPLY: finished
0928 01:55:27.588986 (+   186us) log.cc:844] Serialized 22 byte log entry
0928 01:55:27.589154 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:27.589219 (+    65us) write_op.cc:454] Released schema lock
0928 01:55:27.589251 (+    32us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:27.589496 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:27.589519 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":562,"apply.run_cpu_time_us":1283,"apply.run_wall_time_us":1281,"num_ops":1,"prepare.queue_time_us":200606,"prepare.run_cpu_time_us":2301,"prepare.run_wall_time_us":161680,"raft.queue_time_us":96,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":11,"replication_time_us":220540,"spinlock_wait_cycles":2944}]]}
I20260928 01:55:27.660923 19896 raft_consensus.cc:740] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:27.681169 19896 consensus_queue.cc:260] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.685782 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce41f63df46f4d0493ca22a13daadb4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:27.687477 19474 raft_consensus.cc:2468] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
W20260928 01:55:27.689287 19118 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce41f63df46f4d0493ca22a13daadb4f consensus state has no leader
I20260928 01:55:27.690367 19118 master_service.cc:960] ReplaceTablet: received request to replace tablet efa8a7589d314c25aeccf678c938ecf0 from {username='slave'} at 127.0.0.1:51212
W20260928 01:55:27.693951 19111 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eaa1e9b7119d46a2ba2652a893877c8c consensus state has no leader
I20260928 01:55:27.694609 19451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bbed8181084cb88b7d33976c20fbb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.695164 19111 master_service.cc:960] ReplaceTablet: received request to replace tablet ad62475da6e74fb4971837a018e77c1c from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:27.696499 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca443386942e49d9a66143e1fde777c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.697891 19453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b3c947794c48daaacc299a7d2dd4a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.714963 19890 tablet_bootstrap.cc:492] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:27.669487 19903 leader_election.cc:290] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:27.723870 19896 ts_tablet_manager.cc:1434] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.000s
I20260928 01:55:27.725077 19896 tablet_bootstrap.cc:492] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:27.743100 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:27.748386 19114 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_1a6a047e1e8f4430a6756891154a5e3b" } modify_external_catalogs: true
I20260928 01:55:27.749245 19114 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_1a6a047e1e8f4430a6756891154a5e3b" } modify_external_catalogs: true
I20260928 01:55:27.770913 19113 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 7bfcdfe218414396824a8f3af4d673ff
I20260928 01:55:27.793792 19741 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6b59144fe14daab98b0965c7f8af02 (DEFAULT_TABLE table=default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.794922 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6b59144fe14daab98b0965c7f8af02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.797185 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6b59144fe14daab98b0965c7f8af02 (DEFAULT_TABLE table=default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.799868 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6b59144fe14daab98b0965c7f8af02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.800154 19742 tablet_service.cc:1511] Processing CreateTablet for tablet f7b78eb499d6418f8877bf3b59bbbec2 (DEFAULT_TABLE table=default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.801959 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b78eb499d6418f8877bf3b59bbbec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.805065 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bfcdfe218414396824a8f3af4d673ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:27.805001 19452 tablet_service.cc:1511] Processing CreateTablet for tablet f7b78eb499d6418f8877bf3b59bbbec2 (DEFAULT_TABLE table=default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.806932 19452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b78eb499d6418f8877bf3b59bbbec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.808983 19449 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bfcdfe218414396824a8f3af4d673ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:27.811837 19448 tablet_service.cc:1511] Processing CreateTablet for tablet f3741aec215343468b2d7bc952da03c8 (DEFAULT_TABLE table=default.Table_1d40de09d743485db2f538534e097074 [id=c314147c39ca4ef695e61de1652cf804]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.813916 19448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3741aec215343468b2d7bc952da03c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.822254 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 90b3c947794c48daaacc299a7d2dd4a9 (DEFAULT_TABLE table=default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.822597 19447 tablet_service.cc:1511] Processing CreateTablet for tablet 7a753f894ae94b1eaf9b445df3545ded (DEFAULT_TABLE table=default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:27.832024 19409 leader_election.cc:343] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:27.834075 19447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a753f894ae94b1eaf9b445df3545ded. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:27.836956 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 7bfcdfe218414396824a8f3af4d673ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bfcdfe218414396824a8f3af4d673ff already in progress: creating tablet
W20260928 01:55:27.837188 19409 consensus_peers.cc:597] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad62475da6e74fb4971837a018e77c1c. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:27.842433 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b3c947794c48daaacc299a7d2dd4a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.829677 20029 tablet_bootstrap.cc:492] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:27.843420 20029 ts_tablet_manager.cc:1403] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.390s	user 0.091s	sys 0.123s
I20260928 01:55:27.830554 19743 tablet_service.cc:1511] Processing CreateTablet for tablet 7a753f894ae94b1eaf9b445df3545ded (DEFAULT_TABLE table=default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.845397 20134 consensus_queue.cc:1048] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260928 01:55:27.847046 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a753f894ae94b1eaf9b445df3545ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.826182 19740 tablet_service.cc:1511] Processing CreateTablet for tablet f3741aec215343468b2d7bc952da03c8 (DEFAULT_TABLE table=default.Table_1d40de09d743485db2f538534e097074 [id=c314147c39ca4ef695e61de1652cf804]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.849551 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3741aec215343468b2d7bc952da03c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.870280 20029 raft_consensus.cc:359] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.871153 20029 raft_consensus.cc:385] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:27.871542 20029 raft_consensus.cc:740] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:27.885701 20137 raft_consensus.cc:515] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.896826 20029 consensus_queue.cc:260] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.907851 19112 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_643440738a3244078fd46ee9ed79a3bd" } new_table_name: "default.Table_65f15ba706be46f1a86e11c5c548b555" modify_external_catalogs: true
I20260928 01:55:27.912808 20029 ts_tablet_manager.cc:1434] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.007s
I20260928 01:55:27.916738 19113 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_a3b91440da804fed80fd1ad0b6493012" } new_table_name: "default.Table_884049b20a384d798c2c218641f29412" modify_external_catalogs: true
I20260928 01:55:27.919800 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6b59144fe14daab98b0965c7f8af02 (DEFAULT_TABLE table=default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.925279 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:27.926227 19621 raft_consensus.cc:3060] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:27.929899 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6b59144fe14daab98b0965c7f8af02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.935645 19599 tablet_service.cc:1511] Processing CreateTablet for tablet f7b78eb499d6418f8877bf3b59bbbec2 (DEFAULT_TABLE table=default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.936825 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b78eb499d6418f8877bf3b59bbbec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.943432 20171 raft_consensus.cc:493] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:27.943935 19118 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet efa8a7589d314c25aeccf678c938ecf0
I20260928 01:55:27.944044 20171 raft_consensus.cc:515] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:27.945916 19118 catalog_manager.cc:6934] ReplaceTablet: tablet efa8a7589d314c25aeccf678c938ecf0 deleted and replaced by tablet 2156dae74ee748cd845b6dea1d3b8ea8
I20260928 01:55:27.946136 20171 leader_election.cc:290] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:27.948225 19449 tablet_service.cc:1558] Processing DeleteTablet for tablet efa8a7589d314c25aeccf678c938ecf0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2156dae74ee748cd845b6dea1d3b8ea8) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:27.956657 19597 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bfcdfe218414396824a8f3af4d673ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:27.957782 20147 ts_tablet_manager.cc:1916] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:27.970587 19595 tablet_service.cc:1558] Processing DeleteTablet for tablet efa8a7589d314c25aeccf678c938ecf0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2156dae74ee748cd845b6dea1d3b8ea8) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:27.970438 19597 tablet_service.cc:1511] Processing CreateTablet for tablet 7a753f894ae94b1eaf9b445df3545ded (DEFAULT_TABLE table=default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:27.971683 19556 leader_election.cc:304] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:27.972311 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a753f894ae94b1eaf9b445df3545ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:27.972540 20171 raft_consensus.cc:2804] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:27.973035 20171 raft_consensus.cc:493] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:27.973543 20171 raft_consensus.cc:3060] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:27.991264 20137 leader_election.cc:290] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:28.001560 20124 raft_consensus.cc:493] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:28.007617 20124 raft_consensus.cc:515] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.012180 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce41f63df46f4d0493ca22a13daadb4f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:28.012177 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce41f63df46f4d0493ca22a13daadb4f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:28.012853 19474 raft_consensus.cc:2468] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:28.014068 20124 leader_election.cc:290] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:28.014978 19703 leader_election.cc:304] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:28.015972 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_d8fa3c5311e74d20aa00d9acb400810f"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:28.016638 20124 raft_consensus.cc:2804] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:28.017201 20124 raft_consensus.cc:493] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:28.017640 20124 raft_consensus.cc:3060] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:28.017840 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8fa3c5311e74d20aa00d9acb400810f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:28.019186 19896 tablet_bootstrap.cc:654] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:28.026432 20029 tablet_bootstrap.cc:492] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:28.027093 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_eec015404ccd406f9a1dc1a588d1091c"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:28.030078 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eec015404ccd406f9a1dc1a588d1091c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:28.042872 20137 consensus_queue.cc:1048] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:28.055313 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:28.070264 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_0991384f9b0745a389ad95d24675e413"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:28.072158 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0991384f9b0745a389ad95d24675e413 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:28.081835 19111 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_26116cab8a164e2cb26e73efbde6d923" } modify_external_catalogs: true
I20260928 01:55:28.082459 19111 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_26116cab8a164e2cb26e73efbde6d923" } modify_external_catalogs: true
W20260928 01:55:28.089895 19112 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eaa1e9b7119d46a2ba2652a893877c8c consensus state has no leader
I20260928 01:55:28.091037 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_42b632d0b0ce475d9d3be797e7627a54"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:28.094926 19117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 25) took 1138 ms (client timeout 1000 ms). Trace:
W20260928 01:55:28.096804 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42b632d0b0ce475d9d3be797e7627a54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:28.101486 19596 tablet_service.cc:1511] Processing CreateTablet for tablet f3741aec215343468b2d7bc952da03c8 (DEFAULT_TABLE table=default.Table_1d40de09d743485db2f538534e097074 [id=c314147c39ca4ef695e61de1652cf804]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:28.095361 19117 rpcz_store.cc:269] 0928 01:55:26.956639 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.965176 (+  8537us) service_pool.cc:224] Handling call
0928 01:55:27.009768 (+ 44592us) spinlock_profiling.cc:243] Waited 9.29 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:28.094854 (+1085086us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:27.732374 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:27.732864 (+   490us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:27.732894 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:55:27.732909 (+    15us) tablet.cc:662] Decoding operations
0928 01:55:27.733208 (+   299us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:27.733250 (+    42us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:27.733285 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:27.733489 (+   204us) tablet.cc:701] Row locks acquired
0928 01:55:27.733505 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:55:27.733640 (+   135us) write_op.cc:270] Start()
0928 01:55:27.733736 (+    96us) write_op.cc:276] Timestamp: P: 1790560527733587 usec, L: 0
0928 01:55:27.733754 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:55:27.734391 (+   637us) log.cc:844] Serialized 530 byte log entry
0928 01:55:27.933090 (+198699us) op_driver.cc:464] REPLICATION: finished
0928 01:55:27.934022 (+   932us) write_op.cc:301] APPLY: starting
0928 01:55:27.934119 (+    97us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:27.934259 (+   140us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:27.934429 (+   170us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:27.934660 (+   231us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:27.934908 (+   248us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:27.934977 (+    69us) write_op.cc:312] APPLY: finished
0928 01:55:27.935247 (+   270us) log.cc:844] Serialized 23 byte log entry
0928 01:55:27.935467 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:27.935570 (+   103us) write_op.cc:454] Released schema lock
0928 01:55:27.935625 (+    55us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:27.940417 (+  4792us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:27.940457 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":58413,"reported_tablets":8,"spinlock_wait_cycles":21367040,"child_traces":[["op",{"apply.queue_time_us":742,"apply.run_cpu_time_us":1967,"apply.run_wall_time_us":6265,"num_ops":1,"prepare.queue_time_us":69628,"prepare.run_cpu_time_us":2395,"prepare.run_wall_time_us":2665,"raft.queue_time_us":96,"raft.run_cpu_time_us":14,"raft.run_wall_time_us":15,"replication_time_us":199233}]]}
I20260928 01:55:28.106662 19117 master_service.cc:960] ReplaceTablet: received request to replace tablet 90d40050f85a4d6c90a4ce35cf15d134 from {username='slave'} at 127.0.0.1:51212
W20260928 01:55:28.109082 19113 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b60e7bd679e447d18e340cfaed66d328 has no consensus state
I20260928 01:55:28.119477 19896 tablet_bootstrap.cc:492] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:28.129881 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3741aec215343468b2d7bc952da03c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.135092 19745 tablet_service.cc:1558] Processing DeleteTablet for tablet efa8a7589d314c25aeccf678c938ecf0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2156dae74ee748cd845b6dea1d3b8ea8) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:28.136597 20010 tablet_replica.cc:333] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:28.137367 20010 raft_consensus.cc:2243] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:28.138144 19896 ts_tablet_manager.cc:1403] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.413s	user 0.004s	sys 0.012s
I20260928 01:55:28.138381 20010 raft_consensus.cc:2272] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:28.141497 19896 raft_consensus.cc:359] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.142170 19896 raft_consensus.cc:385] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:28.142441 19896 raft_consensus.cc:740] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:28.143337 20010 ts_tablet_manager.cc:1916] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:28.150934 19621 raft_consensus.cc:2468] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
W20260928 01:55:28.158144 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 72506.4us
I20260928 01:55:28.181320 19890 tablet_bootstrap.cc:654] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:28.193015 20067 raft_consensus.cc:493] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:28.192005 19896 consensus_queue.cc:260] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.193701 20067 raft_consensus.cc:515] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:28.195844 19896 ts_tablet_manager.cc:1434] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260928 01:55:28.199784 20067 leader_election.cc:290] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:28.200148 20148 ts_tablet_manager.cc:1929] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:28.200768 20148 log.cc:1199] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/7dd4743c49314e8b8d86e1c6e553b13e
I20260928 01:55:28.201689 20148 ts_tablet_manager.cc:1950] T 7dd4743c49314e8b8d86e1c6e553b13e P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:28.201953 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa1e9b7119d46a2ba2652a893877c8c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:28.203109 19767 raft_consensus.cc:3060] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:28.203452 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa1e9b7119d46a2ba2652a893877c8c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:28.204377 19619 raft_consensus.cc:3060] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:28.208102 19896 tablet_bootstrap.cc:492] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:28.218189 20067 consensus_queue.cc:1048] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:28.219077 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet 457837143b0f4763a4b91bb25b580477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:28.236466 19601 tablet_service.cc:1558] Processing DeleteTablet for tablet 952df055998942f89baabb341e204f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:28.241369 20029 tablet_bootstrap.cc:654] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:28.242491 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce41f63df46f4d0493ca22a13daadb4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:28.243902 19556 leader_election.cc:343] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:28.172070 20171 raft_consensus.cc:515] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.246214 19618 raft_consensus.cc:2393] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:28.249452 20171 leader_election.cc:290] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:28.250713 20186 log.cc:927] Time spent T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260928 01:55:28.269589 19890 tablet_bootstrap.cc:492] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:28.270181 19890 ts_tablet_manager.cc:1403] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.555s	user 0.013s	sys 0.004s
I20260928 01:55:28.272478 19619 raft_consensus.cc:2468] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:28.274187 19890 raft_consensus.cc:359] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.308985 19890 raft_consensus.cc:385] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:28.309388 19890 raft_consensus.cc:740] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:28.310286 19890 consensus_queue.cc:260] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.314571 20147 ts_tablet_manager.cc:1929] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:28.319798 20147 log.cc:1199] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/a43cfb32bd0043049cbdb2faaf10409f
I20260928 01:55:28.321051 20147 ts_tablet_manager.cc:1950] T a43cfb32bd0043049cbdb2faaf10409f P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:28.338778 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 66) took 1605 ms. Trace:
I20260928 01:55:28.317516 19890 ts_tablet_manager.cc:1434] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.002s
I20260928 01:55:28.340751 19890 tablet_bootstrap.cc:492] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:28.348296 20147 rpcz_store.cc:276] 0928 01:55:26.733014 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.736366 (+  3352us) service_pool.cc:224] Handling call
0928 01:55:27.513182 (+776816us) ts_tablet_manager.cc:1151] Deleting tablet a43cfb32bd0043049cbdb2faaf10409f
0928 01:55:27.513285 (+   103us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:28.261638 (+748353us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:28.314364 (+ 52726us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:28.338684 (+ 24320us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":775846}
I20260928 01:55:28.351074 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet a43cfb32bd0043049cbdb2faaf10409f (table default.Table_a47ad43bf23c4fa8b30c2aa4a8d66767 [id=63a3b65b060345c8811e85383a3d6dbe]) successfully deleted
I20260928 01:55:28.348935 20010 ts_tablet_manager.cc:1929] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:28.353436 20010 log.cc:1199] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/efa8a7589d314c25aeccf678c938ecf0
I20260928 01:55:28.353801 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 67) took 1615 ms. Trace:
I20260928 01:55:28.354337 20147 rpcz_store.cc:276] 0928 01:55:26.738843 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.739844 (+  1001us) service_pool.cc:224] Handling call
0928 01:55:28.353304 (+1613460us) ts_tablet_manager.cc:1151] Deleting tablet a6fb7f3e609144f5a9dcc8b40d21dbb2
0928 01:55:28.353407 (+   103us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:28.353700 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1612455}
I20260928 01:55:28.356742 19890 tablet_bootstrap.cc:654] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:28.357980 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 because the tablet was not found. No further retry: Not found: Tablet not found: a6fb7f3e609144f5a9dcc8b40d21dbb2
I20260928 01:55:28.361119 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:28.377876 20147 tablet_replica.cc:333] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:28.385800 20147 raft_consensus.cc:2243] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:28.386492 20147 pending_rounds.cc:70] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0: Trying to abort 1 pending ops.
I20260928 01:55:28.386832 20147 pending_rounds.cc:77] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135916878069760 op_type: NO_OP noop_request { }
I20260928 01:55:28.387419 20147 raft_consensus.cc:2889] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:28.387984 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce41f63df46f4d0493ca22a13daadb4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:28.256420 20124 raft_consensus.cc:515] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.371616 19767 raft_consensus.cc:2468] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:28.392529 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e1cc46939b4932a344b81c3bc8ca82" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:28.387961 20147 raft_consensus.cc:2272] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:28.308590 19412 leader_election.cc:304] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:28.406975 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 130383us
I20260928 01:55:28.409762 20137 raft_consensus.cc:2804] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:28.415390 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce41f63df46f4d0493ca22a13daadb4f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:28.418248 19619 raft_consensus.cc:2393] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:28.423240 19890 tablet_bootstrap.cc:492] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:28.428689 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e1cc46939b4932a344b81c3bc8ca82" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:28.430774 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce41f63df46f4d0493ca22a13daadb4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:28.431375 19474 raft_consensus.cc:3060] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:28.432313 19896 tablet_bootstrap.cc:654] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:28.432577 20137 raft_consensus.cc:697] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:28.433444 20137 consensus_queue.cc:237] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.390830 20161 raft_consensus.cc:493] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:28.436992 20161 raft_consensus.cc:515] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.437486 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 64) took 1771 ms. Trace:
I20260928 01:55:28.438047 20148 rpcz_store.cc:276] 0928 01:55:26.665989 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.666153 (+   164us) service_pool.cc:224] Handling call
0928 01:55:27.613461 (+947308us) ts_tablet_manager.cc:1151] Deleting tablet 7dd4743c49314e8b8d86e1c6e553b13e
0928 01:55:27.614578 (+  1117us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:28.086573 (+471995us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:28.199969 (+113396us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:28.437402 (+237433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1868,"tablet-delete.queue_time_us":946653}
I20260928 01:55:28.412837 19766 raft_consensus.cc:2393] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
W20260928 01:55:28.444548 19104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 90346.8us
I20260928 01:55:28.453640 19890 ts_tablet_manager.cc:1403] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.005s
W20260928 01:55:28.462291 19103 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_884049b20a384d798c2c218641f29412 [id=fcc02628377b4bbaaf98b333d59da1d5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b60e7bd679e447d18e340cfaed66d328 has no consensus state
I20260928 01:55:28.446810 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 7dd4743c49314e8b8d86e1c6e553b13e (table default.Table_1a6a047e1e8f4430a6756891154a5e3b [id=c9816a660a324eb9a6eeb87f2f1e9422]) successfully deleted
I20260928 01:55:28.419715 20010 ts_tablet_manager.cc:1950] T efa8a7589d314c25aeccf678c938ecf0 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:28.465305 20147 ts_tablet_manager.cc:1916] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:28.472942 19116 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_884049b20a384d798c2c218641f29412" } new_table_name: "default.Table_74308c5165a043f7a175675c414ee652" modify_external_catalogs: true
I20260928 01:55:28.476979 19112 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_65f15ba706be46f1a86e11c5c548b555" } new_table_name: "default.Table_9ebdf86862884825a8be67c95fd3f412" modify_external_catalogs: true
I20260928 01:55:28.487674 20067 raft_consensus.cc:493] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:28.488447 20067 raft_consensus.cc:515] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.491556 20067 leader_election.cc:290] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:28.492878 19553 leader_election.cc:343] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:28.493674 19553 leader_election.cc:304] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:28.494863 20067 raft_consensus.cc:2749] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:28.506259 19890 raft_consensus.cc:359] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:28.506999 19890 raft_consensus.cc:385] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:28.507283 19890 raft_consensus.cc:740] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:28.508128 19890 consensus_queue.cc:260] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:28.465066 19104 consensus_peers.cc:597] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc -> Peer 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095): Couldn't send request to peer 04e48edd841a42d08a480be209f0d294. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260928 01:55:28.516600 19104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 51584.9us
I20260928 01:55:28.511703 20195 tablet.cc:1751] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:28.453043 19474 raft_consensus.cc:2468] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:28.528366 20148 tablet_replica.cc:333] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:28.457535 19412 leader_election.cc:304] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:28.542781 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 85362.4us
W20260928 01:55:28.544921 19556 leader_election.cc:343] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:28.551177 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:28.411772 20124 leader_election.cc:290] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:28.563915 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:28.565157 19621 raft_consensus.cc:2393] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:28.571208 19903 raft_consensus.cc:2804] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:28.572688 19890 ts_tablet_manager.cc:1434] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.117s	user 0.004s	sys 0.004s
I20260928 01:55:28.571435 20134 raft_consensus.cc:493] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:28.540980 20137 raft_consensus.cc:493] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:28.545953 20148 raft_consensus.cc:2243] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:28.570020 20161 leader_election.cc:290] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:28.586762 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet efa8a7589d314c25aeccf678c938ecf0 (table default.Table_d5185be74c414c8a886b3b5ccebf4cd7 [id=3e43587428fb4c679f8222cf3c30d08d]) successfully deleted
I20260928 01:55:28.590034 20029 tablet_bootstrap.cc:492] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:28.590596 20029 ts_tablet_manager.cc:1403] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.564s	user 0.019s	sys 0.001s
W20260928 01:55:28.591249 19553 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 59880us
I20260928 01:55:28.591382 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_593e8a23ad954f5b8b209830cbd7ccf9"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:28.593175 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_593e8a23ad954f5b8b209830cbd7ccf9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:28.595319 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_74d8ab066a6d493d8f5fcda388d66055"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:28.598381 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74d8ab066a6d493d8f5fcda388d66055 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:28.573750 19890 tablet_bootstrap.cc:492] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:28.602100 20184 raft_consensus.cc:493] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:28.602861 20184 raft_consensus.cc:515] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:28.606755 20184 leader_election.cc:290] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:28.614765 19116 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b60e7bd679e447d18e340cfaed66d328 has no consensus state
I20260928 01:55:28.616479 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:28.617362 19619 raft_consensus.cc:2468] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:28.617830 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_a3ed770c6c6f410ba1b6c0db32c665bc"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:28.620875 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3ed770c6c6f410ba1b6c0db32c665bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:28.625605 19704 leader_election.cc:304] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:28.638520 20194 raft_consensus.cc:2804] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:55:28.639266 20194 raft_consensus.cc:493] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:28.640288 19556 leader_election.cc:304] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:28.639901 20194 raft_consensus.cc:3060] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:28.641045 20067 raft_consensus.cc:2804] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:28.641608 19896 tablet_bootstrap.cc:492] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:28.641577 20067 raft_consensus.cc:697] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:28.642037 19896 ts_tablet_manager.cc:1403] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.434s	user 0.010s	sys 0.018s
I20260928 01:55:28.642865 20067 consensus_queue.cc:237] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.651362 20171 consensus_queue.cc:1048] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:28.653694 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 61032.2us
I20260928 01:55:28.579197 20134 raft_consensus.cc:515] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:28.664125 20029 raft_consensus.cc:359] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.592319 19903 raft_consensus.cc:697] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:28.673292 20200 tablet.cc:1751] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:28.678467 20134 leader_election.cc:290] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:28.680644 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:28.640059 20137 raft_consensus.cc:515] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:28.682507 19409 leader_election.cc:343] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: dfc63ccbe4e84373aabe3009cc3d2568
I20260928 01:55:28.683615 20029 raft_consensus.cc:385] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:28.683945 20029 raft_consensus.cc:740] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:28.685158 20137 leader_election.cc:290] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:28.685986 20148 raft_consensus.cc:2272] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:28.686335 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:28.692155 20029 consensus_queue.cc:260] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.692440 19903 consensus_queue.cc:237] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.697600 19596 tablet_service.cc:1511] Processing CreateTablet for tablet b60e7bd679e447d18e340cfaed66d328 (DEFAULT_TABLE table=default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.698747 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b60e7bd679e447d18e340cfaed66d328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.697515 19109 catalog_manager.cc:5838] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } }
I20260928 01:55:28.699605 19109 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 05f875e126f04415a108f778a76bb0f5 (table default.Table_2c6a423a3158495a98d244242381a423 [id=10dc4468b0ce4b2c87cecd4c66cc5300]). Expected version 2 got 0
I20260928 01:55:28.701406 19597 tablet_service.cc:1511] Processing CreateTablet for tablet 99e806ba248746d2bde39a2eb76b17df (DEFAULT_TABLE table=default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.703408 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e806ba248746d2bde39a2eb76b17df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:28.703318 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 48698.6us
I20260928 01:55:28.706298 19890 tablet_bootstrap.cc:654] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:28.707197 20148 ts_tablet_manager.cc:1916] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:28.699678 19474 raft_consensus.cc:2468] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:28.717583 19740 tablet_service.cc:1511] Processing CreateTablet for tablet b699e0d862fa4a54bbd756625f4e692b (DEFAULT_TABLE table=default.Table_882a0296b9ba49ef94e01ab6602cfa6e [id=69979c2fb6c84f81a71c4e04deda37bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.719909 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b699e0d862fa4a54bbd756625f4e692b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.724807 19556 leader_election.cc:304] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:28.721614 19743 tablet_service.cc:1511] Processing CreateTablet for tablet 99e806ba248746d2bde39a2eb76b17df (DEFAULT_TABLE table=default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.730126 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e806ba248746d2bde39a2eb76b17df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:28.730686 19409 leader_election.cc:343] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:28.725262 19748 tablet_service.cc:1511] Processing CreateTablet for tablet b60e7bd679e447d18e340cfaed66d328 (DEFAULT_TABLE table=default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.732908 19896 raft_consensus.cc:359] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.733384 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b60e7bd679e447d18e340cfaed66d328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.733695 19896 raft_consensus.cc:385] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:28.733999 19896 raft_consensus.cc:740] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:28.727908 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_4660abbe85e6487bb791fef30eb47223"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:28.734678 19896 consensus_queue.cc:260] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:28.739440 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4660abbe85e6487bb791fef30eb47223 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:28.747982 20029 ts_tablet_manager.cc:1434] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.157s	user 0.004s	sys 0.004s
I20260928 01:55:28.749337 20029 tablet_bootstrap.cc:492] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:28.755788 19599 tablet_service.cc:1511] Processing CreateTablet for tablet b699e0d862fa4a54bbd756625f4e692b (DEFAULT_TABLE table=default.Table_882a0296b9ba49ef94e01ab6602cfa6e [id=69979c2fb6c84f81a71c4e04deda37bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.756987 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b699e0d862fa4a54bbd756625f4e692b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.758889 19601 tablet_service.cc:1511] Processing CreateTablet for tablet f71e2109f8cd4dd4a288fbdc8e50b133 (DEFAULT_TABLE table=default.Table_15cf8dad1ba94211b8e90f83f991eb22 [id=30ade53be61542a7a042a4401001fba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.759255 19742 tablet_service.cc:1511] Processing CreateTablet for tablet f71e2109f8cd4dd4a288fbdc8e50b133 (DEFAULT_TABLE table=default.Table_15cf8dad1ba94211b8e90f83f991eb22 [id=30ade53be61542a7a042a4401001fba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.760066 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71e2109f8cd4dd4a288fbdc8e50b133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.761106 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71e2109f8cd4dd4a288fbdc8e50b133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.762051 19896 ts_tablet_manager.cc:1434] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.120s	user 0.004s	sys 0.005s
I20260928 01:55:28.763062 19896 tablet_bootstrap.cc:492] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:28.763404 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 67be39a8cae04ff9ae99c2c3b02713cd (DEFAULT_TABLE table=default.Table_07316c39d6b94592bfd855c58d6259ef [id=d54031bc036141b88fcaf6c5f7f55331]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.766822 19451 tablet_service.cc:1511] Processing CreateTablet for tablet b60e7bd679e447d18e340cfaed66d328 (DEFAULT_TABLE table=default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.767382 19447 tablet_service.cc:1511] Processing CreateTablet for tablet 99e806ba248746d2bde39a2eb76b17df (DEFAULT_TABLE table=default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.769845 19451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b60e7bd679e447d18e340cfaed66d328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.765144 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67be39a8cae04ff9ae99c2c3b02713cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.770444 19448 tablet_service.cc:1511] Processing CreateTablet for tablet b699e0d862fa4a54bbd756625f4e692b (DEFAULT_TABLE table=default.Table_882a0296b9ba49ef94e01ab6602cfa6e [id=69979c2fb6c84f81a71c4e04deda37bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.776887 19447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e806ba248746d2bde39a2eb76b17df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.778069 19448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b699e0d862fa4a54bbd756625f4e692b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.780655 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:28.789463 20203 tablet.cc:1751] T ea77f3197ee5496d9624cc76b3361ace P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:28.793399 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce41f63df46f4d0493ca22a13daadb4f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:28.794575 19474 raft_consensus.cc:2393] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:28.795259 19117 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 90d40050f85a4d6c90a4ce35cf15d134
I20260928 01:55:28.796445 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:28.797053 19117 catalog_manager.cc:6934] ReplaceTablet: tablet 90d40050f85a4d6c90a4ce35cf15d134 deleted and replaced by tablet d0cb771766b44b149d3ed3ddf75a7474
I20260928 01:55:28.799021 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:28.779960 20171 raft_consensus.cc:2804] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:28.799836 19474 raft_consensus.cc:2468] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:28.800153 20171 raft_consensus.cc:493] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:28.800653 20171 raft_consensus.cc:3060] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:28.805024 19703 leader_election.cc:304] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:28.805161 19109 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba]). Expected version 2 got 0
I20260928 01:55:28.806803 19109 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:28.808499 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc63ccbe4e84373aabe3009cc3d2568" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:28.809327 19621 raft_consensus.cc:2468] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:28.814262 19453 tablet_service.cc:1511] Processing CreateTablet for tablet f71e2109f8cd4dd4a288fbdc8e50b133 (DEFAULT_TABLE table=default.Table_15cf8dad1ba94211b8e90f83f991eb22 [id=30ade53be61542a7a042a4401001fba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.816118 19453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71e2109f8cd4dd4a288fbdc8e50b133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.827711 19741 tablet_service.cc:1558] Processing DeleteTablet for tablet 90d40050f85a4d6c90a4ce35cf15d134 with delete_type TABLET_DATA_DELETED (replaced by tablet d0cb771766b44b149d3ed3ddf75a7474) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:28.827833 19703 leader_election.cc:304] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:28.829011 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 1555e557370a4e92915a9c55107b573b (DEFAULT_TABLE table=default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.829720 20161 raft_consensus.cc:2749] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:28.830241 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1555e557370a4e92915a9c55107b573b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.830771 20161 raft_consensus.cc:3060] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:28.833552 19741 tablet_service.cc:1511] Processing CreateTablet for tablet 3f4a1c903a04450684ba38081a75559e (DEFAULT_TABLE table=default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.836158 19739 tablet_service.cc:1511] Processing CreateTablet for tablet c1f73a301c84482f897990ac5e5dd162 (DEFAULT_TABLE table=default.Table_9aeb2b485111496ea1fed85fd4c55531 [id=c6da5b1f292748818838b53ed38d64a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.843842 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 67be39a8cae04ff9ae99c2c3b02713cd (DEFAULT_TABLE table=default.Table_07316c39d6b94592bfd855c58d6259ef [id=d54031bc036141b88fcaf6c5f7f55331]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.844882 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67be39a8cae04ff9ae99c2c3b02713cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.850873 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f4a1c903a04450684ba38081a75559e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.858927 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f73a301c84482f897990ac5e5dd162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.861846 19116 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_9d2c34bd356c4efa9ec1f1e11ab42a67" } new_table_name: "default.Table_2916b0cc0e3f4f4c97b4c2439e47cb91" modify_external_catalogs: true
I20260928 01:55:28.864498 19595 tablet_service.cc:1558] Processing DeleteTablet for tablet 90d40050f85a4d6c90a4ce35cf15d134 with delete_type TABLET_DATA_DELETED (replaced by tablet d0cb771766b44b149d3ed3ddf75a7474) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:28.877846 20195 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:44964 (request call id 89) took 1087 ms. Trace:
I20260928 01:55:28.880473 20205 raft_consensus.cc:493] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:28.912863 20194 raft_consensus.cc:515] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:28.930414 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:28.931192 19474 raft_consensus.cc:3060] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:28.881258 20205 raft_consensus.cc:515] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:28.935452 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet 90d40050f85a4d6c90a4ce35cf15d134 with delete_type TABLET_DATA_DELETED (replaced by tablet d0cb771766b44b149d3ed3ddf75a7474) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:28.936640 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 67be39a8cae04ff9ae99c2c3b02713cd (DEFAULT_TABLE table=default.Table_07316c39d6b94592bfd855c58d6259ef [id=d54031bc036141b88fcaf6c5f7f55331]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.937906 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67be39a8cae04ff9ae99c2c3b02713cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.941794 20184 raft_consensus.cc:493] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:28.941583 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 1555e557370a4e92915a9c55107b573b (DEFAULT_TABLE table=default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.942507 20184 raft_consensus.cc:515] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:28.943327 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1555e557370a4e92915a9c55107b573b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.914981 19412 leader_election.cc:304] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:28.945315 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 68387.8us
I20260928 01:55:28.945439 19454 tablet_service.cc:1511] Processing CreateTablet for tablet 3f4a1c903a04450684ba38081a75559e (DEFAULT_TABLE table=default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.946553 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f4a1c903a04450684ba38081a75559e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.949803 20184 leader_election.cc:290] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:28.878530 20195 rpcz_store.cc:276] 0928 01:55:27.790774 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.796298 (+  5524us) service_pool.cc:224] Handling call
0928 01:55:28.877718 (+1081420us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:27.998060 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:55:27.998730 (+   670us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:55:27.998796 (+    66us) alter_schema_op.cc:66] Acquired schema lock
0928 01:55:27.998857 (+    61us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:55:28.042808 (+ 43951us) alter_schema_op.cc:128] START. Timestamp: 1790560528042701
0928 01:55:28.042841 (+    33us) op_driver.cc:348] REPLICATION: starting
0928 01:55:28.043434 (+   593us) log.cc:844] Serialized 173 byte log entry
0928 01:55:28.363331 (+319897us) op_driver.cc:464] REPLICATION: finished
0928 01:55:28.510915 (+147584us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:55:28.518654 (+  7739us) log.cc:844] Serialized 5 byte log entry
0928 01:55:28.771750 (+253096us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:28.877333 (+105583us) log.cc:844] Serialized 14 byte log entry
0928 01:55:28.877465 (+   132us) alter_schema_op.cc:73] Released schema lock
0928 01:55:28.877511 (+    46us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":147176,"mutex_wait_us":12898,"prepare.queue_time_us":199965,"prepare.run_cpu_time_us":2866,"prepare.run_wall_time_us":72239,"raft.queue_time_us":13193,"raft.run_cpu_time_us":2340,"raft.run_wall_time_us":2329,"replication_time_us":320274,"thread_start_us":398090,"threads_started":3,"wal-append.queue_time_us":10187}]]}
I20260928 01:55:28.955355 20029 tablet_bootstrap.cc:654] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:28.941589 19452 tablet_service.cc:1511] Processing CreateTablet for tablet c1f73a301c84482f897990ac5e5dd162 (DEFAULT_TABLE table=default.Table_9aeb2b485111496ea1fed85fd4c55531 [id=c6da5b1f292748818838b53ed38d64a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:28.958467 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c1f247486548ee9747403f7f80e3dc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:28.959163 19452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f73a301c84482f897990ac5e5dd162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:28.959390 19476 raft_consensus.cc:2468] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:28.970438 19903 raft_consensus.cc:2804] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:55:28.971498 19903 raft_consensus.cc:493] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:28.976648 20161 raft_consensus.cc:2749] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:28.917695 20194 leader_election.cc:290] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:29.000252 19896 tablet_bootstrap.cc:654] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:28.972164 19903 raft_consensus.cc:3060] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:55:28.932615 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 260899us
I20260928 01:55:29.008603 19598 tablet_service.cc:1511] Processing CreateTablet for tablet 3f4a1c903a04450684ba38081a75559e (DEFAULT_TABLE table=default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:29.009764 19553 leader_election.cc:343] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:29.010867 19598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f4a1c903a04450684ba38081a75559e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:29.010608 19553 leader_election.cc:304] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:29.012444 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66eeaf33aa943c09f52b74360e2332d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:29.013204 19621 raft_consensus.cc:3060] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:55:29.019347 19553 leader_election.cc:343] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:29.021580 19597 tablet_service.cc:1511] Processing CreateTablet for tablet 86825485bfca479ea63c1a99dddb68d6 (DEFAULT_TABLE table=default.Table_527b8b35bcda4e179459c8909e6ff924 [id=81a780bf887d48bab835a4cc19f773e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:29.023887 19595 tablet_service.cc:1511] Processing CreateTablet for tablet 1555e557370a4e92915a9c55107b573b (DEFAULT_TABLE table=default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:29.041563 20205 leader_election.cc:290] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:29.042797 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86825485bfca479ea63c1a99dddb68d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:29.027743 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c1f247486548ee9747403f7f80e3dc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:29.045042 19617 raft_consensus.cc:2468] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:29.047904 19704 leader_election.cc:304] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:29.050268 19595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1555e557370a4e92915a9c55107b573b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:29.056563 20194 raft_consensus.cc:2804] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:29.057237 20194 raft_consensus.cc:493] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:29.057873 20194 raft_consensus.cc:3060] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:29.061025 19596 tablet_service.cc:1511] Processing CreateTablet for tablet c1f73a301c84482f897990ac5e5dd162 (DEFAULT_TABLE table=default.Table_9aeb2b485111496ea1fed85fd4c55531 [id=c6da5b1f292748818838b53ed38d64a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:29.070013 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f73a301c84482f897990ac5e5dd162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:29.113269 19449 tablet_service.cc:1511] Processing CreateTablet for tablet 86825485bfca479ea63c1a99dddb68d6 (DEFAULT_TABLE table=default.Table_527b8b35bcda4e179459c8909e6ff924 [id=81a780bf887d48bab835a4cc19f773e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:29.121034 20029 tablet_bootstrap.cc:492] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:29.126006 20205 raft_consensus.cc:493] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:29.126590 20205 raft_consensus.cc:515] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:29.141681 20207 raft_consensus.cc:2749] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:29.158744 19449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86825485bfca479ea63c1a99dddb68d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:29.163650 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_bc7db84520fe44218722802e24b939f1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:29.185185 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc7db84520fe44218722802e24b939f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:29.123778 20029 ts_tablet_manager.cc:1403] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.375s	user 0.015s	sys 0.009s
W20260928 01:55:29.209412 19409 leader_election.cc:343] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: c8bbb627a14a477c9362d2b250f27c1e
I20260928 01:55:29.050000 20171 raft_consensus.cc:515] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:29.227766 19619 raft_consensus.cc:2393] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:29.193156 20147 ts_tablet_manager.cc:1929] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:29.223867 20029 raft_consensus.cc:359] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:29.233731 20029 raft_consensus.cc:385] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:29.235352 20029 raft_consensus.cc:740] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:29.244859 20147 log.cc:1199] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/ad62475da6e74fb4971837a018e77c1c
I20260928 01:55:29.263353 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_9e19d07c34de4423843f6dd98c821031"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:29.262842 20029 consensus_queue.cc:260] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:29.271169 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e19d07c34de4423843f6dd98c821031 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:29.294292 20029 ts_tablet_manager.cc:1434] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.084s	user 0.017s	sys 0.000s
I20260928 01:55:29.330845 20029 tablet_bootstrap.cc:492] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:29.394013 20029 tablet_bootstrap.cc:654] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:29.255039 20205 leader_election.cc:290] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:29.404345 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 90d40050f85a4d6c90a4ce35cf15d134 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90d40050f85a4d6c90a4ce35cf15d134 already in progress: creating tablet
W20260928 01:55:29.413585 20211 log.cc:927] Time spent T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
I20260928 01:55:29.415908 20171 leader_election.cc:290] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:29.441835 19890 tablet_bootstrap.cc:492] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:29.442883 19890 ts_tablet_manager.cc:1403] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.869s	user 0.027s	sys 0.004s
W20260928 01:55:29.444345 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 223622us
I20260928 01:55:29.393638 19621 raft_consensus.cc:2468] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:55:29.453781 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:29.411223 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 86825485bfca479ea63c1a99dddb68d6 (DEFAULT_TABLE table=default.Table_527b8b35bcda4e179459c8909e6ff924 [id=81a780bf887d48bab835a4cc19f773e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:29.481662 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86825485bfca479ea63c1a99dddb68d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:29.433121 20147 ts_tablet_manager.cc:1950] T ad62475da6e74fb4971837a018e77c1c P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
W20260928 01:55:29.504518 19553 leader_election.cc:343] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:29.518460 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 50661.3us
I20260928 01:55:29.527086 19896 tablet_bootstrap.cc:492] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:29.505378 20029 tablet_bootstrap.cc:492] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:29.528873 19896 ts_tablet_manager.cc:1403] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.766s	user 0.018s	sys 0.009s
I20260928 01:55:29.529368 20029 ts_tablet_manager.cc:1403] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.199s	user 0.040s	sys 0.016s
W20260928 01:55:29.539861 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 53069.4us
W20260928 01:55:29.516377 19409 leader_election.cc:343] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: e3bccc8b0045456fa7f16e984b3c5bf5
I20260928 01:55:29.540817 20029 raft_consensus.cc:359] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:29.585278 20029 raft_consensus.cc:385] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:55:29.610522 19600 consensus_meta.cc:287] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.007s
I20260928 01:55:29.612268 20029 raft_consensus.cc:740] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:29.613412 20029 consensus_queue.cc:260] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:29.614573 19704 leader_election.cc:304] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:29.617211 20184 raft_consensus.cc:2804] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:55:29.617813 20184 raft_consensus.cc:697] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:29.629297 20184 consensus_queue.cc:237] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:29.630507 20029 ts_tablet_manager.cc:1434] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.100s	user 0.012s	sys 0.004s
I20260928 01:55:29.632069 20029 tablet_bootstrap.cc:492] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:55:29.660495 19105 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 33e1cc46939b4932a344b81c3bc8ca82 (table default.Table_1a6a047e1e8f4430a6756891154a5e3b [id=c9816a660a324eb9a6eeb87f2f1e9422], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 33e1cc46939b4932a344b81c3bc8ca82 consensus state has no leader
I20260928 01:55:29.672894 20029 tablet_bootstrap.cc:654] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:29.593636 19412 leader_election.cc:343] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: c8bbb627a14a477c9362d2b250f27c1e
I20260928 01:55:29.685604 20161 raft_consensus.cc:493] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:55:29.592964 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 82822.2us
I20260928 01:55:29.686472 20161 raft_consensus.cc:515] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:29.602447 19474 consensus_meta.cc:287] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.671s	user 0.014s	sys 0.007s
W20260928 01:55:29.725724 19703 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.Ping -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 173042us
W20260928 01:55:29.755865 19104 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111) [suppressed 8 similar messages]
W20260928 01:55:29.761950 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 66915.5us
I20260928 01:55:29.776365 20161 leader_election.cc:290] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:29.689618 19412 leader_election.cc:304] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:29.793804 20134 raft_consensus.cc:493] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:55:29.795046 20134 raft_consensus.cc:515] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:29.734620 20194 raft_consensus.cc:515] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:29.766485 20202 raft_consensus.cc:493] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
W20260928 01:55:29.746832 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 141572us
I20260928 01:55:29.845431 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:29.866290 19619 raft_consensus.cc:2393] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:29.869095 19118 master_service.cc:960] ReplaceTablet: received request to replace tablet 457837143b0f4763a4b91bb25b580477 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:29.873183 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_a7af8fe79805437dbda5a73ebefa0c79"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:29.877555 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7af8fe79805437dbda5a73ebefa0c79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:29.921061 19739 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44964 (request call id 104) took 1086 ms. Trace:
I20260928 01:55:29.922166 19739 rpcz_store.cc:276] 0928 01:55:28.834616 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.834987 (+   371us) service_pool.cc:224] Handling call
0928 01:55:28.853824 (+ 18837us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:28.858327 (+  4503us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:29.396614 (+538287us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:29.819167 (+422553us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:29.920842 (+101675us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:29.926240 20194 leader_election.cc:290] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:29.926558 19104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 170811us
I20260928 01:55:29.981899 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 65) took 3275 ms. Trace:
I20260928 01:55:29.705869 19474 raft_consensus.cc:2468] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:55:30.001048 19115 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 05f875e126f04415a108f778a76bb0f5 (table default.Table_2c6a423a3158495a98d244242381a423 [id=10dc4468b0ce4b2c87cecd4c66cc5300]). Expected version 2 got 0
I20260928 01:55:30.002951 19115 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba]). Expected version 2 got 0
I20260928 01:55:30.003719 19115 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:30.011945 20213 raft_consensus.cc:493] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:30.012557 20213 raft_consensus.cc:515] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:30.019057 20227 raft_consensus.cc:493] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:55:29.769901 19453 consensus_meta.cc:287] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.725s	user 0.018s	sys 0.004s
I20260928 01:55:30.030565 19110 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 05f875e126f04415a108f778a76bb0f5 (table default.Table_2c6a423a3158495a98d244242381a423 [id=10dc4468b0ce4b2c87cecd4c66cc5300]). Expected version 2 got 0
I20260928 01:55:30.030860 20067 consensus_queue.cc:1048] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:30.031430 19110 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba]). Expected version 2 got 0
I20260928 01:55:30.032137 19110 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:30.033141 19110 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet eaa1e9b7119d46a2ba2652a893877c8c (table default.Table_65f15ba706be46f1a86e11c5c548b555 [id=2961b396aa0e488e8440ed77d774588c]). Expected version 2 got 0
I20260928 01:55:30.033866 19110 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_9d2c34bd356c4efa9ec1f1e11ab42a67 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]). Expected version 1 got 0
I20260928 01:55:30.034401 19110 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet ce41f63df46f4d0493ca22a13daadb4f (table default.Table_f74d6b5e81d2457b88ab4456aa43c249 [id=9e114860728146b097bcfce77a95f9d0]). Expected version 2 got 0
W20260928 01:55:30.035552 19116 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f887fe10461d40ee9363ce97ebbedd4f consensus state has no leader
I20260928 01:55:30.036374 19114 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 33e1cc46939b4932a344b81c3bc8ca82
I20260928 01:55:30.037904 19116 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51212 (request call id 138) took 1177 ms. Trace:
W20260928 01:55:30.038146 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 192549us
W20260928 01:55:30.039362 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 167593us
I20260928 01:55:30.037940 19114 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 123) took 2290 ms. Trace:
I20260928 01:55:30.041337 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c1f247486548ee9747403f7f80e3dc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:30.041949 19619 raft_consensus.cc:3060] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:30.040660 19114 rpcz_store.cc:276] 0928 01:55:27.747871 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.747999 (+   128us) service_pool.cc:224] Handling call
0928 01:55:27.749779 (+  1780us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:27.751510 (+  1731us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:55:27.751686 (+   176us) catalog_manager.cc:2863] Locking tablets
0928 01:55:27.752687 (+  1001us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:55:27.959636 (+206949us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:55:27.959986 (+   350us) catalog_manager.cc:2911] Committing in-memory state
0928 01:55:30.036238 (+2076252us) catalog_manager.cc:2915] Aborting table tasks
0928 01:55:30.037887 (+  1649us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:27.755358 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:27.755756 (+   398us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:27.755781 (+    25us) write_op.cc:435] Acquired schema lock
0928 01:55:27.755795 (+    14us) tablet.cc:662] Decoding operations
0928 01:55:27.756157 (+   362us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:27.756220 (+    63us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:27.756245 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:27.756568 (+   323us) tablet.cc:701] Row locks acquired
0928 01:55:27.756583 (+    15us) write_op.cc:260] PREPARE: finished
0928 01:55:27.756714 (+   131us) write_op.cc:270] Start()
0928 01:55:27.756803 (+    89us) write_op.cc:276] Timestamp: P: 1790560527756654 usec, L: 0
0928 01:55:27.756819 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:55:27.757376 (+   557us) log.cc:844] Serialized 759 byte log entry
0928 01:55:27.933545 (+176169us) op_driver.cc:464] REPLICATION: finished
0928 01:55:27.955972 (+ 22427us) write_op.cc:301] APPLY: starting
0928 01:55:27.956049 (+    77us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:27.957558 (+  1509us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:27.957859 (+   301us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:27.958251 (+   392us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:27.958500 (+   249us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:27.958576 (+    76us) write_op.cc:312] APPLY: finished
0928 01:55:27.958876 (+   300us) log.cc:844] Serialized 29 byte log entry
0928 01:55:27.959160 (+   284us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:27.959261 (+   101us) write_op.cc:454] Released schema lock
0928 01:55:27.959314 (+    53us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:28.010647 (+ 51333us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:28.010674 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":17559,"apply.run_cpu_time_us":2296,"apply.run_wall_time_us":54586,"num_ops":2,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":2332,"prepare.run_wall_time_us":2516,"raft.queue_time_us":109,"raft.run_cpu_time_us":20,"raft.run_wall_time_us":21,"replication_time_us":176635}]]}
I20260928 01:55:30.045257 19117 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 05f875e126f04415a108f778a76bb0f5 (table default.Table_2c6a423a3158495a98d244242381a423 [id=10dc4468b0ce4b2c87cecd4c66cc5300]). Expected version 2 got 0
I20260928 01:55:30.046267 19117 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet ce41f63df46f4d0493ca22a13daadb4f (table default.Table_f74d6b5e81d2457b88ab4456aa43c249 [id=9e114860728146b097bcfce77a95f9d0]). Expected version 2 got 0
I20260928 01:55:30.038286 19116 rpcz_store.cc:276] 0928 01:55:28.860765 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.861320 (+   555us) service_pool.cc:224] Handling call
0928 01:55:28.862897 (+  1577us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:28.866303 (+  3406us) catalog_manager.cc:3764] Apply alter schema
0928 01:55:28.906318 (+ 40015us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 01:55:28.906646 (+   328us) catalog_manager.cc:3954] Updating metadata on disk
0928 01:55:29.702700 (+796054us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 01:55:30.037826 (+335126us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:29.012451 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:29.012872 (+   421us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:29.012896 (+    24us) write_op.cc:435] Acquired schema lock
0928 01:55:29.012911 (+    15us) tablet.cc:662] Decoding operations
0928 01:55:29.013394 (+   483us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:29.013434 (+    40us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:29.013459 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:29.013750 (+   291us) tablet.cc:701] Row locks acquired
0928 01:55:29.013768 (+    18us) write_op.cc:260] PREPARE: finished
0928 01:55:29.013899 (+   131us) write_op.cc:270] Start()
0928 01:55:29.013990 (+    91us) write_op.cc:276] Timestamp: P: 1790560529013829 usec, L: 0
0928 01:55:29.014007 (+    17us) op_driver.cc:348] REPLICATION: starting
0928 01:55:29.018318 (+  4311us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5400030d98. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fe4f4964 00007f19fd708e69 00007f19fd6c4b51 00007f19fd6c482a 00007f19fd749125 00007f19fd7495c9 00007f19fdbd9791 00007f19fdbd8f68 00007f19fdbddc01 00007f19fdbddbb9 00007f19fdbddb49
0928 01:55:29.018624 (+   306us) log.cc:844] Serialized 405 byte log entry
0928 01:55:29.085974 (+ 67350us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b58000428d0. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd6a796c 00007f19fd6ae283 00007f19fd6ae209 00007f19fd6ae199 00007f19fd6ae161 00007f19fd6ad32d 00000000005bd4e4 00000000005bd319 00007f19f65eb3e5 00007f19f65ed751
0928 01:55:29.696488 (+610514us) op_driver.cc:464] REPLICATION: finished
0928 01:55:29.698183 (+  1695us) write_op.cc:301] APPLY: starting
0928 01:55:29.698266 (+    83us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:29.698473 (+   207us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:29.698496 (+    23us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:29.698683 (+   187us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:29.699003 (+   320us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:29.699114 (+   111us) write_op.cc:312] APPLY: finished
0928 01:55:29.699366 (+   252us) log.cc:844] Serialized 23 byte log entry
0928 01:55:29.700095 (+   729us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:29.700157 (+    62us) write_op.cc:454] Released schema lock
0928 01:55:29.701965 (+  1808us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:29.702420 (+   455us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:29.702484 (+    64us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1386,"apply.run_cpu_time_us":2514,"apply.run_wall_time_us":4153,"num_ops":1,"prepare.queue_time_us":6120,"prepare.run_cpu_time_us":4814,"prepare.run_wall_time_us":7719,"raft.queue_time_us":111,"raft.run_cpu_time_us":4757,"raft.run_wall_time_us":66132,"replication_time_us":682348,"spinlock_wait_cycles":148319744}]]}
I20260928 01:55:30.048277 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_65da2b5b91484f68b38861e046f9f883"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:30.049435 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_9ee7221a3e36427e86752547f9beaecf"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:30.051558 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ee7221a3e36427e86752547f9beaecf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:30.046872 19117 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
W20260928 01:55:30.052543 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65da2b5b91484f68b38861e046f9f883 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:30.055181 19619 raft_consensus.cc:2468] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:30.063316 19117 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet eaa1e9b7119d46a2ba2652a893877c8c (table default.Table_65f15ba706be46f1a86e11c5c548b555 [id=2961b396aa0e488e8440ed77d774588c]). Expected version 2 got 0
I20260928 01:55:30.027766 20205 raft_consensus.cc:2749] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:29.808022 20202 raft_consensus.cc:515] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:30.079772 19113 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 05f875e126f04415a108f778a76bb0f5 (table default.Table_2c6a423a3158495a98d244242381a423 [id=10dc4468b0ce4b2c87cecd4c66cc5300]). Expected version 2 got 0
I20260928 01:55:30.083847 19113 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet ce41f63df46f4d0493ca22a13daadb4f (table default.Table_f74d6b5e81d2457b88ab4456aa43c249 [id=9e114860728146b097bcfce77a95f9d0]). Expected version 2 got 0
I20260928 01:55:30.085904 19113 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:30.029083 19474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.18.161.3:54577 (request call id 70) took 1100 ms. Trace:
I20260928 01:55:30.087812 19113 catalog_manager.cc:5838] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:30.094754 19113 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet eaa1e9b7119d46a2ba2652a893877c8c (table default.Table_65f15ba706be46f1a86e11c5c548b555 [id=2961b396aa0e488e8440ed77d774588c]). Expected version 2 got 0
W20260928 01:55:30.034989 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 449191us
W20260928 01:55:30.099049 19452 consensus_meta.cc:287] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.858s	user 0.025s	sys 0.002s
I20260928 01:55:30.108117 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:30.108776 19476 raft_consensus.cc:2468] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:30.019588 20227 raft_consensus.cc:515] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:30.110244 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c1f247486548ee9747403f7f80e3dc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:30.106132 20134 leader_election.cc:290] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:30.110819 19475 raft_consensus.cc:3060] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:30.127653 19896 raft_consensus.cc:359] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:30.128345 19896 raft_consensus.cc:385] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:30.128749 19896 raft_consensus.cc:740] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:30.129773 20202 leader_election.cc:290] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:30.131287 19453 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 91) took 1358 ms. Trace:
I20260928 01:55:30.131808 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:30.132603 19476 raft_consensus.cc:3060] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:30.131739 19453 rpcz_store.cc:276] 0928 01:55:28.773142 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.812940 (+ 39798us) service_pool.cc:224] Handling call
0928 01:55:28.815381 (+  2441us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:28.815593 (+   212us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:28.948333 (+132740us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:30.055928 (+1107595us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:30.131229 (+ 75301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:30.136463 20202 consensus_queue.cc:1048] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:30.137995 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:30.140154 19703 leader_election.cc:304] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
W20260928 01:55:30.141599 19448 consensus_meta.cc:287] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 1.171s	user 0.012s	sys 0.011s
I20260928 01:55:30.141721 20194 raft_consensus.cc:2804] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:30.142186 20194 raft_consensus.cc:493] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:30.142660 20194 raft_consensus.cc:3060] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:30.143172 19448 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 90) took 1374 ms. Trace:
I20260928 01:55:30.129439 19896 consensus_queue.cc:260] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:30.146447 19472 raft_consensus.cc:2468] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
W20260928 01:55:30.146972 19903 consensus_meta.cc:287] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 1.114s	user 0.020s	sys 0.004s
I20260928 01:55:30.148989 19475 raft_consensus.cc:2468] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:30.154135 19113 catalog_manager.cc:5838] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:30.157608 19703 leader_election.cc:304] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:30.158624 20230 raft_consensus.cc:2804] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:30.159217 20230 raft_consensus.cc:493] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:30.159708 20230 raft_consensus.cc:3060] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:30.162600 19111 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 027f99abaacc4c169661e7db08512ebd
I20260928 01:55:30.093466 19474 rpcz_store.cc:276] 0928 01:55:28.927268 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.929912 (+  2644us) service_pool.cc:224] Handling call
0928 01:55:30.027241 (+1097329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49024}
W20260928 01:55:30.118611 19412 leader_election.cc:343] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: e3bccc8b0045456fa7f16e984b3c5bf5
I20260928 01:55:30.164995 19412 leader_election.cc:304] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:30.165256 19111 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 129) took 2084 ms. Trace:
W20260928 01:55:30.166253 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 47688.5us
I20260928 01:55:30.167366 19412 leader_election.cc:304] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:30.110615 19452 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 96) took 1174 ms. Trace:
I20260928 01:55:30.168834 19452 rpcz_store.cc:276] 0928 01:55:28.936540 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.940312 (+  3772us) service_pool.cc:224] Handling call
0928 01:55:28.958681 (+ 18369us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:28.958774 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:29.241046 (+282272us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:30.102234 (+861188us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:30.110553 (+  8319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:30.169616 19703 leader_election.cc:304] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:55:30.172516 19112 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eaa1e9b7119d46a2ba2652a893877c8c consensus state has no leader
I20260928 01:55:30.172560 20161 raft_consensus.cc:2804] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:30.173148 19112 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51212 (request call id 133) took 1696 ms. Trace:
I20260928 01:55:30.173200 20161 raft_consensus.cc:697] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:30.174633 20161 consensus_queue.cc:237] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:30.173466 19112 rpcz_store.cc:276] 0928 01:55:28.476357 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.476482 (+   125us) service_pool.cc:224] Handling call
0928 01:55:28.477681 (+  1199us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:28.478411 (+   730us) catalog_manager.cc:3764] Apply alter schema
0928 01:55:28.479042 (+   631us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 01:55:28.479235 (+   193us) catalog_manager.cc:3954] Updating metadata on disk
0928 01:55:28.605429 (+126194us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 01:55:30.173079 (+1567650us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:28.484797 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:28.485239 (+   442us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:28.485263 (+    24us) write_op.cc:435] Acquired schema lock
0928 01:55:28.485276 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:28.485542 (+   266us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:28.485583 (+    41us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:28.485603 (+    20us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:28.485755 (+   152us) tablet.cc:701] Row locks acquired
0928 01:55:28.485767 (+    12us) write_op.cc:260] PREPARE: finished
0928 01:55:28.485890 (+   123us) write_op.cc:270] Start()
0928 01:55:28.485972 (+    82us) write_op.cc:276] Timestamp: P: 1790560528485821 usec, L: 0
0928 01:55:28.485988 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:55:28.486553 (+   565us) log.cc:844] Serialized 405 byte log entry
0928 01:55:28.590126 (+103573us) op_driver.cc:464] REPLICATION: finished
0928 01:55:28.600453 (+ 10327us) write_op.cc:301] APPLY: starting
0928 01:55:28.600529 (+    76us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:28.600690 (+   161us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:28.600863 (+   173us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:28.601095 (+   232us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:28.601505 (+   410us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:28.601582 (+    77us) write_op.cc:312] APPLY: finished
0928 01:55:28.601911 (+   329us) log.cc:844] Serialized 23 byte log entry
0928 01:55:28.602138 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:28.602224 (+    86us) write_op.cc:454] Released schema lock
0928 01:55:28.602271 (+    47us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:28.602605 (+   334us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:28.602652 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":281472,"child_traces":[["op",{"apply.queue_time_us":10037,"apply.run_cpu_time_us":2106,"apply.run_wall_time_us":2107,"num_ops":1,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":2040,"prepare.run_wall_time_us":2041,"raft.queue_time_us":7879,"raft.run_cpu_time_us":863,"raft.run_wall_time_us":864,"replication_time_us":103973}]]}
I20260928 01:55:30.165745 19111 rpcz_store.cc:276] 0928 01:55:28.081307 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.081457 (+   150us) service_pool.cc:224] Handling call
0928 01:55:28.082930 (+  1473us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:28.083500 (+   570us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:55:28.083653 (+   153us) catalog_manager.cc:2863] Locking tablets
0928 01:55:30.005488 (+1921835us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:55:30.024267 (+ 18779us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:55:30.032298 (+  8031us) catalog_manager.cc:2911] Committing in-memory state
0928 01:55:30.162435 (+130137us) catalog_manager.cc:2915] Aborting table tasks
0928 01:55:30.165169 (+  2734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:30.011023 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:30.011466 (+   443us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:30.011494 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:55:30.011508 (+    14us) tablet.cc:662] Decoding operations
0928 01:55:30.011851 (+   343us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:30.011901 (+    50us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:30.011928 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:30.012337 (+   409us) tablet.cc:701] Row locks acquired
0928 01:55:30.012353 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:55:30.012478 (+   125us) write_op.cc:270] Start()
0928 01:55:30.012577 (+    99us) write_op.cc:276] Timestamp: P: 1790560530012416 usec, L: 0
0928 01:55:30.012596 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:55:30.013209 (+   613us) log.cc:844] Serialized 762 byte log entry
0928 01:55:30.021998 (+  8789us) op_driver.cc:464] REPLICATION: finished
0928 01:55:30.022313 (+   315us) write_op.cc:301] APPLY: starting
0928 01:55:30.022366 (+    53us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:30.022474 (+   108us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:30.022590 (+   116us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:30.022823 (+   233us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:30.022954 (+   131us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:30.022994 (+    40us) write_op.cc:312] APPLY: finished
0928 01:55:30.023194 (+   200us) log.cc:844] Serialized 29 byte log entry
0928 01:55:30.023870 (+   676us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:30.023948 (+    78us) write_op.cc:454] Released schema lock
0928 01:55:30.023986 (+    38us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:30.024275 (+   289us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:30.024304 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":163,"apply.run_cpu_time_us":1399,"apply.run_wall_time_us":1899,"num_ops":2,"prepare.queue_time_us":3159,"prepare.run_cpu_time_us":2536,"prepare.run_wall_time_us":2537,"raft.queue_time_us":129,"raft.run_cpu_time_us":676,"raft.run_wall_time_us":675,"replication_time_us":9297}]]}
W20260928 01:55:30.187788 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 82228.9us
W20260928 01:55:30.191345 19110 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 26) took 1873 ms (client timeout 1000 ms). Trace:
W20260928 01:55:30.197033 19110 rpcz_store.cc:269] 0928 01:55:28.317850 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.319591 (+  1741us) service_pool.cc:224] Handling call
0928 01:55:28.481429 (+161838us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:30.191256 (+1709827us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":12,"spinlock_wait_cycles":352491392}
W20260928 01:55:30.203300 19109 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 14) took 2922 ms (client timeout 1000 ms). Trace:
I20260928 01:55:30.205107 20227 leader_election.cc:290] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:30.218106 19109 rpcz_store.cc:269] 0928 01:55:27.281121 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.281247 (+   126us) service_pool.cc:224] Handling call
0928 01:55:27.320932 (+ 39685us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:30.203065 (+2882133us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:28.909134 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:28.909550 (+   416us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:28.909577 (+    27us) write_op.cc:435] Acquired schema lock
0928 01:55:28.909590 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:28.909871 (+   281us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:28.909915 (+    44us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:28.909939 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:28.910102 (+   163us) tablet.cc:701] Row locks acquired
0928 01:55:28.910115 (+    13us) write_op.cc:260] PREPARE: finished
0928 01:55:28.910246 (+   131us) write_op.cc:270] Start()
0928 01:55:28.910339 (+    93us) write_op.cc:276] Timestamp: P: 1790560528910183 usec, L: 0
0928 01:55:28.910355 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:55:28.910922 (+   567us) log.cc:844] Serialized 530 byte log entry
0928 01:55:29.473800 (+562878us) op_driver.cc:464] REPLICATION: finished
0928 01:55:29.528877 (+ 55077us) write_op.cc:301] APPLY: starting
0928 01:55:29.530132 (+  1255us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:29.530235 (+   103us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:29.530634 (+   399us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:29.531167 (+   533us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:29.531804 (+   637us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:29.531850 (+    46us) write_op.cc:312] APPLY: finished
0928 01:55:29.532087 (+   237us) log.cc:844] Serialized 23 byte log entry
0928 01:55:29.540729 (+  8642us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:29.540805 (+    76us) write_op.cc:454] Released schema lock
0928 01:55:29.540841 (+    36us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:29.541751 (+   910us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:29.541813 (+    62us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25,"reported_tablets":10,"spinlock_wait_cycles":13396864,"child_traces":[["op",{"apply.queue_time_us":54256,"apply.run_cpu_time_us":3645,"apply.run_wall_time_us":12691,"num_ops":1,"prepare.queue_time_us":3344,"prepare.run_cpu_time_us":2140,"prepare.run_wall_time_us":2141,"raft.queue_time_us":2989,"raft.run_cpu_time_us":992,"raft.run_wall_time_us":1193,"replication_time_us":563066,"thread_start_us":17216,"threads_started":1}]]}
I20260928 01:55:30.143606 19448 rpcz_store.cc:276] 0928 01:55:28.768881 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.769035 (+   154us) service_pool.cc:224] Handling call
0928 01:55:28.775748 (+  6713us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:28.775896 (+   148us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:28.932912 (+157016us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:30.142379 (+1209467us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:30.143093 (+   714us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:30.147475 19903 raft_consensus.cc:515] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:30.253751 19903 leader_election.cc:290] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:30.123193 19451 consensus_meta.cc:287] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.896s	user 0.016s	sys 0.000s
I20260928 01:55:30.209596 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 45d8d07b367b4fafbd7171f8ea7b2a26 (DEFAULT_TABLE table=default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.255961 19451 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 88) took 1490 ms. Trace:
I20260928 01:55:30.257038 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d8d07b367b4fafbd7171f8ea7b2a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.256675 19451 rpcz_store.cc:276] 0928 01:55:28.765245 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.765388 (+   143us) service_pool.cc:224] Handling call
0928 01:55:28.768074 (+  2686us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:28.769284 (+  1210us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:29.226108 (+456824us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:30.255108 (+1029000us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:30.255881 (+   773us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:30.206089 20202 raft_consensus.cc:2749] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:30.218137 19739 tablet_service.cc:1511] Processing CreateTablet for tablet d7774406b22547d29d9d42c969cf0874 (DEFAULT_TABLE table=default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.260507 20148 ts_tablet_manager.cc:1929] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:30.261025 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7774406b22547d29d9d42c969cf0874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.220124 19741 tablet_service.cc:1558] Processing DeleteTablet for tablet 33e1cc46939b4932a344b81c3bc8ca82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:30.220690 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 158edf7a5d724c88992fecbadd2cedfa (DEFAULT_TABLE table=default.Table_0991384f9b0745a389ad95d24675e413 [id=1ee3d2a1f321486d90ab82e5cef8f3aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.221823 19743 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca0b52215454a99b6c5d1956088829a (DEFAULT_TABLE table=default.Table_d8fa3c5311e74d20aa00d9acb400810f [id=500a88f7dfbc403f9a04f06f9f6f95bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.222648 19740 tablet_service.cc:1511] Processing CreateTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f (DEFAULT_TABLE table=default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.223927 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (DEFAULT_TABLE table=default.Table_d5185be74c414c8a886b3b5ccebf4cd7 [id=3e43587428fb4c679f8222cf3c30d08d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.223642 19742 tablet_service.cc:1511] Processing CreateTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 (DEFAULT_TABLE table=default.Table_593e8a23ad954f5b8b209830cbd7ccf9 [id=cb3f94a374cd4a21a132791410361924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.223682 19746 tablet_service.cc:1511] Processing CreateTablet for tablet 57a81b9455a340728fea713318e1e77a (DEFAULT_TABLE table=default.Table_a3ed770c6c6f410ba1b6c0db32c665bc [id=49662aab8c5046d2a1f6b7d363da8ada]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.200470 19890 raft_consensus.cc:359] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:30.269529 19890 raft_consensus.cc:385] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:30.269867 19890 raft_consensus.cc:740] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:30.270778 19890 consensus_queue.cc:260] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:29.983462 20147 rpcz_store.cc:276] 0928 01:55:26.706235 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.706950 (+   715us) service_pool.cc:224] Handling call
0928 01:55:28.377611 (+1670661us) ts_tablet_manager.cc:1151] Deleting tablet ad62475da6e74fb4971837a018e77c1c
0928 01:55:28.377680 (+    69us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:28.619659 (+241979us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:29.131682 (+512023us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:29.981672 (+849990us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1636275}
I20260928 01:55:30.245033 20213 leader_election.cc:290] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:30.252965 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:30.272631 19617 raft_consensus.cc:2468] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:30.280236 19110 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_d5185be74c414c8a886b3b5ccebf4cd7" } new_table_name: "default.Table_b84c85e1d5154100a2dea07591b9a420" modify_external_catalogs: true
I20260928 01:55:30.280565 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_67ac9fd1d2164b478671c2457c12241a"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:30.283735 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67ac9fd1d2164b478671c2457c12241a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:30.284637 20147 tablet_replica.cc:333] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:30.298105 20148 log.cc:1199] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/ad62475da6e74fb4971837a018e77c1c
I20260928 01:55:30.299399 20148 ts_tablet_manager.cc:1950] T ad62475da6e74fb4971837a018e77c1c P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:30.300611 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 65) took 3599 ms. Trace:
I20260928 01:55:30.300889 19890 ts_tablet_manager.cc:1434] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.858s	user 0.008s	sys 0.006s
W20260928 01:55:30.301316 19890 ts_tablet_manager.cc:1467] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: Tablet startup took 858ms
W20260928 01:55:30.301716 19890 ts_tablet_manager.cc:1469] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: Trace:
0928 01:55:25.955608 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:25.955781 (+   173us) service_pool.cc:224] Handling call
0928 01:55:25.958157 (+  2376us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:25.958361 (+   204us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:25.980946 (+ 22585us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:26.012546 (+ 31600us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:26.013061 (+   515us) inbound_call.cc:177] Queueing success response
0928 01:55:28.573391 (+2560330us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0928 01:55:29.443345 (+869954us) ts_tablet_manager.cc:1435] Starting tablet replica
0928 01:55:29.676704 (+233359us) tablet_replica.cc:261] Starting instrumentation
0928 01:55:29.745816 (+ 69112us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":2526,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":286,"tablet-open.queue_time_us":2560425}
I20260928 01:55:30.307817 20147 raft_consensus.cc:2243] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:30.308609 20147 raft_consensus.cc:2272] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:30.311544 20147 ts_tablet_manager.cc:1916] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:30.322525 20230 raft_consensus.cc:515] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:30.324877 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158edf7a5d724c88992fecbadd2cedfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.336164 19111 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_2c6a423a3158495a98d244242381a423" } modify_external_catalogs: true
I20260928 01:55:30.336850 19111 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_2c6a423a3158495a98d244242381a423" } modify_external_catalogs: true
W20260928 01:55:30.348526 19598 consensus_meta.cc:287] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.665s	user 0.014s	sys 0.002s
I20260928 01:55:30.352700 19598 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47670 (request call id 94) took 1397 ms. Trace:
I20260928 01:55:30.352841 19118 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 142) took 1049 ms. Trace:
I20260928 01:55:30.353196 19118 rpcz_store.cc:276] 0928 01:55:29.303848 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:29.872442 (+568594us) service_pool.cc:224] Handling call
0928 01:55:29.879405 (+  6963us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:29.882607 (+  3202us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:30.352133 (+469526us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:55:30.352478 (+   345us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:55:30.352769 (+   291us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:30.024447 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:30.024823 (+   376us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:30.024850 (+    27us) write_op.cc:435] Acquired schema lock
0928 01:55:30.024863 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:30.025146 (+   283us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:30.025190 (+    44us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:30.025217 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:30.025410 (+   193us) tablet.cc:701] Row locks acquired
0928 01:55:30.025424 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:30.025541 (+   117us) write_op.cc:270] Start()
0928 01:55:30.025622 (+    81us) write_op.cc:276] Timestamp: P: 1790560530025479 usec, L: 0
0928 01:55:30.025650 (+    28us) op_driver.cc:348] REPLICATION: starting
0928 01:55:30.026352 (+   702us) log.cc:844] Serialized 433 byte log entry
0928 01:55:30.348166 (+321814us) op_driver.cc:464] REPLICATION: finished
0928 01:55:30.349155 (+   989us) write_op.cc:301] APPLY: starting
0928 01:55:30.349220 (+    65us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:30.349342 (+   122us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:30.349451 (+   109us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:30.350204 (+   753us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:30.350489 (+   285us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:55:30.350560 (+    71us) write_op.cc:312] APPLY: finished
0928 01:55:30.350867 (+   307us) log.cc:844] Serialized 29 byte log entry
0928 01:55:30.351698 (+   831us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:30.351805 (+   107us) write_op.cc:454] Released schema lock
0928 01:55:30.351857 (+    52us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":770,"mutex_wait_us":15731,"num_ops":2,"prepare.queue_time_us":15851,"prepare.run_cpu_time_us":1999,"prepare.run_wall_time_us":3087,"replication_time_us":322408}]]}
I20260928 01:55:30.229539 19450 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 94) took 1293 ms. Trace:
I20260928 01:55:30.364493 19450 rpcz_store.cc:276] 0928 01:55:28.935863 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.940419 (+  4556us) service_pool.cc:224] Handling call
0928 01:55:28.942647 (+  2228us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:28.942790 (+   143us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:29.767863 (+825073us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:30.228746 (+460883us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:30.229453 (+   707us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 01:55:30.236351 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 69145.8us
I20260928 01:55:30.242496 19455 tablet_service.cc:1558] Processing DeleteTablet for tablet 33e1cc46939b4932a344b81c3bc8ca82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:30.243201 19447 tablet_service.cc:1511] Processing CreateTablet for tablet d7774406b22547d29d9d42c969cf0874 (DEFAULT_TABLE table=default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.367133 19447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7774406b22547d29d9d42c969cf0874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.243546 19454 tablet_service.cc:1511] Processing CreateTablet for tablet 158edf7a5d724c88992fecbadd2cedfa (DEFAULT_TABLE table=default.Table_0991384f9b0745a389ad95d24675e413 [id=1ee3d2a1f321486d90ab82e5cef8f3aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.368928 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158edf7a5d724c88992fecbadd2cedfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.242663 19453 tablet_service.cc:1511] Processing CreateTablet for tablet 45d8d07b367b4fafbd7171f8ea7b2a26 (DEFAULT_TABLE table=default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.373281 19453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d8d07b367b4fafbd7171f8ea7b2a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.373468 20148 rpcz_store.cc:276] 0928 01:55:26.701283 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.701467 (+   184us) service_pool.cc:224] Handling call
0928 01:55:28.470816 (+1769349us) ts_tablet_manager.cc:1151] Deleting tablet ad62475da6e74fb4971837a018e77c1c
0928 01:55:28.470905 (+    89us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:29.334353 (+863448us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:30.246129 (+911776us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:30.300525 (+ 54396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8583,"tablet-delete.queue_time_us":1768693}
I20260928 01:55:30.375626 20148 tablet_replica.cc:333] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:30.244535 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca0b52215454a99b6c5d1956088829a (DEFAULT_TABLE table=default.Table_d8fa3c5311e74d20aa00d9acb400810f [id=500a88f7dfbc403f9a04f06f9f6f95bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.376888 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca0b52215454a99b6c5d1956088829a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.377269 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 57a81b9455a340728fea713318e1e77a (DEFAULT_TABLE table=default.Table_a3ed770c6c6f410ba1b6c0db32c665bc [id=49662aab8c5046d2a1f6b7d363da8ada]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.378233 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a81b9455a340728fea713318e1e77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.387395 20148 raft_consensus.cc:2243] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:30.388249 20148 raft_consensus.cc:2272] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:30.402033 20148 ts_tablet_manager.cc:1916] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:30.161226 19896 ts_tablet_manager.cc:1434] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.632s	user 0.011s	sys 0.000s
I20260928 01:55:30.347990 19446 tablet_service.cc:1511] Processing CreateTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 (DEFAULT_TABLE table=default.Table_593e8a23ad954f5b8b209830cbd7ccf9 [id=cb3f94a374cd4a21a132791410361924]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:30.403053 19896 ts_tablet_manager.cc:1467] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614: Tablet startup took 873ms
I20260928 01:55:30.404021 19446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22606f012f1c44bd92c8e0341e9ca2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.349929 19451 tablet_service.cc:1511] Processing CreateTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f (DEFAULT_TABLE table=default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.351583 19448 tablet_service.cc:1511] Processing CreateTablet for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (DEFAULT_TABLE table=default.Table_d5185be74c414c8a886b3b5ccebf4cd7 [id=3e43587428fb4c679f8222cf3c30d08d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.409437 19448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2156dae74ee748cd845b6dea1d3b8ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.413331 19451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c320eb2ca2ac4ac68293ef8f7400b45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.227285 19476 raft_consensus.cc:2468] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
W20260928 01:55:30.404407 19896 ts_tablet_manager.cc:1469] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614: Trace:
0928 01:55:25.327708 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:25.327925 (+   217us) service_pool.cc:224] Handling call
0928 01:55:25.330203 (+  2278us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:25.330336 (+   133us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:25.475767 (+145431us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:25.678757 (+202990us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:25.741095 (+ 62338us) inbound_call.cc:177] Queueing success response
0928 01:55:28.762755 (+3021660us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0928 01:55:29.529163 (+766408us) ts_tablet_manager.cc:1435] Starting tablet replica
0928 01:55:29.809223 (+280060us) tablet_replica.cc:261] Starting instrumentation
0928 01:55:29.812240 (+  3017us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":485,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":348,"tablet-open.queue_time_us":3022016}
I20260928 01:55:30.432019 19896 tablet_bootstrap.cc:492] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:30.437901 19747 tablet_service.cc:1511] Processing CreateTablet for tablet d0cb771766b44b149d3ed3ddf75a7474 (DEFAULT_TABLE table=default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.439271 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2156dae74ee748cd845b6dea1d3b8ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.443879 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca0b52215454a99b6c5d1956088829a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.447178 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet ad62475da6e74fb4971837a018e77c1c (table default.Table_7be970fbb13745978e6b90a9a7d84fb7 [id=8b8c2a287da9417fb0cb7f12a676abcf]) successfully deleted
I20260928 01:55:30.449016 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c320eb2ca2ac4ac68293ef8f7400b45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.451069 19747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cb771766b44b149d3ed3ddf75a7474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.452944 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22606f012f1c44bd92c8e0341e9ca2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.304124 19890 tablet_bootstrap.cc:492] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:30.457580 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a81b9455a340728fea713318e1e77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.455026 19598 rpcz_store.cc:276] 0928 01:55:28.954968 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:29.006819 (+ 51851us) service_pool.cc:224] Handling call
0928 01:55:29.009869 (+  3050us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:29.010101 (+   232us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:29.673819 (+663718us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:30.351943 (+678124us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:30.352615 (+   672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:30.463052 19595 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47670 (request call id 93) took 1564 ms. Trace:
I20260928 01:55:30.480234 19767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.2:59399 (request call id 48) took 1030 ms. Trace:
I20260928 01:55:30.480156 19596 tablet_service.cc:1511] Processing CreateTablet for tablet 45d8d07b367b4fafbd7171f8ea7b2a26 (DEFAULT_TABLE table=default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.481524 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d8d07b367b4fafbd7171f8ea7b2a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.480787 19767 rpcz_store.cc:276] 0928 01:55:29.449852 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:29.450000 (+   148us) service_pool.cc:224] Handling call
0928 01:55:29.450815 (+   815us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 01:55:29.452050 (+  1235us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 01:55:29.452099 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 01:55:29.466272 (+ 14173us) log.cc:844] Serialized 26 byte log entry
0928 01:55:29.540889 (+ 74617us) raft_consensus.cc:1645] Marking committed up to 0
0928 01:55:29.540964 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:55:29.549814 (+  8850us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:55:30.479805 (+929991us) raft_consensus.cc:1685] finished
0928 01:55:30.479824 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:55:30.480010 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":725,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":212,"thread_start_us":73635,"threads_started":1,"wal-append.queue_time_us":186408}
I20260928 01:55:30.483698 19116 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 143) took 1080 ms. Trace:
I20260928 01:55:30.484045 19116 rpcz_store.cc:276] 0928 01:55:29.403083 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.047896 (+644813us) service_pool.cc:224] Handling call
0928 01:55:30.053700 (+  5804us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:30.060261 (+  6561us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:30.460132 (+399871us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:55:30.483052 (+ 22920us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:55:30.483385 (+   333us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:30.063320 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:30.063715 (+   395us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:30.063739 (+    24us) write_op.cc:435] Acquired schema lock
0928 01:55:30.063751 (+    12us) tablet.cc:662] Decoding operations
0928 01:55:30.064028 (+   277us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:30.064064 (+    36us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:30.064088 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:30.064309 (+   221us) tablet.cc:701] Row locks acquired
0928 01:55:30.064322 (+    13us) write_op.cc:260] PREPARE: finished
0928 01:55:30.064432 (+   110us) write_op.cc:270] Start()
0928 01:55:30.064565 (+   133us) write_op.cc:276] Timestamp: P: 1790560530064394 usec, L: 0
0928 01:55:30.064581 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:55:30.065362 (+   781us) log.cc:844] Serialized 433 byte log entry
0928 01:55:30.456143 (+390781us) op_driver.cc:464] REPLICATION: finished
0928 01:55:30.457920 (+  1777us) write_op.cc:301] APPLY: starting
0928 01:55:30.457990 (+    70us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:30.458157 (+   167us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:30.458374 (+   217us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:30.458941 (+   567us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:30.459181 (+   240us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:55:30.459256 (+    75us) write_op.cc:312] APPLY: finished
0928 01:55:30.459526 (+   270us) log.cc:844] Serialized 29 byte log entry
0928 01:55:30.459771 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:30.459865 (+    94us) write_op.cc:454] Released schema lock
0928 01:55:30.459910 (+    45us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:30.465612 (+  5702us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:30.465655 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":987,"apply.run_cpu_time_us":2293,"apply.run_wall_time_us":2294,"num_ops":2,"prepare.queue_time_us":1891,"prepare.run_cpu_time_us":1986,"prepare.run_wall_time_us":3190,"replication_time_us":391432}]]}
W20260928 01:55:30.487884 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 88844.5us
I20260928 01:55:30.494001 19597 tablet_service.cc:1511] Processing CreateTablet for tablet 158edf7a5d724c88992fecbadd2cedfa (DEFAULT_TABLE table=default.Table_0991384f9b0745a389ad95d24675e413 [id=1ee3d2a1f321486d90ab82e5cef8f3aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.495306 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158edf7a5d724c88992fecbadd2cedfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.496703 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet 33e1cc46939b4932a344b81c3bc8ca82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:30.497936 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca0b52215454a99b6c5d1956088829a (DEFAULT_TABLE table=default.Table_d8fa3c5311e74d20aa00d9acb400810f [id=500a88f7dfbc403f9a04f06f9f6f95bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.499006 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca0b52215454a99b6c5d1956088829a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.500912 19599 tablet_service.cc:1511] Processing CreateTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 (DEFAULT_TABLE table=default.Table_593e8a23ad954f5b8b209830cbd7ccf9 [id=cb3f94a374cd4a21a132791410361924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.501932 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22606f012f1c44bd92c8e0341e9ca2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.167654 20194 raft_consensus.cc:515] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:30.522457 19598 tablet_service.cc:1511] Processing CreateTablet for tablet d7774406b22547d29d9d42c969cf0874 (DEFAULT_TABLE table=default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.523736 19598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7774406b22547d29d9d42c969cf0874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.388491 20067 raft_consensus.cc:493] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:30.528995 19600 tablet_service.cc:1511] Processing CreateTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f (DEFAULT_TABLE table=default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.530086 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c320eb2ca2ac4ac68293ef8f7400b45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.532338 20134 raft_consensus.cc:2749] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:30.542634 19593 tablet_service.cc:1511] Processing CreateTablet for tablet 57a81b9455a340728fea713318e1e77a (DEFAULT_TABLE table=default.Table_a3ed770c6c6f410ba1b6c0db32c665bc [id=49662aab8c5046d2a1f6b7d363da8ada]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.543884 19593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a81b9455a340728fea713318e1e77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.563515 19896 tablet_bootstrap.cc:654] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:30.572711 19594 tablet_service.cc:1511] Processing CreateTablet for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (DEFAULT_TABLE table=default.Table_d5185be74c414c8a886b3b5ccebf4cd7 [id=3e43587428fb4c679f8222cf3c30d08d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.575944 19594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2156dae74ee748cd845b6dea1d3b8ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.548697 20067 raft_consensus.cc:515] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:30.592276 19454 tablet_service.cc:1511] Processing CreateTablet for tablet d0cb771766b44b149d3ed3ddf75a7474 (DEFAULT_TABLE table=default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.594523 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d40050f85a4d6c90a4ce35cf15d134" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:30.595310 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cb771766b44b149d3ed3ddf75a7474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.594031 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 675e1e1f2630411f8b070d8ca99e8ffb (DEFAULT_TABLE table=default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.603256 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675e1e1f2630411f8b070d8ca99e8ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.463539 19595 rpcz_store.cc:276] 0928 01:55:28.899128 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.900893 (+  1765us) service_pool.cc:224] Handling call
0928 01:55:29.025146 (+124253us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:29.025304 (+   158us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:29.965341 (+940037us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:30.462232 (+496891us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:30.462881 (+   649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:30.654140 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 675e1e1f2630411f8b070d8ca99e8ffb (DEFAULT_TABLE table=default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.661166 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675e1e1f2630411f8b070d8ca99e8ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.664479 19747 tablet_service.cc:1558] Processing DeleteTablet for tablet 027f99abaacc4c169661e7db08512ebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:28 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:30.677987 20067 leader_election.cc:290] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:30.690670 19592 tablet_service.cc:1511] Processing CreateTablet for tablet 675e1e1f2630411f8b070d8ca99e8ffb (DEFAULT_TABLE table=default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:30.700163 19110 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2156dae74ee748cd845b6dea1d3b8ea8 consensus state has no leader
I20260928 01:55:30.701188 19450 tablet_service.cc:1558] Processing DeleteTablet for tablet 027f99abaacc4c169661e7db08512ebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:28 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:30.606118 20148 ts_tablet_manager.cc:1929] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:30.615274 20134 consensus_queue.cc:1048] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:30.616465 19412 leader_election.cc:343] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 952df055998942f89baabb341e204f43
I20260928 01:55:30.745071 19595 tablet_service.cc:1511] Processing CreateTablet for tablet d0cb771766b44b149d3ed3ddf75a7474 (DEFAULT_TABLE table=default.Table_7ed5dc038aaf4cceace845ff6e55d1a9 [id=504c0a60661340feb59f8cb73a219305]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:30.752444 19103 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_b84c85e1d5154100a2dea07591b9a420 [id=3e43587428fb4c679f8222cf3c30d08d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2156dae74ee748cd845b6dea1d3b8ea8 consensus state has no leader
I20260928 01:55:30.758879 19621 raft_consensus.cc:1275] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:55:30.762226 19890 tablet_bootstrap.cc:654] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:30.773285 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675e1e1f2630411f8b070d8ca99e8ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.778513 19591 tablet_service.cc:1558] Processing DeleteTablet for tablet 027f99abaacc4c169661e7db08512ebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:28 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:30.781929 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet a43cfb32bd0043049cbdb2faaf10409f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:30.829074 19118 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_bd232d1bc78e49f4a9925680a33c9caa" } new_table_name: "default.Table_2171ab69dd564f6897eb22381bb0a5b6" modify_external_catalogs: true
I20260928 01:55:30.829228 20067 consensus_queue.cc:1048] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:30.832273 19595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cb771766b44b149d3ed3ddf75a7474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.844166 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_501342eaebce40d1a76ace4b05f022fd"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:30.846052 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_fa2cc70b96124fedb7f77c2fd58c9d89"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:30.847869 19116 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_9ebdf86862884825a8be67c95fd3f412" } modify_external_catalogs: true
I20260928 01:55:30.856737 19116 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_9ebdf86862884825a8be67c95fd3f412" } modify_external_catalogs: true
W20260928 01:55:30.869393 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa2cc70b96124fedb7f77c2fd58c9d89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:30.907611 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_501342eaebce40d1a76ace4b05f022fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:30.908403 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 83185.2us
I20260928 01:55:30.909173 19556 leader_election.cc:304] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:30.916811 20067 raft_consensus.cc:2804] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:30.917501 20067 raft_consensus.cc:697] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:30.918466 20067 consensus_queue.cc:237] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:30.926040 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc63ccbe4e84373aabe3009cc3d2568" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:30.942596 19890 tablet_bootstrap.cc:492] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:30.943235 19890 ts_tablet_manager.cc:1403] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.639s	user 0.012s	sys 0.008s
I20260928 01:55:30.946143 19890 raft_consensus.cc:359] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:30.947154 19890 raft_consensus.cc:385] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:30.947515 19890 raft_consensus.cc:740] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:30.970715 19112 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet ce41f63df46f4d0493ca22a13daadb4f (table default.Table_f74d6b5e81d2457b88ab4456aa43c249 [id=9e114860728146b097bcfce77a95f9d0]). Expected version 2 got 0
I20260928 01:55:30.971796 19112 catalog_manager.cc:5838] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 2, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:55:30.974462 19112 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:30.976043 19112 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet eaa1e9b7119d46a2ba2652a893877c8c (table default.Table_9ebdf86862884825a8be67c95fd3f412 [id=2961b396aa0e488e8440ed77d774588c]). Expected version 3 got 0
I20260928 01:55:30.976979 19890 consensus_queue.cc:260] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:30.978482 19112 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_2916b0cc0e3f4f4c97b4c2439e47cb91 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]). Expected version 2 got 0
I20260928 01:55:30.979492 19590 tablet_service.cc:1511] Processing CreateTablet for tablet 0287060a8d054b15b2252dcf280ca8c2 (DEFAULT_TABLE table=default.Table_9e19d07c34de4423843f6dd98c821031 [id=3ea8fb9803ee49dbaa28e73ebafebaf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:30.980979 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0287060a8d054b15b2252dcf280ca8c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:30.983984 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 33e1cc46939b4932a344b81c3bc8ca82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33e1cc46939b4932a344b81c3bc8ca82 already in progress: creating tablet
I20260928 01:55:30.999233 19600 tablet_service.cc:1511] Processing CreateTablet for tablet c9f3e966ab0d46d187fb9daa356b16fc (DEFAULT_TABLE table=default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.000792 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f3e966ab0d46d187fb9daa356b16fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:31.017273 19455 consensus_meta.cc:287] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
I20260928 01:55:31.019760 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_06429efed97f45e3a85c5c07ab33b50f"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:31.027571 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06429efed97f45e3a85c5c07ab33b50f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:31.033175 19890 ts_tablet_manager.cc:1434] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.001s
I20260928 01:55:31.034216 19890 tablet_bootstrap.cc:492] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:31.039237 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 50347us
I20260928 01:55:30.788838 20148 log.cc:1199] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/a43cfb32bd0043049cbdb2faaf10409f
I20260928 01:55:31.047143 20148 ts_tablet_manager.cc:1950] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:31.048101 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 66) took 4333 ms. Trace:
I20260928 01:55:31.048594 20148 rpcz_store.cc:276] 0928 01:55:26.715148 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.715331 (+   183us) service_pool.cc:224] Handling call
0928 01:55:30.375391 (+3660060us) ts_tablet_manager.cc:1151] Deleting tablet a43cfb32bd0043049cbdb2faaf10409f
0928 01:55:30.375456 (+    65us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:30.534788 (+159332us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:30.605890 (+ 71102us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.047967 (+442077us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9667,"tablet-delete.queue_time_us":3659322}
I20260928 01:55:30.973634 20239 tablet_replica.cc:333] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:30.978677 19747 tablet_service.cc:1511] Processing CreateTablet for tablet c9f3e966ab0d46d187fb9daa356b16fc (DEFAULT_TABLE table=default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.057942 19747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f3e966ab0d46d187fb9daa356b16fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:30.980188 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 0287060a8d054b15b2252dcf280ca8c2 (DEFAULT_TABLE table=default.Table_9e19d07c34de4423843f6dd98c821031 [id=3ea8fb9803ee49dbaa28e73ebafebaf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.065176 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0287060a8d054b15b2252dcf280ca8c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:30.801497 20029 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.147s	sys 0.270s
W20260928 01:55:31.066994 20029 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.389s	user 0.149s	sys 0.279s
I20260928 01:55:31.068188 19109 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_7ed5dc038aaf4cceace845ff6e55d1a9" } new_table_name: "default.Table_26d5ae1cf8d444c2b34571d43922ff0a" modify_external_catalogs: true
I20260928 01:55:31.078303 20029 tablet_bootstrap.cc:492] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:31.078837 20029 ts_tablet_manager.cc:1403] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 1.447s	user 0.165s	sys 0.283s
I20260928 01:55:31.083086 20029 raft_consensus.cc:359] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:31.083829 20029 raft_consensus.cc:385] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:30.985983 20194 leader_election.cc:290] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:30.987234 20230 leader_election.cc:290] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:31.097401 20239 raft_consensus.cc:2243] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:31.100797 20249 raft_consensus.cc:493] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:55:31.101521 20249 raft_consensus.cc:515] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:31.118431 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 78409.6us
I20260928 01:55:31.144490 20239 raft_consensus.cc:2272] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:31.147375 20239 ts_tablet_manager.cc:1916] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:31.033967 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet 457837143b0f4763a4b91bb25b580477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:44964
W20260928 01:55:31.107993 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 204682us
I20260928 01:55:31.116554 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet efa8a7589d314c25aeccf678c938ecf0 with delete_type TABLET_DATA_DELETED (replaced by tablet 2156dae74ee748cd845b6dea1d3b8ea8) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:30.990222 20227 consensus_queue.cc:1048] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:31.084079 20029 raft_consensus.cc:740] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:31.166512 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:31.169135 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:31.169898 19621 raft_consensus.cc:3060] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:31.170949 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_21e19e0229e74ecba58c719d9d48d826"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:30.797295 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 180776us
W20260928 01:55:31.173842 19412 leader_election.cc:343] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: a43cfb32bd0043049cbdb2faaf10409f
W20260928 01:55:31.174749 19412 leader_election.cc:343] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: Tablet not RUNNING: STOPPED
W20260928 01:55:31.175442 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21e19e0229e74ecba58c719d9d48d826 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:31.176424 20134 consensus_queue.cc:1048] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:31.179437 19449 consensus_meta.cc:287] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.932s	user 0.007s	sys 0.002s
I20260928 01:55:31.180807 19449 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 97) took 2077 ms. Trace:
I20260928 01:55:31.181272 19449 rpcz_store.cc:276] 0928 01:55:29.104749 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:29.105591 (+   842us) service_pool.cc:224] Handling call
0928 01:55:29.117698 (+ 12107us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:29.118379 (+   681us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:30.247379 (+1129000us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.180026 (+932647us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:31.180733 (+   707us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:31.157826 20029 consensus_queue.cc:260] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:31.186527 20029 ts_tablet_manager.cc:1434] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.107s	user 0.005s	sys 0.005s
I20260928 01:55:31.188146 20029 tablet_bootstrap.cc:492] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:55:31.164390 19703 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.Ping -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 51122.4us
I20260928 01:55:31.192137 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet ad62475da6e74fb4971837a018e77c1c (table default.Table_7be970fbb13745978e6b90a9a7d84fb7 [id=8b8c2a287da9417fb0cb7f12a676abcf]) successfully deleted
I20260928 01:55:31.193451 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet a43cfb32bd0043049cbdb2faaf10409f (table default.Table_a47ad43bf23c4fa8b30c2aa4a8d66767 [id=63a3b65b060345c8811e85383a3d6dbe]) successfully deleted
W20260928 01:55:31.199565 19453 consensus_meta.cc:287] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.000s
I20260928 01:55:31.202831 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 0287060a8d054b15b2252dcf280ca8c2 (DEFAULT_TABLE table=default.Table_9e19d07c34de4423843f6dd98c821031 [id=3ea8fb9803ee49dbaa28e73ebafebaf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.204444 19621 raft_consensus.cc:2468] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:31.205449 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0287060a8d054b15b2252dcf280ca8c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:31.206888 20256 raft_consensus.cc:493] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:31.207521 20256 raft_consensus.cc:515] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:31.211122 20256 leader_election.cc:290] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:31.212620 20134 raft_consensus.cc:493] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:55:31.213476 20134 raft_consensus.cc:515] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:31.222805 19449 tablet_service.cc:1511] Processing CreateTablet for tablet c9f3e966ab0d46d187fb9daa356b16fc (DEFAULT_TABLE table=default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.225298 19449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f3e966ab0d46d187fb9daa356b16fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:31.240736 19411 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.006s	sys 0.007s
W20260928 01:55:31.241307 19411 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.006s	sys 0.007s
I20260928 01:55:31.255066 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:31.256140 19473 raft_consensus.cc:2393] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:31.259774 20134 leader_election.cc:290] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:31.271685 19114 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:31.273065 19114 catalog_manager.cc:5838] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:55:31.274616 19114 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet ce41f63df46f4d0493ca22a13daadb4f (table default.Table_f74d6b5e81d2457b88ab4456aa43c249 [id=9e114860728146b097bcfce77a95f9d0]). Expected version 2 got 0
I20260928 01:55:31.275303 19114 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_2916b0cc0e3f4f4c97b4c2439e47cb91 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]). Expected version 2 got 0
I20260928 01:55:31.286229 19117 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba] alter complete (version 2)
W20260928 01:55:31.294788 19115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 30) took 3661 ms (client timeout 1000 ms). Trace:
W20260928 01:55:31.295157 19115 rpcz_store.cc:269] 0928 01:55:27.633037 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.688668 (+ 55631us) service_pool.cc:224] Handling call
0928 01:55:31.294701 (+3606033us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26214,"reported_tablets":17}
I20260928 01:55:31.295682 20148 tablet_replica.cc:333] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:31.299580 19111 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 05f875e126f04415a108f778a76bb0f5
I20260928 01:55:31.303350 19452 tablet_service.cc:1558] Processing DeleteTablet for tablet a43cfb32bd0043049cbdb2faaf10409f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:31.304728 19452 tablet_service.cc:1558] Processing DeleteTablet for tablet ad62475da6e74fb4971837a018e77c1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:24 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:31.305894 19452 tablet_service.cc:1558] Processing DeleteTablet for tablet 457837143b0f4763a4b91bb25b580477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:31.307365 19453 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dd4743c49314e8b8d86e1c6e553b13e with delete_type TABLET_DATA_DELETED (replaced by tablet 33e1cc46939b4932a344b81c3bc8ca82) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:31.308367 19455 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e902da355b641868c207fc26578b739 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:23 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:31.310094 19111 master_service.cc:960] ReplaceTablet: received request to replace tablet 027f99abaacc4c169661e7db08512ebd from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:31.314284 19116 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet eaa1e9b7119d46a2ba2652a893877c8c
I20260928 01:55:31.316808 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_7fd82b0e9ca64b8e9d4a715fe2957472"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:31.318686 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:31.323199 19117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 15) took 2498 ms (client timeout 1000 ms). Trace:
W20260928 01:55:31.323688 19117 rpcz_store.cc:269] 0928 01:55:28.825115 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.825296 (+   181us) service_pool.cc:224] Handling call
0928 01:55:31.323113 (+2497817us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:30.072728 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:30.073118 (+   390us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:30.073141 (+    23us) write_op.cc:435] Acquired schema lock
0928 01:55:30.073153 (+    12us) tablet.cc:662] Decoding operations
0928 01:55:30.073390 (+   237us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:30.073425 (+    35us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:30.073447 (+    22us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:30.073583 (+   136us) tablet.cc:701] Row locks acquired
0928 01:55:30.073596 (+    13us) write_op.cc:260] PREPARE: finished
0928 01:55:30.073708 (+   112us) write_op.cc:270] Start()
0928 01:55:30.073786 (+    78us) write_op.cc:276] Timestamp: P: 1790560530073672 usec, L: 0
0928 01:55:30.073802 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:55:30.074300 (+   498us) log.cc:844] Serialized 356 byte log entry
0928 01:55:30.457052 (+382752us) op_driver.cc:464] REPLICATION: finished
0928 01:55:30.460397 (+  3345us) write_op.cc:301] APPLY: starting
0928 01:55:30.460465 (+    68us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:30.460635 (+   170us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:30.460781 (+   146us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:30.460989 (+   208us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:30.461220 (+   231us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:30.461291 (+    71us) write_op.cc:312] APPLY: finished
0928 01:55:30.461538 (+   247us) log.cc:844] Serialized 23 byte log entry
0928 01:55:30.461755 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:30.461828 (+    73us) write_op.cc:454] Released schema lock
0928 01:55:30.461873 (+    45us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:30.462233 (+   360us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:30.462271 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8381,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":3141,"apply.run_cpu_time_us":1744,"apply.run_wall_time_us":1743,"num_ops":1,"prepare.queue_time_us":3139,"prepare.run_cpu_time_us":1781,"prepare.run_wall_time_us":1780,"replication_time_us":383134}]]}
W20260928 01:55:31.336527 19553 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 173955us
W20260928 01:55:31.334293 19118 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77c1f247486548ee9747403f7f80e3dc consensus state has no leader
I20260928 01:55:31.352901 19746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44964 (request call id 114) took 1131 ms. Trace:
I20260928 01:55:31.354228 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_39b9aad9829442b6989cad988795904c"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:31.355877 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39b9aad9829442b6989cad988795904c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:31.337121 19112 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 16) took 1001 ms (client timeout 1000 ms). Trace:
W20260928 01:55:31.338024 19109 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d0cb771766b44b149d3ed3ddf75a7474 consensus state has no leader
I20260928 01:55:31.379292 19601 tablet_service.cc:1558] Processing DeleteTablet for tablet eaa1e9b7119d46a2ba2652a893877c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:30 UTC) from {username='slave'} at 127.0.0.1:47670
W20260928 01:55:31.379678 19556 leader_election.cc:343] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:31.380657 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_a779e68b4b3c4061a02f75a23a7f97d7"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:31.383697 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a779e68b4b3c4061a02f75a23a7f97d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:31.348001 19113 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 31) took 1881 ms (client timeout 1000 ms). Trace:
I20260928 01:55:31.353681 19746 rpcz_store.cc:276] 0928 01:55:30.221388 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.221971 (+   583us) service_pool.cc:224] Handling call
0928 01:55:30.318102 (+ 96131us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5800000f98. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a19fae8a1 00007f0a1a0f2b51 00007f0a1a0f2a02 00007f0a2303d119 00007f0a22277a70 00007f0a2235ce61 00007f0a2233a0f3 00007f0a222e8640 00007f0a20872bf4 00007f0a20872b82 00007f0a20872ab1
0928 01:55:30.456910 (+138808us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.457041 (+   131us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:31.040754 (+583713us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.344731 (+303977us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:31.352716 (+  7985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432768}
W20260928 01:55:31.368458 19112 rpcz_store.cc:269] 0928 01:55:30.335981 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.340547 (+  4566us) service_pool.cc:224] Handling call
0928 01:55:31.337034 (+996487us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:31.074338 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:31.074780 (+   442us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:31.074806 (+    26us) write_op.cc:435] Acquired schema lock
0928 01:55:31.074820 (+    14us) tablet.cc:662] Decoding operations
0928 01:55:31.075116 (+   296us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:31.075161 (+    45us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:31.075186 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:31.075353 (+   167us) tablet.cc:701] Row locks acquired
0928 01:55:31.075367 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:31.075506 (+   139us) write_op.cc:270] Start()
0928 01:55:31.075598 (+    92us) write_op.cc:276] Timestamp: P: 1790560531075468 usec, L: 0
0928 01:55:31.075616 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:55:31.076235 (+   619us) log.cc:844] Serialized 530 byte log entry
0928 01:55:31.101582 (+ 25347us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b5400030d98. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b6aa1 00007f19fd709f75 00007f19fd70a0c2 00007f19fd6c67bf 00007f19fd6a73da 00007f19fd6ae283 00007f19fd6ae209 00007f19fd6ae199 00007f19fd6ae161 00007f19fd6ad32d 00000000005bd4e4
0928 01:55:31.125670 (+ 24088us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b58000428d0. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd6a796c 00007f19fd6ae283 00007f19fd6ae209 00007f19fd6ae199 00007f19fd6ae161 00007f19fd6ad32d 00000000005bd4e4 00000000005bd319 00007f19f65eb3e5 00007f19f65ed751
0928 01:55:31.126185 (+   515us) op_driver.cc:464] REPLICATION: finished
0928 01:55:31.126549 (+   364us) write_op.cc:301] APPLY: starting
0928 01:55:31.126659 (+   110us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:31.126825 (+   166us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:31.126865 (+    40us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:31.127119 (+   254us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:31.127364 (+   245us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:31.127447 (+    83us) write_op.cc:312] APPLY: finished
0928 01:55:31.127767 (+   320us) log.cc:844] Serialized 23 byte log entry
0928 01:55:31.128033 (+   266us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:31.128140 (+   107us) write_op.cc:454] Released schema lock
0928 01:55:31.128193 (+    53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":141,"apply.run_cpu_time_us":1966,"apply.run_wall_time_us":1965,"num_ops":1,"prepare.queue_time_us":93146,"prepare.run_cpu_time_us":2419,"prepare.run_wall_time_us":14235,"raft.queue_time_us":204,"raft.run_cpu_time_us":5107,"raft.run_wall_time_us":52176,"replication_time_us":50417,"spinlock_wait_cycles":111276160}]]}
W20260928 01:55:31.390887 19113 rpcz_store.cc:269] 0928 01:55:29.467132 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:29.715359 (+248227us) service_pool.cc:224] Handling call
0928 01:55:29.789902 (+ 74543us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:31.347911 (+1558009us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:30.208640 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:30.209042 (+   402us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:30.209065 (+    23us) write_op.cc:435] Acquired schema lock
0928 01:55:30.209078 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:30.209416 (+   338us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:30.209452 (+    36us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:30.209475 (+    23us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:30.209805 (+   330us) tablet.cc:701] Row locks acquired
0928 01:55:30.209819 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:30.209946 (+   127us) write_op.cc:270] Start()
0928 01:55:30.210042 (+    96us) write_op.cc:276] Timestamp: P: 1790560530209897 usec, L: 0
0928 01:55:30.210058 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:55:30.210610 (+   552us) log.cc:844] Serialized 907 byte log entry
0928 01:55:30.457361 (+246751us) op_driver.cc:464] REPLICATION: finished
0928 01:55:30.462596 (+  5235us) write_op.cc:301] APPLY: starting
0928 01:55:30.462665 (+    69us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:30.462850 (+   185us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:30.463028 (+   178us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:30.463373 (+   345us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:30.463591 (+   218us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:30.463660 (+    69us) write_op.cc:312] APPLY: finished
0928 01:55:30.463903 (+   243us) log.cc:844] Serialized 29 byte log entry
0928 01:55:30.464083 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:30.464185 (+   102us) write_op.cc:454] Released schema lock
0928 01:55:30.465913 (+  1728us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":19,"spinlock_wait_cycles":86195584,"child_traces":[["op",{"apply.queue_time_us":5050,"apply.run_cpu_time_us":1957,"apply.run_wall_time_us":13797,"num_ops":2,"prepare.queue_time_us":28980,"prepare.run_cpu_time_us":2276,"prepare.run_wall_time_us":2276,"raft.queue_time_us":1691,"raft.run_cpu_time_us":36,"raft.run_wall_time_us":37,"replication_time_us":247188,"thread_start_us":236043,"threads_started":1}]]}
I20260928 01:55:31.420951 20249 leader_election.cc:290] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:31.434026 19739 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44964 (request call id 107) took 1223 ms. Trace:
I20260928 01:55:31.434691 19739 rpcz_store.cc:276] 0928 01:55:30.210573 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.216869 (+  6296us) service_pool.cc:224] Handling call
0928 01:55:30.260376 (+ 43507us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.260517 (+   141us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:30.663277 (+402760us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.345769 (+682492us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:31.433933 (+ 88164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:31.445716 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:31.446527 19473 raft_consensus.cc:3060] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:31.453094 19453 tablet_service.cc:1558] Processing DeleteTablet for tablet eaa1e9b7119d46a2ba2652a893877c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:30 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:31.454669 19455 tablet_service.cc:1558] Processing DeleteTablet for tablet 05f875e126f04415a108f778a76bb0f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:30 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:31.457600 19896 tablet_bootstrap.cc:492] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:31.458096 19896 ts_tablet_manager.cc:1403] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 1.026s	user 0.014s	sys 0.013s
I20260928 01:55:31.462497 19436 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:39100 (request call id 38) took 2423 ms. Trace:
I20260928 01:55:31.471735 19475 raft_consensus.cc:1275] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:55:31.480312 20148 raft_consensus.cc:2243] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 01:55:31.481395 19114 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 27) took 1034 ms (client timeout 1000 ms). Trace:
W20260928 01:55:31.487088 19592 consensus_meta.cc:287] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.004s
W20260928 01:55:31.486119 19114 rpcz_store.cc:269] 0928 01:55:30.447130 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.448017 (+   887us) service_pool.cc:224] Handling call
0928 01:55:31.481298 (+1033281us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:31.392231 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:31.392643 (+   412us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:31.392668 (+    25us) write_op.cc:435] Acquired schema lock
0928 01:55:31.392681 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:31.392942 (+   261us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:31.392981 (+    39us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:31.393003 (+    22us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:31.393150 (+   147us) tablet.cc:701] Row locks acquired
0928 01:55:31.393164 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:31.393279 (+   115us) write_op.cc:270] Start()
0928 01:55:31.393359 (+    80us) write_op.cc:276] Timestamp: P: 1790560531393230 usec, L: 0
0928 01:55:31.393373 (+    14us) op_driver.cc:348] REPLICATION: starting
0928 01:55:31.393955 (+   582us) log.cc:844] Serialized 530 byte log entry
0928 01:55:31.453862 (+ 59907us) op_driver.cc:464] REPLICATION: finished
0928 01:55:31.455756 (+  1894us) write_op.cc:301] APPLY: starting
0928 01:55:31.455858 (+   102us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:31.456032 (+   174us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:31.456234 (+   202us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:31.456482 (+   248us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:31.456712 (+   230us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:31.456795 (+    83us) write_op.cc:312] APPLY: finished
0928 01:55:31.457091 (+   296us) log.cc:844] Serialized 23 byte log entry
0928 01:55:31.457318 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:31.457391 (+    73us) write_op.cc:454] Released schema lock
0928 01:55:31.457442 (+    51us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:31.457778 (+   336us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:31.457820 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":1566,"apply.run_cpu_time_us":1953,"apply.run_wall_time_us":1954,"num_ops":1,"prepare.queue_time_us":40735,"prepare.run_cpu_time_us":2022,"prepare.run_wall_time_us":24514,"replication_time_us":60321}]]}
I20260928 01:55:31.516743 19109 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_1d40de09d743485db2f538534e097074" } modify_external_catalogs: true
I20260928 01:55:31.517598 19109 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_1d40de09d743485db2f538534e097074" } modify_external_catalogs: true
I20260928 01:55:31.541318 19114 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_f74d6b5e81d2457b88ab4456aa43c249" } modify_external_catalogs: true
I20260928 01:55:31.542109 19114 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_f74d6b5e81d2457b88ab4456aa43c249" } modify_external_catalogs: true
I20260928 01:55:31.555127 19703 leader_election.cc:304] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:31.482371 19896 raft_consensus.cc:359] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:31.560117 19896 raft_consensus.cc:385] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:31.560467 19896 raft_consensus.cc:740] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:31.466410 19436 rpcz_store.cc:276] 0928 01:55:29.021249 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:29.081035 (+ 59786us) service_pool.cc:224] Handling call
0928 01:55:30.287282 (+1206247us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54000c22a8. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc1a62f31a1 00007fc1a637f54c 00007fc1a6f9e960 00007fc1a56ee104 00007fc1a56ee092 00007fc1a56edfc1 00007fc1a56edf3c 00007fc1a56ed1f2 00007fc1a3c0209c 00007fc1a3c014d6 00007fc1a3c00e7f
0928 01:55:30.568710 (+281428us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400060c54. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc1a5e9caa1 00007fc1a5f2d6b8 00007fc1a6f9e98d 00007fc1a56ee104 00007fc1a56ee092 00007fc1a56edfc1 00007fc1a56edf3c 00007fc1a56ed1f2 00007fc1a3c0209c 00007fc1a3c014d6 00007fc1a3c00e7f
0928 01:55:31.444927 (+876217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280992384}
I20260928 01:55:31.522363 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3540d1441404092db723b7e5cb61a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:31.524891 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6d3c1d99cc40febd285d0a8f5c3196" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:31.563856 19118 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_3d4ef2c3012a4e4db1e9f4a7c6f1f84e" } new_table_name: "default.Table_f578c30a3812474580b577f61088cf41" modify_external_catalogs: true
I20260928 01:55:31.572171 19111 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_15cf8dad1ba94211b8e90f83f991eb22" } new_table_name: "default.Table_1e30aacb906b40aaa3a683c1495c78f2" modify_external_catalogs: true
I20260928 01:55:31.574437 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3540d1441404092db723b7e5cb61a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:31.575348 19768 raft_consensus.cc:2468] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:31.576433 20252 consensus_queue.cc:1048] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:31.578382 20252 consensus_queue.cc:1048] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:31.580564 20029 tablet_bootstrap.cc:700] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent opening tablet: real 0.185s	user 0.004s	sys 0.000s
I20260928 01:55:31.581221 20227 raft_consensus.cc:2749] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:31.581760 20029 tablet_bootstrap.cc:654] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:31.590530 19890 tablet_bootstrap.cc:654] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:31.591447 19104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 165397us
I20260928 01:55:31.601243 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_50208454838948b69fd04515ea09d66e"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:31.602954 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50208454838948b69fd04515ea09d66e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:31.607570 19118 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ee6d48172044c74aacd4b78683efb66 consensus state has no leader
W20260928 01:55:31.568112 19595 consensus_meta.cc:287] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260928 01:55:31.667531 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 81c205176cb94d9f861cc140560944d4 (DEFAULT_TABLE table=default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.669855 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c205176cb94d9f861cc140560944d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:31.664165 19598 tablet_service.cc:1558] Processing DeleteTablet for tablet 05f875e126f04415a108f778a76bb0f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:30 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:31.677330 19597 tablet_service.cc:1511] Processing CreateTablet for tablet 3505a502bff747deaf1e03c03375aafa (DEFAULT_TABLE table=default.Table_65da2b5b91484f68b38861e046f9f883 [id=c0c2961b24dd4e1580eb67f7a43c5e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.679059 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3505a502bff747deaf1e03c03375aafa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:31.652698 19111 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f71e2109f8cd4dd4a288fbdc8e50b133 consensus state has no leader
I20260928 01:55:31.664700 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_c9d9424440ef43bfac25e91841431667"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:31.687666 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9d9424440ef43bfac25e91841431667 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:31.690193 19599 tablet_service.cc:1511] Processing CreateTablet for tablet 22fc9eff28c4436fb383c3d7169171bb (DEFAULT_TABLE table=default.Table_9ee7221a3e36427e86752547f9beaecf [id=244840982471421db05cec7af71cad31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.691347 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22fc9eff28c4436fb383c3d7169171bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:31.671657 19595 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47670 (request call id 106) took 1141 ms. Trace:
I20260928 01:55:31.709132 19591 tablet_service.cc:1511] Processing CreateTablet for tablet 9a9c2db89fb8467d91c6bd01985d8b40 (DEFAULT_TABLE table=default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.710922 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a9c2db89fb8467d91c6bd01985d8b40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:31.527101 19447 consensus_meta.cc:287] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 1.103s	user 0.007s	sys 0.014s
I20260928 01:55:31.722671 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa8a7589d314c25aeccf678c938ecf0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:31.727862 19447 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 99) took 1486 ms. Trace:
I20260928 01:55:31.728785 19473 raft_consensus.cc:2468] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:31.728628 19447 rpcz_store.cc:276] 0928 01:55:30.241754 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.242052 (+   298us) service_pool.cc:224] Handling call
0928 01:55:30.366394 (+124342us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.366528 (+   134us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:30.423401 (+ 56873us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.723637 (+1300236us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:31.727795 (+  4158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:31.724047 19471 raft_consensus.cc:2468] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:31.714589 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d40050f85a4d6c90a4ce35cf15d134" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:31.719455 19111 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_b436297bdca54bf5a76531dd17d4d43a"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:31.671828 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_d18c82a7d33545a9aa3f56592cf6fbc8"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:31.747246 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:31.746896 19896 consensus_queue.cc:260] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:31.747905 19111 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b436297bdca54bf5a76531dd17d4d43a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:31.728020 19456 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 108) took 1137 ms. Trace:
I20260928 01:55:31.744521 19115 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:31.749161 19456 rpcz_store.cc:276] 0928 01:55:30.590623 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.593213 (+  2590us) service_pool.cc:224] Handling call
0928 01:55:30.602744 (+  9531us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.602850 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:31.494735 (+891885us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.727605 (+232870us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:31.727967 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:31.750121 19115 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_2916b0cc0e3f4f4c97b4c2439e47cb91 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]). Expected version 2 got 0
I20260928 01:55:31.750725 19115 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 77c1f247486548ee9747403f7f80e3dc (table default.Table_2171ab69dd564f6897eb22381bb0a5b6 [id=328e52a4270e476faf1b10d89af3a56c]). Expected version 1 got 0
I20260928 01:55:31.751293 20148 raft_consensus.cc:2272] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:31.752524 19109 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet f3741aec215343468b2d7bc952da03c8
I20260928 01:55:31.754478 20148 ts_tablet_manager.cc:1916] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:55:31.755522 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_f578c30a3812474580b577f61088cf41 [id=80615f0d230c4c50b8c7162d16d54c88], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4ee6d48172044c74aacd4b78683efb66 consensus state has no leader
I20260928 01:55:31.707643 19740 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44964 (request call id 112) took 1486 ms. Trace:
I20260928 01:55:31.757913 19114 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet ce41f63df46f4d0493ca22a13daadb4f
I20260928 01:55:31.761746 19896 ts_tablet_manager.cc:1434] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.303s	user 0.007s	sys 0.002s
I20260928 01:55:31.762912 19896 tablet_bootstrap.cc:492] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:31.702006 19704 leader_election.cc:304] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:31.778178 19451 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 104) took 1429 ms. Trace:
I20260928 01:55:31.778748 19451 rpcz_store.cc:276] 0928 01:55:30.349071 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.349215 (+   144us) service_pool.cc:224] Handling call
0928 01:55:30.412687 (+ 63472us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.412827 (+   140us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:31.533873 (+1121046us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.777573 (+243700us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:31.778108 (+   535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:31.756538 19740 rpcz_store.cc:276] 0928 01:55:30.220756 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.221475 (+   719us) service_pool.cc:224] Handling call
0928 01:55:30.448267 (+226792us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.448452 (+   185us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:30.993516 (+545064us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.417856 (+424340us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:31.686771 (+268915us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:31.801896 19896 tablet_bootstrap.cc:654] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:31.772534 20252 raft_consensus.cc:2804] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:31.821623 20252 raft_consensus.cc:697] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:31.822942 20252 consensus_queue.cc:237] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:31.780164 20194 raft_consensus.cc:493] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:31.824649 20194 raft_consensus.cc:515] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:31.826534 20239 ts_tablet_manager.cc:1929] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:31.827083 20239 log.cc:1199] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/027f99abaacc4c169661e7db08512ebd
W20260928 01:55:31.772665 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 213914us
I20260928 01:55:31.694607 19595 rpcz_store.cc:276] 0928 01:55:30.688369 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.743132 (+ 54763us) service_pool.cc:224] Handling call
0928 01:55:30.799371 (+ 56239us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.799473 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:30.967444 (+167971us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.635964 (+668520us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:31.670594 (+ 34630us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472768}
I20260928 01:55:31.853291 19113 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_2916b0cc0e3f4f4c97b4c2439e47cb91" } new_table_name: "default.Table_7b9732274ea648f08bfbe8dde20be79f" modify_external_catalogs: true
I20260928 01:55:31.684715 19593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47670 (request call id 105) took 1155 ms. Trace:
I20260928 01:55:31.858220 19593 rpcz_store.cc:276] 0928 01:55:30.528882 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.541885 (+ 13003us) service_pool.cc:224] Handling call
0928 01:55:30.543361 (+  1476us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.543446 (+    85us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:31.197967 (+654521us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.343314 (+145347us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:31.671902 (+328588us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:31.869385 20147 ts_tablet_manager.cc:1929] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:31.869947 20147 log.cc:1199] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/dfc63ccbe4e84373aabe3009cc3d2568
I20260928 01:55:31.871078 20147 ts_tablet_manager.cc:1950] T dfc63ccbe4e84373aabe3009cc3d2568 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:31.874403 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 68) took 5118 ms. Trace:
I20260928 01:55:31.876349 19896 tablet_bootstrap.cc:492] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:31.876839 19896 ts_tablet_manager.cc:1403] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.007s
W20260928 01:55:31.882056 19113 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f887fe10461d40ee9363ce97ebbedd4f consensus state has no leader
I20260928 01:55:31.888371 19113 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_b436297bdca54bf5a76531dd17d4d43a" } new_table_name: "default.Table_661da8a82d9f4326a02315d508cd7db7" modify_external_catalogs: true
I20260928 01:55:31.875272 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet f3741aec215343468b2d7bc952da03c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:31.880597 19590 tablet_service.cc:1511] Processing CreateTablet for tablet 416ccc1323fe41b2a7783dc95bba8d84 (DEFAULT_TABLE table=default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.881879 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet ce41f63df46f4d0493ca22a13daadb4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:31.889438 19593 tablet_service.cc:1511] Processing CreateTablet for tablet 376b5a87b07b4f87a2a502b5fa1b23f8 (DEFAULT_TABLE table=default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.784226 19742 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44964 (request call id 111) took 1563 ms. Trace:
I20260928 01:55:31.820015 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6d3c1d99cc40febd285d0a8f5c3196" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:31.827785 20194 leader_election.cc:290] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:31.801605 19743 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44964 (request call id 110) took 1581 ms. Trace:
W20260928 01:55:31.857501 19594 consensus_meta.cc:287] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.005s
I20260928 01:55:31.913156 19597 tablet_service.cc:1511] Processing CreateTablet for tablet 7ab79c6ad03e481a903a0f95ae0512e6 (DEFAULT_TABLE table=default.Table_501342eaebce40d1a76ace4b05f022fd [id=f5f0643fe0534f2e82e105f01832931f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.928714 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_7b0eeaea0af144bf8165b6228c454e7e"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:31.930455 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b0eeaea0af144bf8165b6228c454e7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:31.944406 19113 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d5018f065824614a42f93afd49f770e has no consensus state
I20260928 01:55:31.953720 19115 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:31.961723 19115 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_7b9732274ea648f08bfbe8dde20be79f [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]). Expected version 3 got 0
I20260928 01:55:31.963943 19115 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 77c1f247486548ee9747403f7f80e3dc (table default.Table_2171ab69dd564f6897eb22381bb0a5b6 [id=328e52a4270e476faf1b10d89af3a56c]). Expected version 1 got 0
I20260928 01:55:31.965866 19115 catalog_manager.cc:5838] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:55:31.975154 19113 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_21e19e0229e74ecba58c719d9d48d826" } modify_external_catalogs: true
I20260928 01:55:31.975728 19113 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_21e19e0229e74ecba58c719d9d48d826" } modify_external_catalogs: true
I20260928 01:55:31.988114 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ab79c6ad03e481a903a0f95ae0512e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:31.988241 19118 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_d8fa3c5311e74d20aa00d9acb400810f" } modify_external_catalogs: true
I20260928 01:55:31.988920 19118 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_d8fa3c5311e74d20aa00d9acb400810f" } modify_external_catalogs: true
I20260928 01:55:31.984987 19746 tablet_service.cc:1511] Processing CreateTablet for tablet 81c205176cb94d9f861cc140560944d4 (DEFAULT_TABLE table=default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.990064 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c205176cb94d9f861cc140560944d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:31.990792 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 05f875e126f04415a108f778a76bb0f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:30 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:31.991503 19739 tablet_service.cc:1558] Processing DeleteTablet for tablet eaa1e9b7119d46a2ba2652a893877c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:30 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:31.927423 19738 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44964 (request call id 116) took 1410 ms. Trace:
I20260928 01:55:31.991763 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 3505a502bff747deaf1e03c03375aafa (DEFAULT_TABLE table=default.Table_65da2b5b91484f68b38861e046f9f883 [id=c0c2961b24dd4e1580eb67f7a43c5e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:31.992250 19738 rpcz_store.cc:276] 0928 01:55:30.516511 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.651510 (+134999us) service_pool.cc:224] Handling call
0928 01:55:30.655680 (+  4170us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.655817 (+   137us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:31.411384 (+755567us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.782516 (+371132us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:31.926816 (+144300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:31.992998 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3505a502bff747deaf1e03c03375aafa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:31.974773 20029 tablet_bootstrap.cc:492] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:31.995893 20029 ts_tablet_manager.cc:1403] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.808s	user 0.029s	sys 0.011s
I20260928 01:55:31.999370 19553 leader_election.cc:304] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:32.010571 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae3663fbe024a4e946e47339a4b9090 (DEFAULT_TABLE table=default.Table_fa2cc70b96124fedb7f77c2fd58c9d89 [id=90e10f23ac7f4af489416a55f3287681]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.014684 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_45d6b319a8bc4864a0f443d8c42707d3"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:32.016517 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45d6b319a8bc4864a0f443d8c42707d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:32.028038 19409 leader_election.cc:343] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: 952df055998942f89baabb341e204f43
I20260928 01:55:32.033272 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_fc26a7ce9faf4ea08601641355b17651"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:32.034964 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc26a7ce9faf4ea08601641355b17651 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:32.041957 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_3ce866b8da2a4181bedfe396a59a2b76"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:32.043753 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ce866b8da2a4181bedfe396a59a2b76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:32.046489 19112 master_service.cc:960] ReplaceTablet: received request to replace tablet 5d9b93f45ccf44e785b00849e49c8294 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:32.059221 19111 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:32.061400 19111 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_7b9732274ea648f08bfbe8dde20be79f [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]). Expected version 3 got 0
I20260928 01:55:32.062227 19111 catalog_manager.cc:5838] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:32.063643 19111 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 77c1f247486548ee9747403f7f80e3dc (table default.Table_2171ab69dd564f6897eb22381bb0a5b6 [id=328e52a4270e476faf1b10d89af3a56c]). Expected version 1 got 0
I20260928 01:55:32.063791 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa1e9b7119d46a2ba2652a893877c8c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:32.082157 19455 tablet_service.cc:1558] Processing DeleteTablet for tablet ce41f63df46f4d0493ca22a13daadb4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:32.085541 19409 leader_election.cc:304] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:55:32.086685 19409 raft_consensus.cc:2686] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:55:32.086694 19592 tablet_service.cc:1511] Processing CreateTablet for tablet c8fd6b965d22477aaee9bafccb2069b1 (DEFAULT_TABLE table=default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:32.087591 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 59864.3us
I20260928 01:55:31.923008 20147 rpcz_store.cc:276] 0928 01:55:26.755848 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.756370 (+   522us) service_pool.cc:224] Handling call
0928 01:55:30.275570 (+3519200us) ts_tablet_manager.cc:1151] Deleting tablet dfc63ccbe4e84373aabe3009cc3d2568
0928 01:55:30.275799 (+   229us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:31.243119 (+967320us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.869210 (+626091us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.874304 (+  5094us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21631,"tablet-delete.queue_time_us":3518142}
I20260928 01:55:32.096407 19452 tablet_service.cc:1558] Processing DeleteTablet for tablet f3741aec215343468b2d7bc952da03c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:32.103549 19440 tablet_service.cc:1511] Processing CreateTablet for tablet e05925303152462e8ca25cd15f3bedff (DEFAULT_TABLE table=default.Table_21e19e0229e74ecba58c719d9d48d826 [id=73589cf1bbce4173ac1347c30cc2d811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.105175 19440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05925303152462e8ca25cd15f3bedff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.111901 19445 tablet_service.cc:1511] Processing CreateTablet for tablet 376b5a87b07b4f87a2a502b5fa1b23f8 (DEFAULT_TABLE table=default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:32.112706 19474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.006s	sys 0.005s
W20260928 01:55:32.113101 19474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.006s	sys 0.005s
I20260928 01:55:32.129215 19113 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet e05925303152462e8ca25cd15f3bedff
I20260928 01:55:32.133926 19118 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 9ca0b52215454a99b6c5d1956088829a
W20260928 01:55:32.146503 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 61867.8us
I20260928 01:55:32.145488 20251 consensus_queue.cc:1048] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.151s
I20260928 01:55:32.154117 19452 tablet_service.cc:1558] Processing DeleteTablet for tablet e05925303152462e8ca25cd15f3bedff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:32.156445 19439 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ca0b52215454a99b6c5d1956088829a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:32.157451 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 81c205176cb94d9f861cc140560944d4 (DEFAULT_TABLE table=default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.158593 19453 tablet_service.cc:1511] Processing CreateTablet for tablet 416ccc1323fe41b2a7783dc95bba8d84 (DEFAULT_TABLE table=default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.159624 19447 tablet_service.cc:1511] Processing CreateTablet for tablet 22fc9eff28c4436fb383c3d7169171bb (DEFAULT_TABLE table=default.Table_9ee7221a3e36427e86752547f9beaecf [id=244840982471421db05cec7af71cad31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.065784 19896 raft_consensus.cc:359] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:32.160809 19896 raft_consensus.cc:385] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:32.161105 19896 raft_consensus.cc:740] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:32.161829 19896 consensus_queue.cc:260] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:32.168120 19444 tablet_service.cc:1511] Processing CreateTablet for tablet 7ab79c6ad03e481a903a0f95ae0512e6 (DEFAULT_TABLE table=default.Table_501342eaebce40d1a76ace4b05f022fd [id=f5f0643fe0534f2e82e105f01832931f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.172283 19442 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae3663fbe024a4e946e47339a4b9090 (DEFAULT_TABLE table=default.Table_fa2cc70b96124fedb7f77c2fd58c9d89 [id=90e10f23ac7f4af489416a55f3287681]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.174183 19454 tablet_service.cc:1511] Processing CreateTablet for tablet 9a9c2db89fb8467d91c6bd01985d8b40 (DEFAULT_TABLE table=default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.177079 20249 raft_consensus.cc:2804] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:32.177471 20249 raft_consensus.cc:493] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:32.177779 20249 raft_consensus.cc:3060] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:32.183809 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 3505a502bff747deaf1e03c03375aafa (DEFAULT_TABLE table=default.Table_65da2b5b91484f68b38861e046f9f883 [id=c0c2961b24dd4e1580eb67f7a43c5e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.185292 19598 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1ddfab489f4ace921d551c216039bd (DEFAULT_TABLE table=default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.187599 19595 tablet_service.cc:1511] Processing CreateTablet for tablet e05925303152462e8ca25cd15f3bedff (DEFAULT_TABLE table=default.Table_21e19e0229e74ecba58c719d9d48d826 [id=73589cf1bbce4173ac1347c30cc2d811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.189189 19596 tablet_service.cc:1558] Processing DeleteTablet for tablet e05925303152462e8ca25cd15f3bedff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:32.190595 19596 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ca0b52215454a99b6c5d1956088829a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:32.191766 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet dfc63ccbe4e84373aabe3009cc3d2568 (table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]) successfully deleted
I20260928 01:55:32.191586 19443 tablet_service.cc:1511] Processing CreateTablet for tablet c8fd6b965d22477aaee9bafccb2069b1 (DEFAULT_TABLE table=default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.193645 20029 raft_consensus.cc:359] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:32.194319 20029 raft_consensus.cc:385] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:32.194581 20029 raft_consensus.cc:740] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:32.195168 20029 consensus_queue.cc:260] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:32.194761 19441 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1ddfab489f4ace921d551c216039bd (DEFAULT_TABLE table=default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.219507 19890 tablet_bootstrap.cc:492] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:32.220360 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416ccc1323fe41b2a7783dc95bba8d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.224350 19594 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47670 (request call id 104) took 1695 ms. Trace:
I20260928 01:55:32.224798 19594 rpcz_store.cc:276] 0928 01:55:30.528580 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.544338 (+ 15758us) service_pool.cc:224] Handling call
0928 01:55:30.573830 (+ 29492us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.573974 (+   144us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:31.214653 (+640679us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.996556 (+781903us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:32.224282 (+227726us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261312}
I20260928 01:55:32.226300 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae3663fbe024a4e946e47339a4b9090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.220083 19890 ts_tablet_manager.cc:1403] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 1.186s	user 0.007s	sys 0.023s
I20260928 01:55:32.236728 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8fd6b965d22477aaee9bafccb2069b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.237639 20147 tablet_replica.cc:333] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:32.237572 20289 consensus_queue.cc:1048] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:32.290424 19114 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_f578c30a3812474580b577f61088cf41" } new_table_name: "default.Table_3c2b867f1a684d0089c1244ac367c3bb" modify_external_catalogs: true
I20260928 01:55:31.917114 19743 rpcz_store.cc:276] 0928 01:55:30.220045 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.220534 (+   489us) service_pool.cc:224] Handling call
0928 01:55:30.443186 (+222652us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.443356 (+   170us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:31.009770 (+566414us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.419932 (+410162us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:31.801521 (+381589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6400}
I20260928 01:55:32.295624 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_adb5ab9de36441229bdfdfceffe4604e"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:32.297410 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_adb5ab9de36441229bdfdfceffe4604e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:32.287175 19115 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_1109ca51476d45c0a4aad60c01bc222b" } new_table_name: "default.Table_20dcad66d10f47f1a1537bf182984f07" modify_external_catalogs: true
I20260928 01:55:32.310837 20029 ts_tablet_manager.cc:1434] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.315s	user 0.007s	sys 0.000s
I20260928 01:55:31.916925 19742 rpcz_store.cc:276] 0928 01:55:30.220389 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.222587 (+  2198us) service_pool.cc:224] Handling call
0928 01:55:30.321219 (+ 98632us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b5800000f98. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a19fae8a1 00007f0a1a0f2b51 00007f0a1a0f2a02 00007f0a2303d119 00007f0a22277a70 00007f0a2235ce61 00007f0a2233a0f3 00007f0a222e8640 00007f0a20872bf4 00007f0a20872b82 00007f0a20872ab1
0928 01:55:30.452256 (+131037us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.452428 (+   172us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:30.998373 (+545945us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.557613 (+559240us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:31.784115 (+226502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11859200}
I20260928 01:55:32.204337 20239 ts_tablet_manager.cc:1950] T 027f99abaacc4c169661e7db08512ebd P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:32.345589 20029 tablet_bootstrap.cc:492] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:32.365136 19742 tablet_service.cc:1511] Processing CreateTablet for tablet 22fc9eff28c4436fb383c3d7169171bb (DEFAULT_TABLE table=default.Table_9ee7221a3e36427e86752547f9beaecf [id=244840982471421db05cec7af71cad31]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:32.372807 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 214444us
I20260928 01:55:32.379592 19113 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_0991384f9b0745a389ad95d24675e413" } modify_external_catalogs: true
I20260928 01:55:32.380717 19113 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_0991384f9b0745a389ad95d24675e413" } modify_external_catalogs: true
I20260928 01:55:32.385159 19110 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_593e8a23ad954f5b8b209830cbd7ccf9" } modify_external_catalogs: true
I20260928 01:55:32.386514 19110 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_593e8a23ad954f5b8b209830cbd7ccf9" } modify_external_catalogs: true
I20260928 01:55:32.397037 19556 leader_election.cc:304] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:32.400626 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_39aacd0daa1b4dc2ac37b6aec34468bf"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:32.403837 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39aacd0daa1b4dc2ac37b6aec34468bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:32.405107 19556 leader_election.cc:343] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:32.406174 19556 leader_election.cc:343] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:32.243356 19448 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 105) took 1892 ms. Trace:
I20260928 01:55:32.252585 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376b5a87b07b4f87a2a502b5fa1b23f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:32.253000 19446 consensus_meta.cc:287] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.860s	user 0.006s	sys 0.005s
I20260928 01:55:32.329912 20148 ts_tablet_manager.cc:1929] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:32.424294 20284 raft_consensus.cc:2804] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:55:32.424950 20284 raft_consensus.cc:493] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:55:32.425303 20284 raft_consensus.cc:3060] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:32.428957 19743 tablet_service.cc:1511] Processing CreateTablet for tablet 9a9c2db89fb8467d91c6bd01985d8b40 (DEFAULT_TABLE table=default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:32.435235 19114 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ee6d48172044c74aacd4b78683efb66 consensus state has no leader
I20260928 01:55:32.435503 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a9c2db89fb8467d91c6bd01985d8b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.436937 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_7b512897d5b14bda99e46dcb3eec147c"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:32.442585 19745 tablet_service.cc:1558] Processing DeleteTablet for tablet f3741aec215343468b2d7bc952da03c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:32.446084 19745 tablet_service.cc:1558] Processing DeleteTablet for tablet ce41f63df46f4d0493ca22a13daadb4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:32.449693 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 416ccc1323fe41b2a7783dc95bba8d84 (DEFAULT_TABLE table=default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.453187 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416ccc1323fe41b2a7783dc95bba8d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.463212 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22fc9eff28c4436fb383c3d7169171bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:32.333326 19449 consensus_meta.cc:287] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.601s	user 0.014s	sys 0.000s
I20260928 01:55:32.478438 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa1e9b7119d46a2ba2652a893877c8c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:32.484332 19621 raft_consensus.cc:2468] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
W20260928 01:55:32.495303 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 88500.1us
W20260928 01:55:32.397027 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 305317us
I20260928 01:55:32.419389 19448 rpcz_store.cc:276] 0928 01:55:30.350796 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.350914 (+   118us) service_pool.cc:224] Handling call
0928 01:55:30.408761 (+ 57847us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.408899 (+   138us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:31.518141 (+1109242us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.767897 (+249756us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:32.243160 (+475263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:32.507709 19453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416ccc1323fe41b2a7783dc95bba8d84. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:32.512743 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b512897d5b14bda99e46dcb3eec147c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:32.514195 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 117) took 1862 ms. Trace:
I20260928 01:55:32.515218 20239 rpcz_store.cc:276] 0928 01:55:30.664064 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.664311 (+   247us) service_pool.cc:224] Handling call
0928 01:55:30.973388 (+309077us) ts_tablet_manager.cc:1151] Deleting tablet 027f99abaacc4c169661e7db08512ebd
0928 01:55:30.973429 (+    41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:31.740794 (+767365us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:31.826369 (+ 85575us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:32.514102 (+687733us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160660,"tablet-delete.queue_time_us":306999}
I20260928 01:55:32.516950 19446 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 103) took 2273 ms. Trace:
I20260928 01:55:32.517465 19446 rpcz_store.cc:276] 0928 01:55:30.243764 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.347010 (+103246us) service_pool.cc:224] Handling call
0928 01:55:30.403206 (+ 56196us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:30.403353 (+   147us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:30.711791 (+308438us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:32.505601 (+1793810us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:32.516868 (+ 11267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10537}
I20260928 01:55:32.519775 19449 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 111) took 1329 ms. Trace:
I20260928 01:55:32.518303 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 376b5a87b07b4f87a2a502b5fa1b23f8 (DEFAULT_TABLE table=default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.520694 19449 rpcz_store.cc:276] 0928 01:55:31.190627 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.221610 (+ 30983us) service_pool.cc:224] Handling call
0928 01:55:31.224625 (+  3015us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:31.224760 (+   135us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:31.731785 (+507025us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:32.518948 (+787163us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:32.519684 (+   736us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12376}
I20260928 01:55:32.521067 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 7ab79c6ad03e481a903a0f95ae0512e6 (DEFAULT_TABLE table=default.Table_501342eaebce40d1a76ace4b05f022fd [id=f5f0643fe0534f2e82e105f01832931f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.521787 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376b5a87b07b4f87a2a502b5fa1b23f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.523356 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ab79c6ad03e481a903a0f95ae0512e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:32.533289 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 46115.4us
I20260928 01:55:32.481276 19598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1ddfab489f4ace921d551c216039bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:32.397310 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 397980us
I20260928 01:55:32.576294 20239 tablet_replica.cc:333] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:32.578529 19595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05925303152462e8ca25cd15f3bedff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.579245 19593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376b5a87b07b4f87a2a502b5fa1b23f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.589833 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c205176cb94d9f861cc140560944d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.584378 20148 log.cc:1199] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/952df055998942f89baabb341e204f43
I20260928 01:55:32.596617 20239 raft_consensus.cc:2243] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:32.599504 20300 raft_consensus.cc:493] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:32.601006 20300 raft_consensus.cc:515] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:32.608744 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 112104us
I20260928 01:55:32.609493 19890 raft_consensus.cc:359] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:32.610234 19890 raft_consensus.cc:385] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:32.610512 19890 raft_consensus.cc:740] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:32.615187 20283 consensus_queue.cc:1048] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:32.616103 19890 consensus_queue.cc:260] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:32.625633 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa8a7589d314c25aeccf678c938ecf0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:32.600008 19553 leader_election.cc:343] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:32.634610 19115 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 599ef1523fcf43d1a1e2a91f03abaa60 consensus state has no leader
W20260928 01:55:32.594673 19409 leader_election.cc:343] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: a43cfb32bd0043049cbdb2faaf10409f
I20260928 01:55:32.639767 20239 raft_consensus.cc:2272] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:32.642696 20239 ts_tablet_manager.cc:1916] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:32.605301 19896 ts_tablet_manager.cc:1434] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.728s	user 0.014s	sys 0.006s
I20260928 01:55:32.648964 19704 leader_election.cc:304] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:32.650849 20194 raft_consensus.cc:2804] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:55:32.651201 20194 raft_consensus.cc:493] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:32.651521 20194 raft_consensus.cc:3060] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:32.651971 19117 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_50208454838948b69fd04515ea09d66e" } new_table_name: "default.Table_45ba8bc09f494400ad88a655691247ae" modify_external_catalogs: true
W20260928 01:55:32.644668 19896 ts_tablet_manager.cc:1467] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614: Tablet startup took 767ms
I20260928 01:55:32.659229 19740 tablet_service.cc:1511] Processing CreateTablet for tablet c8fd6b965d22477aaee9bafccb2069b1 (DEFAULT_TABLE table=default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.660545 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8fd6b965d22477aaee9bafccb2069b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.667394 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae3663fbe024a4e946e47339a4b9090 (DEFAULT_TABLE table=default.Table_fa2cc70b96124fedb7f77c2fd58c9d89 [id=90e10f23ac7f4af489416a55f3287681]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.668764 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae3663fbe024a4e946e47339a4b9090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.672565 19747 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1ddfab489f4ace921d551c216039bd (DEFAULT_TABLE table=default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.673854 19747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1ddfab489f4ace921d551c216039bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.678509 19741 tablet_service.cc:1511] Processing CreateTablet for tablet e05925303152462e8ca25cd15f3bedff (DEFAULT_TABLE table=default.Table_21e19e0229e74ecba58c719d9d48d826 [id=73589cf1bbce4173ac1347c30cc2d811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.679720 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05925303152462e8ca25cd15f3bedff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.695647 20148 ts_tablet_manager.cc:1950] T 952df055998942f89baabb341e204f43 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
W20260928 01:55:32.718211 19104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 476173us
I20260928 01:55:32.720432 19737 tablet_service.cc:1558] Processing DeleteTablet for tablet e05925303152462e8ca25cd15f3bedff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:32.721611 19736 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ca0b52215454a99b6c5d1956088829a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:32.722702 19735 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a3540d1441404092db723b7e5cb61a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:26 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:32.739043 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_a841520189cd409693d77754fa85be49"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:32.627941 19553 leader_election.cc:304] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:32.741379 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a841520189cd409693d77754fa85be49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:32.741609 19104 consensus_peers.cc:597] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc -> Peer 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095): Couldn't send request to peer 04e48edd841a42d08a480be209f0d294. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260928 01:55:32.750485 19117 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a5e07078b2a4fe59d9293d9511cbb6b has no consensus state
I20260928 01:55:32.759286 20303 raft_consensus.cc:2749] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:32.762900 20249 consensus_meta.cc:287] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.585s	user 0.004s	sys 0.005s
W20260928 01:55:32.766639 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f71e2109f8cd4dd4a288fbdc8e50b133 (table default.Table_1e30aacb906b40aaa3a683c1495c78f2 [id=30ade53be61542a7a042a4401001fba9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f71e2109f8cd4dd4a288fbdc8e50b133 consensus state has no leader
I20260928 01:55:32.768395 20249 raft_consensus.cc:515] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:32.769373 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 169394us
W20260928 01:55:32.772420 19553 consensus_peers.cc:597] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:32.604123 20300 leader_election.cc:290] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:32.776885 20147 raft_consensus.cc:2243] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 01:55:32.770718 19591 consensus_meta.cc:287] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.001s
I20260928 01:55:32.778012 19591 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47670 (request call id 118) took 1079 ms. Trace:
I20260928 01:55:32.778370 19591 rpcz_store.cc:276] 0928 01:55:31.699064 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.699218 (+   154us) service_pool.cc:224] Handling call
0928 01:55:31.710171 (+ 10953us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:31.710324 (+   153us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:32.182542 (+472218us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:32.777504 (+594962us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:32.777939 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:32.778885 20147 raft_consensus.cc:2272] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:32.770978 20284 raft_consensus.cc:515] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:32.779695 20259 raft_consensus.cc:493] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:32.781219 20284 leader_election.cc:290] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:32.781915 19617 raft_consensus.cc:2393] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 2: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:32.780252 20259 raft_consensus.cc:515] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:32.783380 20194 raft_consensus.cc:515] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:32.785251 20259 leader_election.cc:290] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:32.765460 19590 consensus_meta.cc:287] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.006s
I20260928 01:55:32.787735 19890 ts_tablet_manager.cc:1434] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.559s	user 0.014s	sys 0.000s
I20260928 01:55:32.802877 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 67) took 6052 ms. Trace:
I20260928 01:55:32.803337 20148 rpcz_store.cc:276] 0928 01:55:26.750540 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.750717 (+   177us) service_pool.cc:224] Handling call
0928 01:55:31.228830 (+4478113us) ts_tablet_manager.cc:1151] Deleting tablet 952df055998942f89baabb341e204f43
0928 01:55:31.279725 (+ 50895us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:31.862818 (+583093us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:32.329047 (+466229us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:32.802786 (+473739us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4285228}
I20260928 01:55:32.809039 19118 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:32.809772 19118 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_7b9732274ea648f08bfbe8dde20be79f [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]). Expected version 3 got 0
I20260928 01:55:32.799399 20249 leader_election.cc:290] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:32.693414 19409 leader_election.cc:304] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:55:32.820900 19890 ts_tablet_manager.cc:1467] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0: Tablet startup took 591ms
W20260928 01:55:32.656009 19896 ts_tablet_manager.cc:1469] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614: Trace:
0928 01:55:25.842876 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:25.843072 (+   196us) service_pool.cc:224] Handling call
0928 01:55:25.844457 (+  1385us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:25.844560 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:25.890550 (+ 45990us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:25.975901 (+ 85351us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:26.064553 (+ 88652us) inbound_call.cc:177] Queueing success response
0928 01:55:31.762525 (+5697972us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0928 01:55:31.877120 (+114595us) ts_tablet_manager.cc:1435] Starting tablet replica
0928 01:55:31.878262 (+  1142us) tablet_replica.cc:261] Starting instrumentation
0928 01:55:31.878781 (+   519us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":427717,"spinlock_wait_cycles":71058304,"tablet-open.queue_time_us":5786311,"thread_start_us":256278,"threads_started":1}
I20260928 01:55:32.816653 19448 tablet_service.cc:1511] Processing CreateTablet for tablet eac01fc222dd480cbed7cac37a0e6693 (DEFAULT_TABLE table=default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:32.822642 19409 raft_consensus.cc:2686] T a43cfb32bd0043049cbdb2faaf10409f P 37089d44fdba4b6488b5b5aea28af614: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:55:32.825066 20148 tablet_replica.cc:333] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:32.825407 20194 leader_election.cc:290] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:32.823040 20147 ts_tablet_manager.cc:1916] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:32.826565 19896 tablet_bootstrap.cc:492] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:32.827355 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 237692us
W20260928 01:55:32.828428 19409 leader_election.cc:343] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: dfc63ccbe4e84373aabe3009cc3d2568
I20260928 01:55:32.836635 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 952df055998942f89baabb341e204f43 (table default.Table_88ced5d20fea41538f5221b8f4367570 [id=d09064e0c8664ffd9e2fbf72f49b8e31]) successfully deleted
W20260928 01:55:32.836376 19890 ts_tablet_manager.cc:1469] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0: Trace:
0928 01:55:25.529072 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:25.529299 (+   227us) service_pool.cc:224] Handling call
0928 01:55:25.533300 (+  4001us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:25.533477 (+   177us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:25.753354 (+219877us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:26.237638 (+484284us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:26.238425 (+   787us) inbound_call.cc:177] Queueing success response
0928 01:55:31.033877 (+4795452us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0928 01:55:32.228933 (+1195056us) ts_tablet_manager.cc:1435] Starting tablet replica
0928 01:55:32.554933 (+326000us) tablet_replica.cc:261] Starting instrumentation
0928 01:55:32.556110 (+  1177us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":18438,"raft.queue_time_us":9588,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"tablet-open.queue_time_us":4795557,"thread_start_us":150278,"threads_started":1}
I20260928 01:55:32.828812 19409 leader_election.cc:304] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:55:32.841434 19409 leader_election.cc:343] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: efa8a7589d314c25aeccf678c938ecf0
I20260928 01:55:32.864355 20029 tablet_bootstrap.cc:654] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:32.864435 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3540d1441404092db723b7e5cb61a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:32.865089 19764 raft_consensus.cc:3060] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:32.871774 19412 leader_election.cc:304] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:32.853241 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa1e9b7119d46a2ba2652a893877c8c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:32.856964 19553 leader_election.cc:343] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:32.873842 19553 leader_election.cc:304] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:32.842149 20259 raft_consensus.cc:2749] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260928 01:55:32.875663 19553 leader_election.cc:343] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: efa8a7589d314c25aeccf678c938ecf0
I20260928 01:55:32.876217 20259 raft_consensus.cc:3060] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:32.879310 20249 raft_consensus.cc:2749] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:32.852128 20148 raft_consensus.cc:2243] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:32.859912 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa8a7589d314c25aeccf678c938ecf0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:32.745362 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1ddfab489f4ace921d551c216039bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.887593 19449 tablet_service.cc:1511] Processing CreateTablet for tablet 12c7284250084d6299cafe8310cfd257 (DEFAULT_TABLE table=default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.890122 19443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8fd6b965d22477aaee9bafccb2069b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.891804 19449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c7284250084d6299cafe8310cfd257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.899353 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3540d1441404092db723b7e5cb61a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:32.900074 19442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae3663fbe024a4e946e47339a4b9090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.900272 19475 raft_consensus.cc:3060] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:32.906352 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 027f99abaacc4c169661e7db08512ebd (table default.Table_26116cab8a164e2cb26e73efbde6d923 [id=00aeb9f1892b4b009a69e32f201b081a]) successfully deleted
I20260928 01:55:32.915725 19117 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_7b9732274ea648f08bfbe8dde20be79f" } new_table_name: "default.Table_25f5d9bf8f154b87b16032e2ce9ec169" modify_external_catalogs: true
I20260928 01:55:32.916801 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_8fa166d0b57c47e1a0f8e07124585fb9"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:32.921293 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fa166d0b57c47e1a0f8e07124585fb9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:32.929726 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3540d1441404092db723b7e5cb61a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:32.932183 19890 tablet_bootstrap.cc:492] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:32.935477 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e1cc46939b4932a344b81c3bc8ca82" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:32.936421 19618 raft_consensus.cc:2468] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:32.896071 19115 catalog_manager.cc:5838] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:32.939208 19115 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_7b9732274ea648f08bfbe8dde20be79f [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]). Expected version 3 got 0
I20260928 01:55:32.940055 19115 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:32.946054 20249 consensus_queue.cc:1048] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:32.900689 20148 raft_consensus.cc:2272] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 01:55:32.947580 19553 leader_election.cc:343] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: efa8a7589d314c25aeccf678c938ecf0
I20260928 01:55:32.949379 19598 tablet_service.cc:1511] Processing CreateTablet for tablet eac01fc222dd480cbed7cac37a0e6693 (DEFAULT_TABLE table=default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.951257 19598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac01fc222dd480cbed7cac37a0e6693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.952946 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa1e9b7119d46a2ba2652a893877c8c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
W20260928 01:55:32.961892 19744 consensus_meta.cc:287] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da: Time spent flushing consensus metadata: real 0.819s	user 0.013s	sys 0.000s
I20260928 01:55:32.964362 19447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22fc9eff28c4436fb383c3d7169171bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.966423 19593 tablet_service.cc:1511] Processing CreateTablet for tablet 12c7284250084d6299cafe8310cfd257 (DEFAULT_TABLE table=default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.968834 19593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c7284250084d6299cafe8310cfd257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.973838 19595 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5e07078b2a4fe59d9293d9511cbb6b (DEFAULT_TABLE table=default.Table_45ba8bc09f494400ad88a655691247ae [id=0da09ac1dc794d82b6f9323d0196b4cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.975544 19595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5e07078b2a4fe59d9293d9511cbb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.980600 19448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac01fc222dd480cbed7cac37a0e6693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.984714 19111 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_4e2fdca3bbd348fa97286ef3e47f76ec"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:32.986414 19111 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e2fdca3bbd348fa97286ef3e47f76ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:32.989157 19734 tablet_service.cc:1511] Processing CreateTablet for tablet eac01fc222dd480cbed7cac37a0e6693 (DEFAULT_TABLE table=default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:32.991307 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac01fc222dd480cbed7cac37a0e6693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:32.998404 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 12c7284250084d6299cafe8310cfd257 (DEFAULT_TABLE table=default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:33.000260 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c7284250084d6299cafe8310cfd257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:33.006371 19744 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44964 (request call id 127) took 1015 ms. Trace:
I20260928 01:55:33.006855 19744 rpcz_store.cc:276] 0928 01:55:31.990842 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.991124 (+   282us) service_pool.cc:224] Handling call
0928 01:55:31.992510 (+  1386us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:31.992608 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:32.065474 (+ 72866us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:32.992107 (+926633us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:33.006304 (+ 14197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 01:55:33.021072 19412 leader_election.cc:343] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: Tablet not RUNNING: STOPPED
I20260928 01:55:33.022315 20320 tablet.cc:1751] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:33.022850 19412 leader_election.cc:304] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:33.012956 19475 raft_consensus.cc:2468] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:33.036337 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ab79c6ad03e481a903a0f95ae0512e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:33.045919 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a9c2db89fb8467d91c6bd01985d8b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:33.050309 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3505a502bff747deaf1e03c03375aafa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:33.037607 20148 ts_tablet_manager.cc:1916] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:33.057047 20297 raft_consensus.cc:2804] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:33.057678 20297 raft_consensus.cc:493] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:33.058202 20297 raft_consensus.cc:3060] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:33.062882 20147 ts_tablet_manager.cc:1929] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:33.063234 19890 tablet_bootstrap.cc:654] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:33.063498 20147 log.cc:1199] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/63a3540d1441404092db723b7e5cb61a
I20260928 01:55:33.064544 20147 ts_tablet_manager.cc:1950] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:33.047287 19764 raft_consensus.cc:2468] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:33.075826 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 75) took 5751 ms. Trace:
I20260928 01:55:33.076115 19446 tablet_service.cc:1511] Processing CreateTablet for tablet 0d5018f065824614a42f93afd49f770e (DEFAULT_TABLE table=default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:33.078151 19765 raft_consensus.cc:1240] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: [1.1-1.2]
I20260928 01:55:33.078706 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e1cc46939b4932a344b81c3bc8ca82" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:33.076606 20147 rpcz_store.cc:276] 0928 01:55:27.324798 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.324968 (+   170us) service_pool.cc:224] Handling call
0928 01:55:32.172174 (+4847206us) ts_tablet_manager.cc:1151] Deleting tablet 63a3540d1441404092db723b7e5cb61a
0928 01:55:32.237505 (+ 65331us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:32.778614 (+541109us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54000933d4. stack: 00007fd5309ed323 00007fd5309ed220 00007fd530591574 0000000000516964 00000000005168f9 00007fd537aeaaa1 00007fd537b89b22 00007fd537fca55c 00007fd538c33c3a 00007fd538c64960 00007fd538c4ae6d 00007fd538c4ae19 00007fd538c4ada9 00007fd538c4ad71 00007fd538c49f9d 00000000005bd4e4
0928 01:55:32.834512 (+ 55898us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.062737 (+228225us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.075747 (+ 13010us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237580544,"tablet-delete.queue_time_us":4768048}
I20260928 01:55:33.081197 19446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5018f065824614a42f93afd49f770e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:33.081156 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 63a3540d1441404092db723b7e5cb61a (table default.Table_2720a066cdca41b4998342e7fb48de23 [id=58b8eec416eb437f92897594371a012f]) successfully deleted
I20260928 01:55:33.089633 20029 tablet_bootstrap.cc:492] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:33.090118 20029 ts_tablet_manager.cc:1403] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.745s	user 0.015s	sys 0.004s
I20260928 01:55:33.109091 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 0d5018f065824614a42f93afd49f770e (DEFAULT_TABLE table=default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:33.111701 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5e07078b2a4fe59d9293d9511cbb6b (DEFAULT_TABLE table=default.Table_45ba8bc09f494400ad88a655691247ae [id=0da09ac1dc794d82b6f9323d0196b4cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:33.128588 19445 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5e07078b2a4fe59d9293d9511cbb6b (DEFAULT_TABLE table=default.Table_45ba8bc09f494400ad88a655691247ae [id=0da09ac1dc794d82b6f9323d0196b4cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:33.148123 19703 leader_election.cc:304] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
W20260928 01:55:33.151125 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 49331.2us
I20260928 01:55:33.155877 19746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44964 (request call id 126) took 1171 ms. Trace:
I20260928 01:55:33.159781 20292 raft_consensus.cc:2749] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:55:33.161860 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3540d1441404092db723b7e5cb61a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:33.163331 19763 raft_consensus.cc:2393] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:33.166090 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5018f065824614a42f93afd49f770e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:33.156282 19746 rpcz_store.cc:276] 0928 01:55:31.984139 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.984285 (+   146us) service_pool.cc:224] Handling call
0928 01:55:31.989651 (+  5366us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:31.989727 (+    76us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:32.872998 (+883271us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.047969 (+174971us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:33.155817 (+107848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:33.167235 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5e07078b2a4fe59d9293d9511cbb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:33.170778 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_d64c4b140b0f41cea6c0cc6314e6fbaf"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:33.173938 19114 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_f8b9950aa8284139a842273931f64732" } new_table_name: "default.Table_9fd15739cad24b449aed7e2a9f1066ba" modify_external_catalogs: true
W20260928 01:55:33.176708 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d64c4b140b0f41cea6c0cc6314e6fbaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:33.182265 20239 ts_tablet_manager.cc:1929] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 01:55:33.189901 19409 leader_election.cc:343] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:33.191072 19409 leader_election.cc:304] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:33.107133 19553 leader_election.cc:304] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:33.196811 20289 raft_consensus.cc:2749] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:33.198926 19590 tablet_service.cc:1511] Processing CreateTablet for tablet 0d5018f065824614a42f93afd49f770e (DEFAULT_TABLE table=default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:33.202421 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 45214.6us
W20260928 01:55:33.197089 19553 raft_consensus.cc:2686] T 63a3540d1441404092db723b7e5cb61a P a3ee288ca1464d20a715673422a214a0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:55:33.199227 20302 consensus_queue.cc:1059] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260928 01:55:33.208798 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 101755us
I20260928 01:55:33.223811 19113 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 158edf7a5d724c88992fecbadd2cedfa
I20260928 01:55:33.235859 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 81) took 5281 ms. Trace:
I20260928 01:55:33.236245 20029 raft_consensus.cc:359] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:33.237210 20029 raft_consensus.cc:385] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:33.237535 20029 raft_consensus.cc:740] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:33.241446 20147 rpcz_store.cc:276] 0928 01:55:27.954323 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.956306 (+  1983us) service_pool.cc:224] Handling call
0928 01:55:33.091687 (+5135381us) ts_tablet_manager.cc:1151] Deleting tablet 7bfcdfe218414396824a8f3af4d673ff
0928 01:55:33.091737 (+    50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:33.235782 (+144045us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5134359}
W20260928 01:55:33.243917 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 7bfcdfe218414396824a8f3af4d673ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bfcdfe218414396824a8f3af4d673ff already in progress: creating tablet
I20260928 01:55:33.239567 20029 consensus_queue.cc:260] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:33.253010 19438 tablet_service.cc:1558] Processing DeleteTablet for tablet 158edf7a5d724c88992fecbadd2cedfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:33.254154 19896 tablet_bootstrap.cc:654] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:33.230662 20239 log.cc:1199] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/457837143b0f4763a4b91bb25b580477
I20260928 01:55:33.262689 20239 ts_tablet_manager.cc:1950] T 457837143b0f4763a4b91bb25b580477 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:33.264835 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5e07078b2a4fe59d9293d9511cbb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:33.251916 19453 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 127) took 1222 ms. Trace:
I20260928 01:55:33.278220 20319 tablet.cc:1751] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:33.279904 19591 tablet_service.cc:1558] Processing DeleteTablet for tablet 158edf7a5d724c88992fecbadd2cedfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:33.267045 19440 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 133) took 1233 ms. Trace:
I20260928 01:55:33.301859 20292 raft_consensus.cc:493] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:33.303936 20029 ts_tablet_manager.cc:1434] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.214s	user 0.005s	sys 0.005s
I20260928 01:55:33.302410 20292 raft_consensus.cc:515] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:33.307672 20292 leader_election.cc:290] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:33.313071 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6d3c1d99cc40febd285d0a8f5c3196" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:33.313758 19620 raft_consensus.cc:2468] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:33.317041 19704 leader_election.cc:304] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:33.325038 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 131984us
I20260928 01:55:33.347798 20331 tablet.cc:1751] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:33.360634 19746 tablet_service.cc:1558] Processing DeleteTablet for tablet 158edf7a5d724c88992fecbadd2cedfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:44964
W20260928 01:55:33.318220 19739 consensus_meta.cc:287] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.010s
I20260928 01:55:33.372144 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5018f065824614a42f93afd49f770e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:33.376454 20147 tablet_replica.cc:333] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:33.377471 20147 raft_consensus.cc:2243] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:33.377487 19110 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 22606f012f1c44bd92c8e0341e9ca2b7
I20260928 01:55:33.378240 20147 raft_consensus.cc:2272] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:33.380280 19112 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 5d9b93f45ccf44e785b00849e49c8294
I20260928 01:55:33.380519 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:33.381731 19112 catalog_manager.cc:6934] ReplaceTablet: tablet 5d9b93f45ccf44e785b00849e49c8294 deleted and replaced by tablet 49a73835e2854976b40b31fe752d1b1b
I20260928 01:55:33.382036 19112 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51212 (request call id 175) took 1335 ms. Trace:
W20260928 01:55:33.384642 19117 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f887fe10461d40ee9363ce97ebbedd4f consensus state has no leader
I20260928 01:55:33.382333 19112 rpcz_store.cc:276] 0928 01:55:32.046267 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.046378 (+   111us) service_pool.cc:224] Handling call
0928 01:55:33.381984 (+1335606us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:33.119460 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:33.119895 (+   435us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:33.119920 (+    25us) write_op.cc:435] Acquired schema lock
0928 01:55:33.119935 (+    15us) tablet.cc:662] Decoding operations
0928 01:55:33.120284 (+   349us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:33.120324 (+    40us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:33.120361 (+    37us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:33.120584 (+   223us) tablet.cc:701] Row locks acquired
0928 01:55:33.120598 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:33.127303 (+  6705us) write_op.cc:270] Start()
0928 01:55:33.133514 (+  6211us) write_op.cc:276] Timestamp: P: 1790560533120631 usec, L: 0
0928 01:55:33.133534 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:55:33.183780 (+ 50246us) log.cc:844] Serialized 625 byte log entry
0928 01:55:33.210764 (+ 26984us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b6aa1 00007f19fd7495e8 00007f19fdbd9791 00007f19fdbd8f68 00007f19fdbddc01 00007f19fdbddbb9 00007f19fdbddb49 00007f19fdbddb11 00007f19fdbdcd3d 00000000005bd4e4 00000000005bd319
0928 01:55:33.377533 (+166769us) op_driver.cc:464] REPLICATION: finished
0928 01:55:33.377854 (+   321us) write_op.cc:301] APPLY: starting
0928 01:55:33.377917 (+    63us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:33.378076 (+   159us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:33.378111 (+    35us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:33.378608 (+   497us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:33.378900 (+   292us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:33.378972 (+    72us) write_op.cc:312] APPLY: finished
0928 01:55:33.379255 (+   283us) log.cc:844] Serialized 29 byte log entry
0928 01:55:33.379448 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:33.379550 (+   102us) write_op.cc:454] Released schema lock
0928 01:55:33.379619 (+    69us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":116,"apply.run_cpu_time_us":2022,"apply.run_wall_time_us":2022,"num_ops":2,"prepare.queue_time_us":305468,"prepare.run_cpu_time_us":4322,"prepare.run_wall_time_us":91439,"replication_time_us":243868,"spinlock_wait_cycles":100875008}]]}
I20260928 01:55:33.386179 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d9b93f45ccf44e785b00849e49c8294 with delete_type TABLET_DATA_DELETED (replaced by tablet 49a73835e2854976b40b31fe752d1b1b) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:33.400923 19439 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d9b93f45ccf44e785b00849e49c8294 with delete_type TABLET_DATA_DELETED (replaced by tablet 49a73835e2854976b40b31fe752d1b1b) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:33.411199 19767 raft_consensus.cc:1240] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: [1.1-1.2]
I20260928 01:55:33.413039 19743 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44964 (request call id 129) took 1051 ms. Trace:
I20260928 01:55:33.413563 19743 rpcz_store.cc:276] 0928 01:55:32.361366 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.427740 (+ 66374us) service_pool.cc:224] Handling call
0928 01:55:32.434845 (+  7105us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:32.434962 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:32.847560 (+412598us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.396840 (+549280us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:33.412961 (+ 16121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:33.416039 20147 ts_tablet_manager.cc:1916] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:33.420826 20337 tablet.cc:1751] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:33.425480 20328 tablet.cc:1751] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:33.397838 20329 tablet.cc:1751] T e2d1238d0a2d45c0a708442fd0b17291 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:33.435468 20029 tablet_bootstrap.cc:492] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:33.412739 19438 tablet_service.cc:1558] Processing DeleteTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:33.434331 20289 consensus_queue.cc:1059] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:33.405591 20161 raft_consensus.cc:2804] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:33.447609 20161 raft_consensus.cc:493] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:33.448137 20161 raft_consensus.cc:3060] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:33.460616 19890 tablet_bootstrap.cc:492] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:33.461192 19890 ts_tablet_manager.cc:1403] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.529s	user 0.009s	sys 0.012s
I20260928 01:55:33.473765 20332 tablet.cc:1751] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:33.272490 19453 rpcz_store.cc:276] 0928 01:55:32.029688 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.094544 (+ 64856us) service_pool.cc:224] Handling call
0928 01:55:32.241746 (+147202us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b5800000f98. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc19ec558a1 00007fc19ed99e7c 00007fc19ed99a3b 00007fc1a7ce4119 00007fc1a6f1ea70 00007fc1a7003e61 00007fc1a6fe10f3 00007fc1a6f8f640 00007fc1a5519bf4 00007fc1a5519b82 00007fc1a5519ab1
0928 01:55:32.257369 (+ 15623us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:32.257502 (+   133us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:32.844905 (+587403us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.149486 (+304581us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:33.248626 (+ 99140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10276608}
I20260928 01:55:33.286192 19440 rpcz_store.cc:276] 0928 01:55:32.032109 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.095167 (+ 63058us) service_pool.cc:224] Handling call
0928 01:55:32.104443 (+  9276us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:32.104571 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:32.808107 (+703536us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.073074 (+264967us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:33.265291 (+192217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:33.502002 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 120) took 2524 ms. Trace:
I20260928 01:55:33.502571 20239 rpcz_store.cc:276] 0928 01:55:30.977481 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.033778 (+ 56297us) service_pool.cc:224] Handling call
0928 01:55:32.576082 (+1542304us) ts_tablet_manager.cc:1151] Deleting tablet 457837143b0f4763a4b91bb25b580477
0928 01:55:32.576133 (+    51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:32.790614 (+214481us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.182114 (+391500us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.501911 (+319797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46415,"tablet-delete.queue_time_us":1427557}
W20260928 01:55:33.504436 19114 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca443386942e49d9a66143e1fde777c5 consensus state has no leader
I20260928 01:55:33.512825 20284 raft_consensus.cc:493] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:33.512948 19471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.2:44309 (request call id 62) took 1319 ms. Trace:
I20260928 01:55:33.513526 20284 raft_consensus.cc:515] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:33.520949 20284 leader_election.cc:290] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:33.545578 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 457837143b0f4763a4b91bb25b580477 (table default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]) successfully deleted
I20260928 01:55:33.546407 19890 raft_consensus.cc:359] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:33.566241 19739 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d9b93f45ccf44e785b00849e49c8294 with delete_type TABLET_DATA_DELETED (replaced by tablet 49a73835e2854976b40b31fe752d1b1b) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:33.566906 19890 raft_consensus.cc:385] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:55:33.567529 19742 consensus_meta.cc:287] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent flushing consensus metadata: real 0.566s	user 0.015s	sys 0.001s
I20260928 01:55:33.568351 19890 raft_consensus.cc:740] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:33.572916 19742 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44964 (request call id 128) took 1479 ms. Trace:
I20260928 01:55:33.510427 20320 tablet.cc:1751] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 3
I20260928 01:55:33.573416 19742 rpcz_store.cc:276] 0928 01:55:32.093509 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.361858 (+268349us) service_pool.cc:224] Handling call
0928 01:55:32.366045 (+  4187us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:32.366148 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:33.001160 (+635012us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.572314 (+571154us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:33.572834 (+   520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:33.577209 19890 consensus_queue.cc:260] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:33.580410 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:33.579232 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 119) took 2779 ms. Trace:
I20260928 01:55:33.588941 20239 rpcz_store.cc:276] 0928 01:55:30.799338 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.116346 (+317008us) service_pool.cc:224] Handling call
0928 01:55:33.526605 (+2410259us) ts_tablet_manager.cc:1151] Deleting tablet efa8a7589d314c25aeccf678c938ecf0
0928 01:55:33.528844 (+  2239us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:33.578564 (+ 49720us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2369473}
I20260928 01:55:33.596969 20029 tablet_bootstrap.cc:654] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:33.513478 19471 rpcz_store.cc:276] 0928 01:55:32.193091 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.239077 (+ 45986us) service_pool.cc:224] Handling call
0928 01:55:32.335747 (+ 96670us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 01:55:32.336899 (+  1152us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 01:55:32.337037 (+   138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 01:55:32.408330 (+ 71293us) alter_schema_op.cc:128] START. Timestamp: 1790560531628071
0928 01:55:33.001707 (+593377us) log.cc:844] Serialized 173 byte log entry
0928 01:55:33.396588 (+394881us) raft_consensus.cc:1645] Marking committed up to 1
0928 01:55:33.412550 (+ 15962us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:55:33.469613 (+ 57063us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:55:33.478454 (+  8841us) raft_consensus.cc:1685] finished
0928 01:55:33.484702 (+  6248us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:55:33.512398 (+ 27696us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:32.509115 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:55:32.583828 (+ 74713us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:55:32.583878 (+    50us) alter_schema_op.cc:66] Acquired schema lock
0928 01:55:32.594188 (+ 10310us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
Metrics: {"thread_start_us":385464,"threads_started":1,"wal-append.queue_time_us":389626,"child_traces":[["op",{"prepare.queue_time_us":100039,"prepare.run_cpu_time_us":1716,"prepare.run_wall_time_us":86308,"thread_start_us":197670,"threads_started":1}]]}
I20260928 01:55:33.597538 20239 tablet_replica.cc:333] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
W20260928 01:55:33.601066 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 296049us
I20260928 01:55:33.605561 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6d3c1d99cc40febd285d0a8f5c3196" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:33.614696 19118 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]). Expected version 1 got 0
I20260928 01:55:33.592461 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:33.618358 19763 raft_consensus.cc:2468] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:33.619822 19553 leader_election.cc:304] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:33.622864 19118 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 29) took 780 ms (client timeout 1000 ms). Trace:
W20260928 01:55:33.623267 19118 rpcz_store.cc:269] 0928 01:55:32.842918 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.856940 (+ 14022us) service_pool.cc:224] Handling call
0928 01:55:32.915194 (+ 58254us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:33.622795 (+707601us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":129555200}
I20260928 01:55:33.620885 20310 raft_consensus.cc:2804] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 01:55:33.629076 19115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 18) took 935 ms (client timeout 1000 ms). Trace:
I20260928 01:55:33.629192 20310 raft_consensus.cc:493] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:33.629956 20310 raft_consensus.cc:3060] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:33.629619 20161 raft_consensus.cc:515] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:33.629413 19115 rpcz_store.cc:269] 0928 01:55:32.694053 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.694217 (+   164us) service_pool.cc:224] Handling call
0928 01:55:32.713233 (+ 19016us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:33.629000 (+915767us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:33.315587 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:33.316036 (+   449us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:33.316062 (+    26us) write_op.cc:435] Acquired schema lock
0928 01:55:33.316077 (+    15us) tablet.cc:662] Decoding operations
0928 01:55:33.318858 (+  2781us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:33.318902 (+    44us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:33.318929 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:33.319143 (+   214us) tablet.cc:701] Row locks acquired
0928 01:55:33.319158 (+    15us) write_op.cc:260] PREPARE: finished
0928 01:55:33.319295 (+   137us) write_op.cc:270] Start()
0928 01:55:33.319386 (+    91us) write_op.cc:276] Timestamp: P: 1790560533310895 usec, L: 0
0928 01:55:33.319401 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:33.319967 (+   566us) log.cc:844] Serialized 530 byte log entry
0928 01:55:33.416642 (+ 96675us) op_driver.cc:464] REPLICATION: finished
0928 01:55:33.422509 (+  5867us) write_op.cc:301] APPLY: starting
0928 01:55:33.422626 (+   117us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:33.422770 (+   144us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:33.422963 (+   193us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:33.423297 (+   334us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:33.423499 (+   202us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:33.423593 (+    94us) write_op.cc:312] APPLY: finished
0928 01:55:33.423873 (+   280us) log.cc:844] Serialized 23 byte log entry
0928 01:55:33.607140 (+183267us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:33.607248 (+   108us) write_op.cc:454] Released schema lock
0928 01:55:33.607302 (+    54us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:33.607733 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:33.607773 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7219,"reported_tablets":7,"spinlock_wait_cycles":37673856,"child_traces":[["op",{"apply.queue_time_us":5654,"apply.run_cpu_time_us":2241,"apply.run_wall_time_us":185168,"num_ops":1,"prepare.queue_time_us":300580,"prepare.run_cpu_time_us":2236,"prepare.run_wall_time_us":4614,"replication_time_us":97090}]]}
I20260928 01:55:33.620345 19890 ts_tablet_manager.cc:1434] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.159s	user 0.004s	sys 0.006s
I20260928 01:55:33.637784 20239 raft_consensus.cc:2243] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:33.644191 20239 pending_rounds.cc:70] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: Trying to abort 1 pending ops.
I20260928 01:55:33.659044 19115 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_1e30aacb906b40aaa3a683c1495c78f2" } modify_external_catalogs: true
I20260928 01:55:33.659703 19115 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_1e30aacb906b40aaa3a683c1495c78f2" } modify_external_catalogs: true
I20260928 01:55:33.663223 19114 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_d6ec5f8939f84de7994041a54bdbe36b" } modify_external_catalogs: true
I20260928 01:55:33.663712 19114 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_d6ec5f8939f84de7994041a54bdbe36b" } modify_external_catalogs: true
I20260928 01:55:33.671123 19890 tablet_bootstrap.cc:492] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:33.680142 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet efa8a7589d314c25aeccf678c938ecf0 because the tablet was not found. No further retry: Not found: Tablet not found: efa8a7589d314c25aeccf678c938ecf0
W20260928 01:55:33.690598 20319 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.303s	user 0.002s	sys 0.005s
I20260928 01:55:33.681649 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_fc937fcafd1c43aa8dad79a6f33508cf"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:33.694514 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc937fcafd1c43aa8dad79a6f33508cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:33.708741 20344 tablet.cc:1751] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:33.719414 20332 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:44964 (request call id 142) took 1039 ms. Trace:
I20260928 01:55:33.729142 20147 ts_tablet_manager.cc:1929] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:33.647625 20239 pending_rounds.cc:77] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7334135937048625152 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "05f875e126f04415a108f778a76bb0f5" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_2c6a423a3158495a98d244242381a423" dest_uuid: "37089d44fdba4b6488b5b5aea28af614" new_extra_config { } }
W20260928 01:55:33.746248 19409 consensus_peers.cc:597] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:33.747503 20239 raft_consensus.cc:2272] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:33.752065 20340 consensus_queue.cc:1048] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.072s
I20260928 01:55:33.748095 19472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.3:54577 (request call id 87) took 1433 ms. Trace:
I20260928 01:55:33.772406 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:33.755436 19472 rpcz_store.cc:276] 0928 01:55:32.038665 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.095365 (+ 56700us) service_pool.cc:224] Handling call
0928 01:55:32.134033 (+ 38668us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b5800000f98. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc19ec558a1 00007fc19ed99b51 00007fc19ed99a02 00007fc1a7ce4119 00007fc1a6f1ea70 00007fc1a6fe76db 00007fc1a6fe7761 00007fc1a6fa9570 00007fc1a6f93b69 00007fc1a6f93612 00007fc1a560fd34
0928 01:55:32.134210 (+   177us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 01:55:32.550066 (+415856us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 01:55:32.576829 (+ 26763us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 01:55:32.656988 (+ 80159us) log.cc:844] Serialized 26 byte log entry
0928 01:55:32.821979 (+164991us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b4800003558. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc1a6ef9641 00007fc1a6ef06d7 00007fc1a6ef056a 00007fc1a6fe789f 00007fc1a6fe7567 00007fc1a6ffbb8c 00007fc1a6ffbb38 00007fc1a6ffbab8 00007fc1a6ffba73 00007fc1a6ffad1c 00007fc1a6397876
0928 01:55:33.267472 (+445493us) raft_consensus.cc:1645] Marking committed up to 0
0928 01:55:33.273526 (+  6054us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:55:33.300189 (+ 26663us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:55:33.300516 (+   327us) raft_consensus.cc:1685] finished
0928 01:55:33.386168 (+ 85652us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:55:33.452689 (+ 66521us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":452757,"raft.run_cpu_time_us":4375,"raft.run_wall_time_us":242731,"spinlock_wait_cycles":29238912,"thread_start_us":822887,"threads_started":2,"wal-append.queue_time_us":431274}
I20260928 01:55:33.751479 20161 leader_election.cc:290] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:33.784448 19105 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 33e1cc46939b4932a344b81c3bc8ca82 (table default.Table_1a6a047e1e8f4430a6756891154a5e3b [id=c9816a660a324eb9a6eeb87f2f1e9422], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 33e1cc46939b4932a344b81c3bc8ca82 consensus state has no leader
I20260928 01:55:33.752132 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6d3c1d99cc40febd285d0a8f5c3196" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:33.793143 19617 raft_consensus.cc:3060] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:33.798130 19765 raft_consensus.cc:1240] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: [1.1-1.2]
I20260928 01:55:33.803047 20147 log.cc:1199] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/efa8a7589d314c25aeccf678c938ecf0
I20260928 01:55:33.803946 20147 ts_tablet_manager.cc:1950] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:33.807717 20029 tablet_bootstrap.cc:492] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
W20260928 01:55:33.800647 20259 consensus_meta.cc:287] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.913s	user 0.014s	sys 0.009s
I20260928 01:55:33.818996 20302 consensus_queue.cc:1059] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260928 01:55:33.830595 19617 raft_consensus.cc:2468] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:33.832957 19890 tablet_bootstrap.cc:654] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:33.836778 19556 leader_election.cc:343] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:33.842126 20331 tablet.cc:1746] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0: Skipping requested alter to schema version 2, tablet already version 2
W20260928 01:55:33.845793 19409 consensus_peers.cc:597] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 457837143b0f4763a4b91bb25b580477. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:33.854825 20029 ts_tablet_manager.cc:1403] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.419s	user 0.013s	sys 0.005s
I20260928 01:55:33.854055 20329 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:47670 (request call id 114) took 2361 ms. Trace:
I20260928 01:55:33.858763 20352 tablet.cc:1751] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:33.831702 20259 raft_consensus.cc:2749] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:55:33.867587 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 168646us
I20260928 01:55:33.860455 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 84) took 5890 ms. Trace:
I20260928 01:55:33.875221 20147 rpcz_store.cc:276] 0928 01:55:27.969560 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.969866 (+   306us) service_pool.cc:224] Handling call
0928 01:55:33.244578 (+5274712us) ts_tablet_manager.cc:1151] Deleting tablet efa8a7589d314c25aeccf678c938ecf0
0928 01:55:33.308653 (+ 64075us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b5800000f98. stack: 00007fd5309ed323 00007fd5309ed220 00007fd530591574 0000000000516964 00000000005168f9 00007fd5308a38a1 00007fd5309e7b51 00007fd5309e8182 00007fd53995b2c9 00007fd538b6c918 00007fd538c332c9 00007fd538c338c3 00007fd538c64960 00007fd538c4ae6d 00007fd538c4ae19 00007fd538c4ada9
0928 01:55:33.371306 (+ 62653us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:33.564157 (+192851us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.728997 (+164840us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.860373 (+131376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142915840,"tablet-delete.queue_time_us":5273318}
I20260928 01:55:33.876715 20147 tablet_replica.cc:333] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:33.877563 20147 raft_consensus.cc:2243] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:33.878162 20147 raft_consensus.cc:2272] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:33.719806 20332 rpcz_store.cc:276] 0928 01:55:32.679631 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.680337 (+   706us) service_pool.cc:224] Handling call
0928 01:55:33.719348 (+1039011us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:32.843722 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:55:32.844220 (+   498us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:55:32.844260 (+    40us) alter_schema_op.cc:66] Acquired schema lock
0928 01:55:32.844363 (+   103us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:55:32.844500 (+   137us) alter_schema_op.cc:128] START. Timestamp: 1790560532844403
0928 01:55:32.844535 (+    35us) op_driver.cc:348] REPLICATION: starting
0928 01:55:32.845283 (+   748us) log.cc:844] Serialized 173 byte log entry
0928 01:55:33.140759 (+295476us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b180000b8c0. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a23024b81 00007f0a23031571 00007f0a1a12a363 00007f0a1a12c751 00007f0a1a12c709 00007f0a1a12c699 00007f0a1a12c661 00007f0a1a12b95d 00000000005bd4e4 00000000005bd319 00007f0a1a10d81a
0928 01:55:33.141173 (+   414us) op_driver.cc:464] REPLICATION: finished
0928 01:55:33.352706 (+211533us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:55:33.482466 (+129760us) log.cc:844] Serialized 5 byte log entry
0928 01:55:33.717129 (+234663us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.718536 (+  1407us) log.cc:844] Serialized 14 byte log entry
0928 01:55:33.719203 (+   667us) alter_schema_op.cc:73] Released schema lock
0928 01:55:33.719244 (+    41us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":211253,"prepare.queue_time_us":119088,"prepare.run_cpu_time_us":2574,"prepare.run_wall_time_us":176238,"raft.queue_time_us":99073,"raft.run_cpu_time_us":5567,"raft.run_wall_time_us":170050,"replication_time_us":296475,"spinlock_wait_cycles":68551936,"thread_start_us":333287,"threads_started":3,"wal-append.queue_time_us":68279}]]}
I20260928 01:55:33.832127 20310 raft_consensus.cc:515] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:33.820964 20239 ts_tablet_manager.cc:1916] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:33.833638 19704 leader_election.cc:304] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:33.882419 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 48887us
I20260928 01:55:33.868083 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6d3c1d99cc40febd285d0a8f5c3196" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:33.885437 20340 raft_consensus.cc:2804] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:33.886320 20292 consensus_queue.cc:1048] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:33.887992 20338 tablet.cc:1751] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 3
I20260928 01:55:33.889900 20340 raft_consensus.cc:697] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:33.890920 20340 consensus_queue.cc:237] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:33.909142 19890 tablet_bootstrap.cc:492] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:33.909668 19890 ts_tablet_manager.cc:1403] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.239s	user 0.004s	sys 0.010s
W20260928 01:55:33.853724 19703 leader_election.cc:343] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:33.918161 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 64479.6us
I20260928 01:55:33.917694 19473 raft_consensus.cc:2468] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:55:33.924743 19473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.18.161.2:44309 (request call id 67) took 1065 ms. Trace:
I20260928 01:55:33.925390 19473 rpcz_store.cc:276] 0928 01:55:32.859298 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.859445 (+   147us) service_pool.cc:224] Handling call
0928 01:55:33.924446 (+1065001us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000d0cd4. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc1a5e9caa1 00007fc1a5f37aba 00007fc1a6f94d57 00007fc1a5614834 00007fc1a56147c2 00007fc1a56146f1 00007fc1a561466c 00007fc1a5613922 00007fc1a3c0209c 00007fc1a3c014d6 00007fc1a3c00e7f
0928 01:55:33.924637 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302379776}
I20260928 01:55:33.934369 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:33.935297 19765 raft_consensus.cc:3060] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:33.880302 20147 ts_tablet_manager.cc:1916] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:33.947561 20293 raft_consensus.cc:3055] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:55:33.931232 20310 leader_election.cc:290] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:33.948261 20293 raft_consensus.cc:740] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:33.955806 20293 consensus_queue.cc:260] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:33.958057 20293 raft_consensus.cc:3060] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:33.958757 19111 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_45ba8bc09f494400ad88a655691247ae" } new_table_name: "default.Table_deb7dc16f0794afd95d9f29bed3a5621" modify_external_catalogs: true
I20260928 01:55:33.872383 20329 rpcz_store.cc:276] 0928 01:55:31.492724 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.492844 (+   120us) service_pool.cc:224] Handling call
0928 01:55:33.853918 (+2361074us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:31.591050 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:55:31.627572 (+ 36522us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:55:31.627784 (+   212us) alter_schema_op.cc:66] Acquired schema lock
0928 01:55:31.627969 (+   185us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:55:31.637113 (+  9144us) alter_schema_op.cc:128] START. Timestamp: 1790560531628071
0928 01:55:31.637261 (+   148us) op_driver.cc:348] REPLICATION: starting
0928 01:55:31.641425 (+  4164us) log.cc:844] Serialized 173 byte log entry
0928 01:55:33.210560 (+1569135us) op_driver.cc:464] REPLICATION: finished
0928 01:55:33.397638 (+187078us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:55:33.466261 (+ 68623us) log.cc:844] Serialized 5 byte log entry
0928 01:55:33.724195 (+257934us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.780686 (+ 56491us) log.cc:844] Serialized 14 byte log entry
0928 01:55:33.782167 (+  1481us) alter_schema_op.cc:73] Released schema lock
0928 01:55:33.836440 (+ 54273us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
0928 01:55:33.852826 (+ 16386us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b540012b2a8. stack: 00007fd5309ed323 00007fd5309ed220 00007fd530591574 0000000000516964 00000000005168f9 00007fd539ee6c21 00007fd539ee588c 00007fd53800771d 00007fd5380075ba 00007fd538007467 00007fd53800f599 00007fd53800ed63 00007fd538012f71 00007fd538012f29 00007fd538012eb9 00007fd538012e81
Metrics: {"child_traces":[["op",{"apply.queue_time_us":186800,"prepare.queue_time_us":28756,"prepare.run_cpu_time_us":55829,"prepare.run_wall_time_us":667571,"replication_time_us":1573162,"spinlock_wait_cycles":31827840,"thread_start_us":662249,"threads_started":3,"wal-append.queue_time_us":632339,"wal-append.run_cpu_time_us":1618,"wal-append.run_wall_time_us":1025214}]]}
I20260928 01:55:33.979264 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_9ed6c2517322426b846b7a00c9d19b22"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:33.981153 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ed6c2517322426b846b7a00c9d19b22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:33.986195 19896 tablet_bootstrap.cc:492] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:33.986810 19896 ts_tablet_manager.cc:1403] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 1.160s	user 0.020s	sys 0.018s
I20260928 01:55:33.989073 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_fc433ca62dc241a89de45a60e9a5db1e"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:33.990728 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc433ca62dc241a89de45a60e9a5db1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:33.995645 19117 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_b84c85e1d5154100a2dea07591b9a420" } new_table_name: "default.Table_2ba0a32bb9a441bdba3ac63f08ae026f" modify_external_catalogs: true
I20260928 01:55:34.000380 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_919e392236f9437fb1c2f9fee1f94f84"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:34.002223 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_919e392236f9437fb1c2f9fee1f94f84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:33.939911 19890 raft_consensus.cc:359] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:34.003294 19890 raft_consensus.cc:385] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:34.003557 19890 raft_consensus.cc:740] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:34.004438 19890 consensus_queue.cc:260] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:34.007071 19890 ts_tablet_manager.cc:1434] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260928 01:55:34.014428 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet efa8a7589d314c25aeccf678c938ecf0 (table default.Table_b84c85e1d5154100a2dea07591b9a420 [id=3e43587428fb4c679f8222cf3c30d08d]) successfully deleted
W20260928 01:55:34.034094 19703 leader_election.cc:343] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:34.039314 20029 raft_consensus.cc:359] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:34.045679 20029 raft_consensus.cc:385] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:34.046355 20029 raft_consensus.cc:740] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:34.046667 19890 tablet_bootstrap.cc:492] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:34.047360 20029 consensus_queue.cc:260] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:34.051259 19470 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.002s	sys 0.013s
W20260928 01:55:34.051841 19470 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.003s	sys 0.014s
I20260928 01:55:34.056542 20341 tablet.cc:1751] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
W20260928 01:55:34.058176 20363 log.cc:927] Time spent T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.090s	user 0.000s	sys 0.002s
W20260928 01:55:34.072271 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 64691.2us
I20260928 01:55:34.075680 19890 tablet_bootstrap.cc:654] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:34.098892 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:34.102552 20147 ts_tablet_manager.cc:1929] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:34.112397 20147 log.cc:1199] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/457837143b0f4763a4b91bb25b580477
I20260928 01:55:34.113420 20147 ts_tablet_manager.cc:1950] T 457837143b0f4763a4b91bb25b580477 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:34.116820 19456 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 122) took 2090 ms. Trace:
I20260928 01:55:34.115521 19890 tablet_bootstrap.cc:492] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:34.117641 19890 ts_tablet_manager.cc:1403] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.002s
I20260928 01:55:34.117264 19456 rpcz_store.cc:276] 0928 01:55:32.026837 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.092537 (+ 65700us) service_pool.cc:224] Handling call
0928 01:55:32.245820 (+153283us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:32.245922 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:33.482031 (+1236109us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:33.845372 (+363341us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:34.116425 (+271053us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b5800000f98. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc19ec558a1 00007fc19ed99b51 00007fc19ed9a182 00007fc1a7d0d2c9 00007fc1a6f1e918 00007fc1a6fe4fa3 00007fc1a6fe0d3f 00007fc1a6fe14fd 00007fc1a6f8f640 00007fc1a5519bf4 00007fc1a5519b82
0928 01:55:34.116750 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98102144}
I20260928 01:55:34.120594 19890 raft_consensus.cc:359] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:34.121755 19442 consensus_meta.cc:287] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.006s
I20260928 01:55:34.122051 19890 raft_consensus.cc:385] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:55:34.123198 19447 consensus_meta.cc:287] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.001s
I20260928 01:55:34.124063 19890 raft_consensus.cc:740] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
W20260928 01:55:34.124523 19441 consensus_meta.cc:287] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.879s	user 0.012s	sys 0.007s
I20260928 01:55:34.125393 19890 consensus_queue.cc:260] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:34.132373 19470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.2:44309 (request call id 70) took 1058 ms. Trace:
I20260928 01:55:34.132962 19470 rpcz_store.cc:276] 0928 01:55:33.074416 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.150811 (+ 76395us) service_pool.cc:224] Handling call
0928 01:55:33.249317 (+ 98506us) raft_consensus.cc:1471] Updating replica for 0 ops
0928 01:55:33.249684 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 2
0928 01:55:34.064706 (+815022us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0928 01:55:34.082916 (+ 18210us) raft_consensus.cc:1645] Marking committed up to 2
0928 01:55:34.090666 (+  7750us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:55:34.124105 (+ 33439us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:55:34.132277 (+  8172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:34.122942 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 86) took 5905 ms. Trace:
I20260928 01:55:34.141039 20344 tablet.cc:1746] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da: Skipping requested alter to schema version 2, tablet already version 2
I20260928 01:55:34.140473 20147 rpcz_store.cc:276] 0928 01:55:28.217661 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.218894 (+  1233us) service_pool.cc:224] Handling call
0928 01:55:33.876550 (+5657656us) ts_tablet_manager.cc:1151] Deleting tablet 457837143b0f4763a4b91bb25b580477
0928 01:55:33.876599 (+    49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:34.039148 (+162549us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.102381 (+ 63233us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.122865 (+ 20484us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5656883}
I20260928 01:55:34.142041 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 85) took 5924 ms. Trace:
I20260928 01:55:34.152328 20147 rpcz_store.cc:276] 0928 01:55:28.217383 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.236315 (+ 18932us) service_pool.cc:224] Handling call
0928 01:55:34.141731 (+5905416us) ts_tablet_manager.cc:1151] Deleting tablet 952df055998942f89baabb341e204f43
0928 01:55:34.141791 (+    60us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:34.141978 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5904716}
I20260928 01:55:34.153928 20147 tablet_replica.cc:333] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:34.154814 20147 raft_consensus.cc:2243] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:34.158365 20147 raft_consensus.cc:2272] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:34.156634 20329 tablet.cc:1751] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 4
I20260928 01:55:34.159873 19556 leader_election.cc:304] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:34.163724 19556 raft_consensus.cc:2686] T efa8a7589d314c25aeccf678c938ecf0 P a3ee288ca1464d20a715673422a214a0: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 01:55:34.138648 19446 consensus_meta.cc:287] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.892s	user 0.010s	sys 0.011s
W20260928 01:55:34.155233 20297 consensus_meta.cc:287] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 1.082s	user 0.025s	sys 0.000s
I20260928 01:55:34.191246 20029 ts_tablet_manager.cc:1434] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.336s	user 0.010s	sys 0.000s
I20260928 01:55:34.199322 20029 tablet_bootstrap.cc:492] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:34.199958 19896 raft_consensus.cc:359] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:34.200747 19896 raft_consensus.cc:385] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:34.201028 19896 raft_consensus.cc:740] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:34.201726 19896 consensus_queue.cc:260] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:34.204576 19441 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 132) took 2172 ms. Trace:
I20260928 01:55:34.205090 19441 rpcz_store.cc:276] 0928 01:55:32.031744 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.095075 (+ 63331us) service_pool.cc:224] Handling call
0928 01:55:32.246332 (+151257us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:32.252235 (+  5903us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:33.245412 (+993177us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.130593 (+885181us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:34.204494 (+ 73901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:34.204500 20344 tablet.cc:1751] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 4
I20260928 01:55:34.167714 19442 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 131) took 2136 ms. Trace:
I20260928 01:55:34.132002 19765 raft_consensus.cc:2468] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:34.212126 19447 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 123) took 2184 ms. Trace:
I20260928 01:55:34.212700 19447 rpcz_store.cc:276] 0928 01:55:32.027263 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.095247 (+ 67984us) service_pool.cc:224] Handling call
0928 01:55:32.244157 (+148910us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:32.244298 (+   141us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:33.548575 (+1304277us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.123740 (+575165us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:34.212041 (+ 88301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:34.216821 19446 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 142) took 1142 ms. Trace:
I20260928 01:55:34.217408 19446 rpcz_store.cc:276] 0928 01:55:33.074512 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.074722 (+   210us) service_pool.cc:224] Handling call
0928 01:55:33.080272 (+  5550us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:33.080465 (+   193us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:33.246745 (+166280us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.193656 (+946911us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:34.216734 (+ 23078us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:34.188427 20297 raft_consensus.cc:515] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:34.235399 20239 ts_tablet_manager.cc:1929] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 01:55:34.238184 20297 leader_election.cc:290] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:34.239389 19445 consensus_meta.cc:287] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614: Time spent flushing consensus metadata: real 0.563s	user 0.016s	sys 0.000s
I20260928 01:55:34.251717 19450 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 121) took 2225 ms. Trace:
I20260928 01:55:34.240453 19445 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 141) took 1296 ms. Trace:
I20260928 01:55:34.151978 19890 ts_tablet_manager.cc:1434] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260928 01:55:34.267616 19890 tablet_bootstrap.cc:492] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:34.268216 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 108426us
I20260928 01:55:34.269042 20239 log.cc:1199] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/05f875e126f04415a108f778a76bb0f5
I20260928 01:55:34.269894 20239 ts_tablet_manager.cc:1950] T 05f875e126f04415a108f778a76bb0f5 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:34.178892 20147 ts_tablet_manager.cc:1916] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:34.272346 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 124) took 2289 ms. Trace:
I20260928 01:55:34.272687 20239 rpcz_store.cc:276] 0928 01:55:31.983195 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.990614 (+  7419us) service_pool.cc:224] Handling call
0928 01:55:33.590768 (+1600154us) ts_tablet_manager.cc:1151] Deleting tablet 05f875e126f04415a108f778a76bb0f5
0928 01:55:33.597324 (+  6556us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:33.643907 (+ 46583us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b54000c1054. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a211f5aa1 00007f0a21294b22 00007f0a216d555c 00007f0a2233ec3a 00007f0a2236f960 00007f0a22355e6d 00007f0a22355e19 00007f0a22355da9 00007f0a22355d71 00007f0a22354f9d 00000000005bd4e4
0928 01:55:34.193166 (+549259us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.235232 (+ 42066us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.272271 (+ 37039us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37173120,"tablet-delete.queue_time_us":1599501}
I20260928 01:55:34.275729 19454 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 124) took 2248 ms. Trace:
W20260928 01:55:34.277681 20352 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.203s	user 0.001s	sys 0.004s
I20260928 01:55:34.278530 20239 tablet_replica.cc:333] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:34.279431 20239 raft_consensus.cc:2243] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:34.279958 20239 raft_consensus.cc:2272] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:34.214950 19553 leader_election.cc:304] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:34.280630 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 65785us
I20260928 01:55:34.281798 20310 raft_consensus.cc:2804] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:34.282066 20239 ts_tablet_manager.cc:1916] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:34.282326 20310 raft_consensus.cc:697] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:34.283241 20310 consensus_queue.cc:237] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:34.239591 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e1cc46939b4932a344b81c3bc8ca82" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:34.251062 20029 tablet_bootstrap.cc:654] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:34.288746 19765 raft_consensus.cc:3060] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:34.236562 19442 rpcz_store.cc:276] 0928 01:55:32.031223 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.072312 (+ 41089us) service_pool.cc:224] Handling call
0928 01:55:32.244488 (+172176us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:32.244592 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:33.557244 (+1312652us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.122494 (+565250us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:34.155819 (+ 33325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:34.266114 19445 rpcz_store.cc:276] 0928 01:55:33.000352 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.010975 (+ 10623us) service_pool.cc:224] Handling call
0928 01:55:33.129656 (+118681us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:33.193570 (+ 63914us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:33.675764 (+482194us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.239859 (+564095us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:34.240384 (+   525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:34.270215 19450 rpcz_store.cc:276] 0928 01:55:32.026393 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.094762 (+ 68369us) service_pool.cc:224] Handling call
0928 01:55:32.242598 (+147836us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b5800000f98. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc19ec558a1 00007fc19ed99e7c 00007fc19ed99a3b 00007fc1a7ce4119 00007fc1a6f1ea70 00007fc1a7003e61 00007fc1a6fe10f3 00007fc1a6f8f640 00007fc1a5519bf4 00007fc1a5519b82 00007fc1a5519ab1
0928 01:55:32.257722 (+ 15124us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:32.257839 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:33.786647 (+1528808us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.250965 (+464318us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:34.251640 (+   675us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5772672}
I20260928 01:55:34.313747 19890 tablet_bootstrap.cc:654] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:34.315636 20148 ts_tablet_manager.cc:1929] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:34.318390 20148 log.cc:1199] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/c8bbb627a14a477c9362d2b250f27c1e
I20260928 01:55:34.319440 20148 ts_tablet_manager.cc:1950] T c8bbb627a14a477c9362d2b250f27c1e P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:34.320508 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 68) took 7538 ms. Trace:
I20260928 01:55:34.320883 20148 rpcz_store.cc:276] 0928 01:55:26.782374 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.782545 (+   171us) service_pool.cc:224] Handling call
0928 01:55:32.824794 (+6042249us) ts_tablet_manager.cc:1151] Deleting tablet c8bbb627a14a477c9362d2b250f27c1e
0928 01:55:32.824891 (+    97us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:34.110358 (+1285467us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.315491 (+205133us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.320441 (+  4950us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29513,"tablet-delete.queue_time_us":6041604}
I20260928 01:55:34.322676 20148 tablet_replica.cc:333] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:34.332089 20029 tablet_bootstrap.cc:492] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:34.332598 20029 ts_tablet_manager.cc:1403] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.133s	user 0.007s	sys 0.013s
I20260928 01:55:34.335458 20029 raft_consensus.cc:359] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:34.336302 20029 raft_consensus.cc:385] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:34.276080 19454 rpcz_store.cc:276] 0928 01:55:32.027633 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.094711 (+ 67078us) service_pool.cc:224] Handling call
0928 01:55:32.244712 (+150001us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:32.245652 (+   940us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:34.143963 (+1898311us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.273440 (+129477us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:34.275667 (+  2227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:34.336612 20029 raft_consensus.cc:740] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:34.346696 20029 consensus_queue.cc:260] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:34.360934 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 982c3e07bcb94230b93764330914630f (DEFAULT_TABLE table=default.Table_39aacd0daa1b4dc2ac37b6aec34468bf [id=091b5a4098aa4735adb1bf56bff7d3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.361706 19742 tablet_service.cc:1511] Processing CreateTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 (DEFAULT_TABLE table=default.Table_3ce866b8da2a4181bedfe396a59a2b76 [id=2e72bf3c803b4352af5b9d6300abbd35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.362164 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982c3e07bcb94230b93764330914630f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.362739 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89e1d60db21f4a8294792df3fadf5d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.360934 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 0b222e5366a64f52bc97acd551c7a067 (DEFAULT_TABLE table=default.Table_adb5ab9de36441229bdfdfceffe4604e [id=65e97905d20f4bce9e010a056883d7b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.365031 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b222e5366a64f52bc97acd551c7a067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.364895 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 7daa1b799e0d408287edc03988f5b683 (DEFAULT_TABLE table=default.Table_7b0eeaea0af144bf8165b6228c454e7e [id=a051e78b19ab4fe1be3db9e064eaf56d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.359754 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 664b608bb0f54fc5baa10622f7d916c1 (DEFAULT_TABLE table=default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.365816 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7daa1b799e0d408287edc03988f5b683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.366525 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 664b608bb0f54fc5baa10622f7d916c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.377463 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 05f875e126f04415a108f778a76bb0f5 (table default.Table_2c6a423a3158495a98d244242381a423 [id=10dc4468b0ce4b2c87cecd4c66cc5300]) successfully deleted
I20260928 01:55:34.389753 20029 ts_tablet_manager.cc:1434] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260928 01:55:34.405591 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet c8bbb627a14a477c9362d2b250f27c1e (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]) successfully deleted
I20260928 01:55:34.410854 20029 tablet_bootstrap.cc:492] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:55:34.422217 19111 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a5e07078b2a4fe59d9293d9511cbb6b consensus state has no leader
I20260928 01:55:34.429797 19113 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:34.435021 20239 ts_tablet_manager.cc:1929] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:34.437355 20239 log.cc:1199] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/eaa1e9b7119d46a2ba2652a893877c8c
I20260928 01:55:34.438282 20239 ts_tablet_manager.cc:1950] T eaa1e9b7119d46a2ba2652a893877c8c P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:34.439399 19445 tablet_service.cc:1511] Processing CreateTablet for tablet 982c3e07bcb94230b93764330914630f (DEFAULT_TABLE table=default.Table_39aacd0daa1b4dc2ac37b6aec34468bf [id=091b5a4098aa4735adb1bf56bff7d3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.439416 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 0b222e5366a64f52bc97acd551c7a067 (DEFAULT_TABLE table=default.Table_adb5ab9de36441229bdfdfceffe4604e [id=65e97905d20f4bce9e010a056883d7b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.436666 20029 tablet_bootstrap.cc:654] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:34.440727 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982c3e07bcb94230b93764330914630f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.443867 19454 tablet_service.cc:1511] Processing CreateTablet for tablet 664b608bb0f54fc5baa10622f7d916c1 (DEFAULT_TABLE table=default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.444500 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b222e5366a64f52bc97acd551c7a067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.445487 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 664b608bb0f54fc5baa10622f7d916c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.445616 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 125) took 2462 ms. Trace:
I20260928 01:55:34.446143 20239 rpcz_store.cc:276] 0928 01:55:31.983648 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.991352 (+  7704us) service_pool.cc:224] Handling call
0928 01:55:34.278208 (+2286856us) ts_tablet_manager.cc:1151] Deleting tablet eaa1e9b7119d46a2ba2652a893877c8c
0928 01:55:34.278398 (+   190us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:34.340409 (+ 62011us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.434873 (+ 94464us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.445540 (+ 10667us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2286295}
I20260928 01:55:34.449388 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 130) took 2007 ms. Trace:
I20260928 01:55:34.450656 20338 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:39104 (request call id 110) took 3744 ms. Trace:
I20260928 01:55:34.451226 20239 rpcz_store.cc:276] 0928 01:55:32.442247 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.442404 (+   157us) service_pool.cc:224] Handling call
0928 01:55:34.448990 (+2006586us) ts_tablet_manager.cc:1151] Deleting tablet f3741aec215343468b2d7bc952da03c8
0928 01:55:34.449042 (+    52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:34.449327 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2005365}
I20260928 01:55:34.457348 19442 tablet_service.cc:1511] Processing CreateTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 (DEFAULT_TABLE table=default.Table_3ce866b8da2a4181bedfe396a59a2b76 [id=2e72bf3c803b4352af5b9d6300abbd35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.458623 20239 tablet_replica.cc:333] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:34.461373 20239 raft_consensus.cc:2243] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:34.461635 19116 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:34.462735 20239 raft_consensus.cc:2272] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 01:55:34.466092 19117 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2156dae74ee748cd845b6dea1d3b8ea8 consensus state has no leader
I20260928 01:55:34.468942 19896 ts_tablet_manager.cc:1434] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.482s	user 0.014s	sys 0.000s
I20260928 01:55:34.471292 20239 ts_tablet_manager.cc:1916] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:34.474134 19442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89e1d60db21f4a8294792df3fadf5d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.474419 19444 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 129) took 2444 ms. Trace:
I20260928 01:55:34.474794 19444 rpcz_store.cc:276] 0928 01:55:32.030490 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.095195 (+ 64705us) service_pool.cc:224] Handling call
0928 01:55:32.243787 (+148592us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:32.243896 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:34.188257 (+1944361us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.354139 (+165882us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:34.474354 (+120215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:34.439426 19443 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39104 (request call id 130) took 2408 ms. Trace:
I20260928 01:55:34.476513 20310 raft_consensus.cc:493] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:34.477061 20310 raft_consensus.cc:515] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:34.480319 19118 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 77c1f247486548ee9747403f7f80e3dc (table default.Table_2171ab69dd564f6897eb22381bb0a5b6 [id=328e52a4270e476faf1b10d89af3a56c]). Expected version 1 got 0
I20260928 01:55:34.480408 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a71904514a488083426f5fe07d12cd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:34.481843 19896 tablet_bootstrap.cc:492] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:34.482110 19553 leader_election.cc:343] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:34.483129 20310 leader_election.cc:290] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:34.459252 20294 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39104: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.522s ago.
I20260928 01:55:34.480577 20319 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:39104 (request call id 120) took 3030 ms. Trace:
I20260928 01:55:34.476167 19443 rpcz_store.cc:276] 0928 01:55:32.030848 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.095121 (+ 64273us) service_pool.cc:224] Handling call
0928 01:55:32.246065 (+150944us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:32.246203 (+   138us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:34.209138 (+1962935us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.438939 (+229801us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:34.439368 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:34.465277 20352 tablet.cc:1751] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 4
I20260928 01:55:34.495384 20148 raft_consensus.cc:2243] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:34.502673 20029 tablet_bootstrap.cc:492] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:34.503152 20029 ts_tablet_manager.cc:1403] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.001s
I20260928 01:55:34.505744 20029 raft_consensus.cc:359] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:34.506371 20029 raft_consensus.cc:385] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:34.506626 20029 raft_consensus.cc:740] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:34.507544 20029 consensus_queue.cc:260] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:34.509900 20148 raft_consensus.cc:2272] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:34.513844 20148 ts_tablet_manager.cc:1916] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:34.514169 19765 raft_consensus.cc:2468] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:34.515424 19409 leader_election.cc:304] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:34.516224 20259 raft_consensus.cc:2804] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:34.516274 20289 raft_consensus.cc:493] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:34.516686 20259 raft_consensus.cc:697] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:34.524852 20029 ts_tablet_manager.cc:1434] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260928 01:55:34.526607 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet eaa1e9b7119d46a2ba2652a893877c8c (table default.Table_9ebdf86862884825a8be67c95fd3f412 [id=2961b396aa0e488e8440ed77d774588c]) successfully deleted
W20260928 01:55:34.527521 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet f3741aec215343468b2d7bc952da03c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3741aec215343468b2d7bc952da03c8 already in progress: creating tablet
I20260928 01:55:34.531857 20029 tablet_bootstrap.cc:492] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:34.516788 20289 raft_consensus.cc:515] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:34.451081 20338 rpcz_store.cc:276] 0928 01:55:30.705940 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.728360 (+ 22420us) service_pool.cc:224] Handling call
0928 01:55:34.450514 (+3722154us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:30.742675 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:55:31.050059 (+307384us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:55:31.050093 (+    34us) alter_schema_op.cc:66] Acquired schema lock
0928 01:55:31.170875 (+120782us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:55:31.171098 (+   223us) alter_schema_op.cc:128] START. Timestamp: 1790560531170975
0928 01:55:31.171144 (+    46us) op_driver.cc:348] REPLICATION: starting
0928 01:55:31.172027 (+   883us) log.cc:844] Serialized 173 byte log entry
0928 01:55:31.233864 (+ 61837us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b440003484c. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc19ec558a1 00007fc19ecf3775 00007fc19ecf4192 00007fc1a5d153bb 00007fc1a5d10c9f 00007fc19edb408c 00000000005ad759 00007fc19edd060b 00007fc19edce90b 00007fc19edd0b72 00007fc1a5d033fb
0928 01:55:33.206399 (+1972535us) op_driver.cc:464] REPLICATION: finished
0928 01:55:33.784915 (+578516us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:55:33.891710 (+106795us) log.cc:844] Serialized 5 byte log entry
0928 01:55:34.316561 (+424851us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.449911 (+133350us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4800003558. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc1a6ef9641 00007fc1a6ef06d7 00007fc1a6ef056a 00007fc1a6fe789f 00007fc1a6fe7567 00007fc1a6ffbb8c 00007fc1a6ffbb38 00007fc1a6ffbab8 00007fc1a6ffba73 00007fc1a6ffad1c 00007fc1a6397876
0928 01:55:34.450188 (+   277us) log.cc:844] Serialized 14 byte log entry
0928 01:55:34.450305 (+   117us) alter_schema_op.cc:73] Released schema lock
0928 01:55:34.450340 (+    35us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":577927,"prepare.queue_time_us":166,"prepare.run_cpu_time_us":16357,"prepare.run_wall_time_us":762344,"replication_time_us":2034626,"spinlock_wait_cycles":160244864,"thread_start_us":804381,"threads_started":2,"wal-append.queue_time_us":364365,"wal-append.run_cpu_time_us":2362,"wal-append.run_wall_time_us":1002347}]]}
I20260928 01:55:34.544080 20310 raft_consensus.cc:493] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:34.544593 20310 raft_consensus.cc:515] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:34.440704 20341 tablet.cc:1751] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
W20260928 01:55:34.545308 19556 leader_election.cc:343] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:34.546458 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 277507us
I20260928 01:55:34.546612 20310 leader_election.cc:290] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:34.583335 19890 tablet_bootstrap.cc:492] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:34.583828 19890 ts_tablet_manager.cc:1403] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.316s	user 0.009s	sys 0.000s
I20260928 01:55:34.528693 20294 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:39104 (request call id 135) took 2495 ms. Trace:
I20260928 01:55:34.590823 19441 tablet_service.cc:1511] Processing CreateTablet for tablet 7602706a3fbc438d8d448c9ac057087c (DEFAULT_TABLE table=default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.590783 19890 raft_consensus.cc:359] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:34.591475 19890 raft_consensus.cc:385] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:34.591754 19890 raft_consensus.cc:740] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:34.592103 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7602706a3fbc438d8d448c9ac057087c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.594035 19443 tablet_service.cc:1511] Processing CreateTablet for tablet 7daa1b799e0d408287edc03988f5b683 (DEFAULT_TABLE table=default.Table_7b0eeaea0af144bf8165b6228c454e7e [id=a051e78b19ab4fe1be3db9e064eaf56d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.595309 19443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7daa1b799e0d408287edc03988f5b683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.597146 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e1cc46939b4932a344b81c3bc8ca82" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:34.597781 19617 raft_consensus.cc:3060] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:34.602093 19896 tablet_bootstrap.cc:654] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:34.605405 19444 tablet_service.cc:1511] Processing CreateTablet for tablet 5374596938d64cafb9621a1932ca1f68 (DEFAULT_TABLE table=default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.606613 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5374596938d64cafb9621a1932ca1f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.611675 19617 raft_consensus.cc:2468] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:34.627192 20289 leader_election.cc:290] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:34.589634 20294 rpcz_store.cc:276] 0928 01:55:32.032987 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.048599 (+ 15612us) service_pool.cc:224] Handling call
0928 01:55:34.517314 (+2468715us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:32.487332 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:55:32.777930 (+290598us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:55:34.452290 (+1674360us) alter_schema_op.cc:66] Acquired schema lock
0928 01:55:34.458556 (+  6266us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:55:34.459021 (+   465us) op_driver.cc:389] HandleFailure(Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.522s ago.)
0928 01:55:34.459097 (+    76us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":216620,"thread_start_us":128957,"threads_started":1}]]}
W20260928 01:55:34.632727 20294 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39104: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.696s ago.
I20260928 01:55:34.633001 19742 tablet_service.cc:1511] Processing CreateTablet for tablet 5374596938d64cafb9621a1932ca1f68 (DEFAULT_TABLE table=default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.633302 20294 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:39104 (request call id 138) took 1895 ms. Trace:
I20260928 01:55:34.634159 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5374596938d64cafb9621a1932ca1f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.633599 20294 rpcz_store.cc:276] 0928 01:55:32.737542 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.737660 (+   118us) service_pool.cc:224] Handling call
0928 01:55:34.633225 (+1895565us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:34.632030 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:55:34.632383 (+   353us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:55:34.632416 (+    33us) alter_schema_op.cc:66] Acquired schema lock
0928 01:55:34.632460 (+    44us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:55:34.632607 (+   147us) op_driver.cc:389] HandleFailure(Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.696s ago.)
0928 01:55:34.632635 (+    28us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":1893290}]]}
I20260928 01:55:34.632046 20029 tablet_bootstrap.cc:654] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:34.650091 19590 tablet_service.cc:1511] Processing CreateTablet for tablet 664b608bb0f54fc5baa10622f7d916c1 (DEFAULT_TABLE table=default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.651506 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 664b608bb0f54fc5baa10622f7d916c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.643014 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfcdfe218414396824a8f3af4d673ff" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:34.498052 20319 rpcz_store.cc:276] 0928 01:55:31.449838 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.450024 (+   186us) service_pool.cc:224] Handling call
0928 01:55:34.480482 (+3030458us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:31.505268 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:55:31.505837 (+   569us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:55:31.505884 (+    47us) alter_schema_op.cc:66] Acquired schema lock
0928 01:55:31.506042 (+   158us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:55:31.506224 (+   182us) alter_schema_op.cc:128] START. Timestamp: 1790560531506012
0928 01:55:31.506244 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:55:31.507028 (+   784us) log.cc:844] Serialized 173 byte log entry
0928 01:55:32.859672 (+1352644us) op_driver.cc:464] REPLICATION: finished
0928 01:55:33.277971 (+418299us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:55:33.478565 (+200594us) log.cc:844] Serialized 5 byte log entry
0928 01:55:34.179544 (+700979us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.375022 (+195478us) log.cc:844] Serialized 14 byte log entry
0928 01:55:34.378726 (+  3704us) alter_schema_op.cc:73] Released schema lock
0928 01:55:34.465655 (+ 86929us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":418003,"prepare.queue_time_us":53941,"prepare.run_cpu_time_us":10228,"prepare.run_wall_time_us":293338,"raft.queue_time_us":207,"raft.run_cpu_time_us":1551,"raft.run_wall_time_us":1550,"replication_time_us":1353230,"spinlock_wait_cycles":2432,"thread_start_us":679679,"threads_started":4,"wal-append.queue_time_us":451960,"wal-append.run_cpu_time_us":2439,"wal-append.run_wall_time_us":1002426}]]}
I20260928 01:55:34.662413 19436 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:39100 (request call id 40) took 1782 ms. Trace:
I20260928 01:55:34.663723 19436 rpcz_store.cc:276] 0928 01:55:32.873793 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.873948 (+   155us) service_pool.cc:224] Handling call
0928 01:55:34.129596 (+1255648us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54000b2054. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc1a5e9caa1 00007fc1a5f2d6b8 00007fc1a6f9e98d 00007fc1a56ee104 00007fc1a56ee092 00007fc1a56edfc1 00007fc1a56edf3c 00007fc1a56ed1f2 00007fc1a3c0209c 00007fc1a3c014d6 00007fc1a3c00e7f
0928 01:55:34.299663 (+170067us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54000c2454. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc1a5e9caa1 00007fc1a5f2d6b8 00007fc1a6f9e98d 00007fc1a56ee104 00007fc1a56ee092 00007fc1a56edfc1 00007fc1a56edf3c 00007fc1a56ed1f2 00007fc1a3c0209c 00007fc1a3c014d6 00007fc1a3c00e7f
0928 01:55:34.353905 (+ 54242us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b54000c1a54. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc1a5e9caa1 00007fc1a5f2d6b8 00007fc1a6f9e98d 00007fc1a56ee104 00007fc1a56ee092 00007fc1a56edfc1 00007fc1a56edf3c 00007fc1a56ed1f2 00007fc1a3c0209c 00007fc1a3c014d6 00007fc1a3c00e7f
0928 01:55:34.655899 (+301994us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232538368}
I20260928 01:55:34.664101 20379 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 81ebb46a410e43ebaec3ef4dd13a71fc)
I20260928 01:55:34.663169 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a71904514a488083426f5fe07d12cd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:34.664767 20147 ts_tablet_manager.cc:1929] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:34.664846 20379 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:34.665397 20147 log.cc:1199] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/90d40050f85a4d6c90a4ce35cf15d134
I20260928 01:55:34.666085 20147 ts_tablet_manager.cc:1950] T 90d40050f85a4d6c90a4ce35cf15d134 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:34.604223 20259 consensus_queue.cc:237] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:34.672668 20319 tablet.cc:1746] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614: Skipping requested alter to schema version 2, tablet already version 2
I20260928 01:55:34.672384 19890 consensus_queue.cc:260] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:34.680186 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 7602706a3fbc438d8d448c9ac057087c (DEFAULT_TABLE table=default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.681354 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7602706a3fbc438d8d448c9ac057087c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.686918 20379 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:34.689623 19598 tablet_service.cc:1511] Processing CreateTablet for tablet 0b222e5366a64f52bc97acd551c7a067 (DEFAULT_TABLE table=default.Table_adb5ab9de36441229bdfdfceffe4604e [id=65e97905d20f4bce9e010a056883d7b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.690474 20148 ts_tablet_manager.cc:1929] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:34.690760 19598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b222e5366a64f52bc97acd551c7a067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.690955 20148 log.cc:1199] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/e3bccc8b0045456fa7f16e984b3c5bf5
I20260928 01:55:34.691702 20148 ts_tablet_manager.cc:1950] T e3bccc8b0045456fa7f16e984b3c5bf5 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:34.693493 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfcdfe218414396824a8f3af4d673ff" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:34.694170 19765 raft_consensus.cc:2468] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:34.701123 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d40050f85a4d6c90a4ce35cf15d134" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:34.701860 19766 raft_consensus.cc:2468] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:34.705049 20239 ts_tablet_manager.cc:1929] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 01:55:34.705511 20239 log.cc:1199] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/ce41f63df46f4d0493ca22a13daadb4f
I20260928 01:55:34.705646 19890 ts_tablet_manager.cc:1434] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.122s	user 0.006s	sys 0.002s
I20260928 01:55:34.706342 20239 ts_tablet_manager.cc:1950] T ce41f63df46f4d0493ca22a13daadb4f P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:34.706889 19890 tablet_bootstrap.cc:492] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:34.709594 19553 leader_election.cc:304] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:34.711305 20310 raft_consensus.cc:2804] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:34.711686 20310 raft_consensus.cc:493] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:34.712037 20310 raft_consensus.cc:3060] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:34.719270 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 457837143b0f4763a4b91bb25b580477 (table default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]) successfully deleted
W20260928 01:55:34.720129 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 952df055998942f89baabb341e204f43 because the tablet was not found. No further retry: Not found: Tablet not found: 952df055998942f89baabb341e204f43
I20260928 01:55:34.727021 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_93d5b38d864e421eb0f1ebc64ad796ed"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:34.728899 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93d5b38d864e421eb0f1ebc64ad796ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:34.710304 19409 leader_election.cc:304] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:34.731352 20289 raft_consensus.cc:2804] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:34.731715 20289 raft_consensus.cc:493] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:34.732035 20289 raft_consensus.cc:3060] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:34.732752 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_a7be235b87c5430196c28409590e15e8"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:34.743983 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7be235b87c5430196c28409590e15e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:34.749064 20289 raft_consensus.cc:515] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:34.752947 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 131) took 2307 ms. Trace:
I20260928 01:55:34.758132 19896 tablet_bootstrap.cc:492] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:34.758103 20292 consensus_queue.cc:1048] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:34.758621 19896 ts_tablet_manager.cc:1403] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.277s	user 0.005s	sys 0.009s
I20260928 01:55:34.758385 19111 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_2fbaba56e6074d2caa5b8a3603cc5ff9" } new_table_name: "default.Table_1d7ba037c2b94761a1844dd92fec58ad" modify_external_catalogs: true
W20260928 01:55:34.760612 19082 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 60336.8us
I20260928 01:55:34.753331 20239 rpcz_store.cc:276] 0928 01:55:32.445533 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.445776 (+   243us) service_pool.cc:224] Handling call
0928 01:55:34.457722 (+2011946us) ts_tablet_manager.cc:1151] Deleting tablet ce41f63df46f4d0493ca22a13daadb4f
0928 01:55:34.457785 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:34.534911 (+ 77126us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.704893 (+169982us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.752870 (+ 47977us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2010911}
I20260928 01:55:34.763065 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_5a6972316f7940d88c5a2f5d5a17284f"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:34.764591 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a6972316f7940d88c5a2f5d5a17284f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:34.763842 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 139) took 2085 ms. Trace:
I20260928 01:55:34.770491 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet ce41f63df46f4d0493ca22a13daadb4f (table default.Table_f74d6b5e81d2457b88ab4456aa43c249 [id=9e114860728146b097bcfce77a95f9d0]) successfully deleted
I20260928 01:55:34.770900 19896 raft_consensus.cc:359] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:34.771605 19896 raft_consensus.cc:385] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:34.771854 19896 raft_consensus.cc:740] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:34.772531 19896 consensus_queue.cc:260] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:34.774600 19896 ts_tablet_manager.cc:1434] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260928 01:55:34.775588 19896 tablet_bootstrap.cc:492] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:34.766430 20239 rpcz_store.cc:276] 0928 01:55:32.677948 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.678148 (+   200us) service_pool.cc:224] Handling call
0928 01:55:34.763434 (+2085286us) ts_tablet_manager.cc:1151] Deleting tablet e05925303152462e8ca25cd15f3bedff
0928 01:55:34.763482 (+    48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:34.763771 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2042356}
I20260928 01:55:34.784999 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 140) took 2106 ms. Trace:
I20260928 01:55:34.790297 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 69) took 7894 ms. Trace:
I20260928 01:55:34.792421 20289 leader_election.cc:290] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:34.794488 19595 tablet_service.cc:1511] Processing CreateTablet for tablet 982c3e07bcb94230b93764330914630f (DEFAULT_TABLE table=default.Table_39aacd0daa1b4dc2ac37b6aec34468bf [id=091b5a4098aa4735adb1bf56bff7d3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.787351 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d40050f85a4d6c90a4ce35cf15d134" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:34.795364 19766 raft_consensus.cc:3060] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:34.795696 19595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982c3e07bcb94230b93764330914630f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.802634 19766 raft_consensus.cc:2468] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:34.806757 19593 tablet_service.cc:1511] Processing CreateTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 (DEFAULT_TABLE table=default.Table_3ce866b8da2a4181bedfe396a59a2b76 [id=2e72bf3c803b4352af5b9d6300abbd35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.807861 19593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89e1d60db21f4a8294792df3fadf5d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.790692 20148 rpcz_store.cc:276] 0928 01:55:26.896142 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:26.922931 (+ 26789us) service_pool.cc:224] Handling call
0928 01:55:34.322396 (+7399465us) ts_tablet_manager.cc:1151] Deleting tablet e3bccc8b0045456fa7f16e984b3c5bf5
0928 01:55:34.322459 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:34.587172 (+264713us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.690305 (+103133us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.790199 (+ 99894us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123717,"tablet-delete.queue_time_us":7387404}
I20260928 01:55:34.814638 19409 leader_election.cc:304] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:34.815323 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 71) took 7809 ms. Trace:
I20260928 01:55:34.815665 20148 rpcz_store.cc:276] 0928 01:55:27.005712 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.006377 (+   665us) service_pool.cc:224] Handling call
0928 01:55:34.814378 (+7808001us) ts_tablet_manager.cc:1151] Deleting tablet a6fb7f3e609144f5a9dcc8b40d21dbb2
0928 01:55:34.815023 (+   645us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:34.815271 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7800937}
I20260928 01:55:34.816850 20289 raft_consensus.cc:2804] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:34.803169 20239 rpcz_store.cc:276] 0928 01:55:32.678459 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.678684 (+   225us) service_pool.cc:224] Handling call
0928 01:55:34.784561 (+2105877us) ts_tablet_manager.cc:1151] Deleting tablet 9ca0b52215454a99b6c5d1956088829a
0928 01:55:34.784611 (+    50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:34.784935 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2062364}
I20260928 01:55:34.819060 20239 tablet_replica.cc:333] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:34.819778 19592 tablet_service.cc:1511] Processing CreateTablet for tablet 7daa1b799e0d408287edc03988f5b683 (DEFAULT_TABLE table=default.Table_7b0eeaea0af144bf8165b6228c454e7e [id=a051e78b19ab4fe1be3db9e064eaf56d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.821029 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7daa1b799e0d408287edc03988f5b683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.820854 20289 raft_consensus.cc:697] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:34.821762 20289 consensus_queue.cc:237] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:34.826910 20148 tablet_replica.cc:333] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:34.827750 20148 raft_consensus.cc:2243] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:34.828293 20148 raft_consensus.cc:2272] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:34.830181 20029 tablet_bootstrap.cc:492] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:34.830487 20148 ts_tablet_manager.cc:1916] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:34.830685 20029 ts_tablet_manager.cc:1403] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.299s	user 0.015s	sys 0.001s
W20260928 01:55:34.831314 19102 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 60795.1us
I20260928 01:55:34.833285 20029 raft_consensus.cc:359] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:34.833648 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:34.834053 20029 raft_consensus.cc:385] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:34.834295 20029 raft_consensus.cc:740] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:34.835043 20029 consensus_queue.cc:260] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:34.837567 19591 tablet_service.cc:1511] Processing CreateTablet for tablet 5374596938d64cafb9621a1932ca1f68 (DEFAULT_TABLE table=default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.838792 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5374596938d64cafb9621a1932ca1f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:34.841943 20239 raft_consensus.cc:2243] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:34.850261 19896 tablet_bootstrap.cc:654] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:34.858278 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 7602706a3fbc438d8d448c9ac057087c (DEFAULT_TABLE table=default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:34.859315 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7602706a3fbc438d8d448c9ac057087c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:34.862552 19179 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:34.870581 20292 raft_consensus.cc:493] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:34.871065 20292 raft_consensus.cc:515] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:34.873248 19103 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_2ba0a32bb9a441bdba3ac63f08ae026f [id=3e43587428fb4c679f8222cf3c30d08d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2156dae74ee748cd845b6dea1d3b8ea8 consensus state has no leader
I20260928 01:55:34.874161 20292 leader_election.cc:290] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:34.876466 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:34.877074 19618 raft_consensus.cc:2468] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:34.879315 19704 leader_election.cc:304] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:34.880776 20340 raft_consensus.cc:2804] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:34.881114 20340 raft_consensus.cc:493] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:34.881428 20340 raft_consensus.cc:3060] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:34.885468 20310 raft_consensus.cc:515] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:34.888257 20310 leader_election.cc:290] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:34.891181 20239 raft_consensus.cc:2272] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:34.894412 20239 ts_tablet_manager.cc:1916] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:34.900801 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:34.903533 19468 raft_consensus.cc:3060] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:34.919324 20148 ts_tablet_manager.cc:1929] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:34.896166 20029 ts_tablet_manager.cc:1434] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.065s	user 0.004s	sys 0.000s
W20260928 01:55:34.912796 19703 leader_election.cc:343] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:34.919838 20148 log.cc:1199] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/dfc63ccbe4e84373aabe3009cc3d2568
W20260928 01:55:34.921584 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 210670us
I20260928 01:55:34.923247 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfcdfe218414396824a8f3af4d673ff" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:34.923996 19766 raft_consensus.cc:3060] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:34.925618 20029 tablet_bootstrap.cc:492] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:34.935457 20292 consensus_queue.cc:1048] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:34.944358 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 92) took 6088 ms. Trace:
I20260928 01:55:34.944761 20147 rpcz_store.cc:276] 0928 01:55:28.856412 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.856614 (+   202us) service_pool.cc:224] Handling call
0928 01:55:34.153755 (+5297141us) ts_tablet_manager.cc:1151] Deleting tablet 90d40050f85a4d6c90a4ce35cf15d134
0928 01:55:34.153804 (+    49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:34.303299 (+149495us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.664359 (+361060us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.944265 (+279906us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5288722}
I20260928 01:55:34.945508 20148 ts_tablet_manager.cc:1950] T dfc63ccbe4e84373aabe3009cc3d2568 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:34.946208 20147 tablet_replica.cc:333] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:34.947238 20147 raft_consensus.cc:2243] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:34.947785 20147 raft_consensus.cc:2272] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:34.945770 20340 raft_consensus.cc:515] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:34.948402 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 112976us
I20260928 01:55:34.951907 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:34.952778 19618 raft_consensus.cc:3060] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:34.959138 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet a6fb7f3e609144f5a9dcc8b40d21dbb2 because the tablet was not found. No further retry: Not found: Tablet not found: a6fb7f3e609144f5a9dcc8b40d21dbb2
I20260928 01:55:34.948120 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 70) took 8001 ms. Trace:
I20260928 01:55:34.960865 20148 rpcz_store.cc:276] 0928 01:55:26.993330 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.004390 (+ 11060us) service_pool.cc:224] Handling call
0928 01:55:34.826695 (+7822305us) ts_tablet_manager.cc:1151] Deleting tablet dfc63ccbe4e84373aabe3009cc3d2568
0928 01:55:34.826757 (+    62us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:34.889855 (+ 63098us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.919175 (+ 29320us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:34.948038 (+ 28863us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7787247}
I20260928 01:55:34.969420 20148 tablet_replica.cc:333] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:34.979707 19618 raft_consensus.cc:2468] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:34.982482 20148 raft_consensus.cc:2243] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:34.983044 20148 raft_consensus.cc:2272] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:34.988873 20148 ts_tablet_manager.cc:1916] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:34.996659 19896 tablet_bootstrap.cc:492] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:34.997179 19896 ts_tablet_manager.cc:1403] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.222s	user 0.023s	sys 0.009s
I20260928 01:55:35.011304 20340 leader_election.cc:290] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:35.016140 19766 raft_consensus.cc:2468] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:35.019064 19110 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 197) took 1018 ms. Trace:
I20260928 01:55:35.025261 19896 raft_consensus.cc:359] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:35.025902 19896 raft_consensus.cc:385] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.026149 19896 raft_consensus.cc:740] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
W20260928 01:55:35.024484 19104 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 65371.8us
I20260928 01:55:35.026918 19896 consensus_queue.cc:260] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:35.050858 19896 ts_tablet_manager.cc:1434] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.053s	user 0.002s	sys 0.008s
I20260928 01:55:35.051970 19896 tablet_bootstrap.cc:492] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:35.054890 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:35.064699 20029 tablet_bootstrap.cc:654] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.065936 20147 ts_tablet_manager.cc:1916] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:35.029307 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet dfc63ccbe4e84373aabe3009cc3d2568 (table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]) successfully deleted
I20260928 01:55:35.019472 19110 rpcz_store.cc:276] 0928 01:55:33.999796 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.999904 (+   108us) service_pool.cc:224] Handling call
0928 01:55:34.002666 (+  2762us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:34.004633 (+  1967us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:35.017419 (+1012786us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:55:35.018070 (+   651us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:55:35.018519 (+   449us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:34.011783 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:34.160182 (+148399us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:34.160236 (+    54us) write_op.cc:435] Acquired schema lock
0928 01:55:34.160251 (+    15us) tablet.cc:662] Decoding operations
0928 01:55:34.160644 (+   393us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:34.160688 (+    44us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:34.160717 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:34.161035 (+   318us) tablet.cc:701] Row locks acquired
0928 01:55:34.161054 (+    19us) write_op.cc:260] PREPARE: finished
0928 01:55:34.161225 (+   171us) write_op.cc:270] Start()
0928 01:55:34.161338 (+   113us) write_op.cc:276] Timestamp: P: 1790560534161145 usec, L: 0
0928 01:55:34.161357 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:55:34.257295 (+ 95938us) log.cc:844] Serialized 433 byte log entry
0928 01:55:34.257961 (+   666us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b6aa1 00007f19fd7495e8 00007f19fdbd9791 00007f19fdbd8f68 00007f19fdbddc01 00007f19fdbddbb9 00007f19fdbddb49 00007f19fdbddb11 00007f19fdbdcd3d 00000000005bd4e4 00000000005bd319
0928 01:55:34.956100 (+698139us) op_driver.cc:464] REPLICATION: finished
0928 01:55:35.013850 (+ 57750us) write_op.cc:301] APPLY: starting
0928 01:55:35.013987 (+   137us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:35.014200 (+   213us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:35.014253 (+    53us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:35.015176 (+   923us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:35.015488 (+   312us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:55:35.015563 (+    75us) write_op.cc:312] APPLY: finished
0928 01:55:35.015969 (+   406us) log.cc:844] Serialized 29 byte log entry
0928 01:55:35.016816 (+   847us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:35.016916 (+   100us) write_op.cc:454] Released schema lock
0928 01:55:35.017008 (+    92us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":57373,"num_ops":2,"prepare.queue_time_us":5832,"prepare.run_cpu_time_us":3394,"prepare.run_wall_time_us":246305,"replication_time_us":794536,"spinlock_wait_cycles":219135232,"thread_start_us":28407,"threads_started":1}]]}
W20260928 01:55:35.072865 19104 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260928 01:55:35.049680 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet e05925303152462e8ca25cd15f3bedff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e05925303152462e8ca25cd15f3bedff already in progress: creating tablet
W20260928 01:55:35.076853 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 9ca0b52215454a99b6c5d1956088829a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ca0b52215454a99b6c5d1956088829a already in progress: creating tablet
W20260928 01:55:34.996011 19179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 133574us
W20260928 01:55:35.067584 19703 leader_election.cc:343] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:35.096688 20148 ts_tablet_manager.cc:1929] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:35.097579 20148 log.cc:1199] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/63a3540d1441404092db723b7e5cb61a
W20260928 01:55:35.097985 19179 leader_election.cc:336] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095): Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:35.099494 20148 ts_tablet_manager.cc:1950] T 63a3540d1441404092db723b7e5cb61a P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:35.101928 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 78) took 7620 ms. Trace:
I20260928 01:55:35.106148 19896 tablet_bootstrap.cc:654] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.101909 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:35.102329 20148 rpcz_store.cc:276] 0928 01:55:27.481649 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.481887 (+   238us) service_pool.cc:224] Handling call
0928 01:55:34.969204 (+7487317us) ts_tablet_manager.cc:1151] Deleting tablet 63a3540d1441404092db723b7e5cb61a
0928 01:55:34.969281 (+    77us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.037108 (+ 67827us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.076176 (+ 39068us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.101855 (+ 25679us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7486467}
I20260928 01:55:35.114750 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 84) took 7317 ms. Trace:
I20260928 01:55:35.115119 20148 rpcz_store.cc:276] 0928 01:55:27.797377 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.808467 (+ 11090us) service_pool.cc:224] Handling call
0928 01:55:35.114163 (+7305696us) ts_tablet_manager.cc:1151] Deleting tablet 7bfcdfe218414396824a8f3af4d673ff
0928 01:55:35.114266 (+   103us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.114666 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7304174}
I20260928 01:55:35.122951 20148 tablet_replica.cc:333] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:35.124065 20148 raft_consensus.cc:2243] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:35.124782 20148 raft_consensus.cc:2272] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:35.127404 20148 ts_tablet_manager.cc:1916] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:35.135154 19890 tablet_bootstrap.cc:654] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.137786 19896 tablet_bootstrap.cc:492] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:35.138271 19896 ts_tablet_manager.cc:1403] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.087s	user 0.005s	sys 0.009s
W20260928 01:55:35.149528 19104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 76678.4us
I20260928 01:55:35.151445 20029 tablet_bootstrap.cc:492] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:35.151902 20029 ts_tablet_manager.cc:1403] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.226s	user 0.006s	sys 0.012s
I20260928 01:55:35.152105 19896 raft_consensus.cc:359] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.153118 19896 raft_consensus.cc:385] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.153412 19896 raft_consensus.cc:740] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.153972 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 63a3540d1441404092db723b7e5cb61a (table default.Table_2720a066cdca41b4998342e7fb48de23 [id=58b8eec416eb437f92897594371a012f]) successfully deleted
I20260928 01:55:35.154130 19896 consensus_queue.cc:260] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:35.154999 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7bfcdfe218414396824a8f3af4d673ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bfcdfe218414396824a8f3af4d673ff already in progress: creating tablet
I20260928 01:55:35.156311 19896 ts_tablet_manager.cc:1434] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260928 01:55:35.157274 19896 tablet_bootstrap.cc:492] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:35.163270 20379 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:55:35.169828 20239 ts_tablet_manager.cc:1929] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:35.176394 19896 tablet_bootstrap.cc:654] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.179960 20148 ts_tablet_manager.cc:1929] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:35.191690 19114 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 78a71904514a488083426f5fe07d12cd
I20260928 01:55:35.191910 20148 log.cc:1199] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/efa8a7589d314c25aeccf678c938ecf0
I20260928 01:55:35.192765 20148 ts_tablet_manager.cc:1950] T efa8a7589d314c25aeccf678c938ecf0 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:35.193938 19114 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 192) took 1531 ms. Trace:
I20260928 01:55:35.195473 19896 tablet_bootstrap.cc:492] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:35.195895 19896 ts_tablet_manager.cc:1403] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.007s
I20260928 01:55:35.199100 19896 raft_consensus.cc:359] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.199745 19896 raft_consensus.cc:385] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.199983 19896 raft_consensus.cc:740] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.200367 20289 raft_consensus.cc:493] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:35.200578 19896 consensus_queue.cc:260] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.200964 20289 raft_consensus.cc:515] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.202405 20239 log.cc:1199] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/63a3540d1441404092db723b7e5cb61a
I20260928 01:55:35.202723 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 78a71904514a488083426f5fe07d12cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:35.203158 20239 ts_tablet_manager.cc:1950] T 63a3540d1441404092db723b7e5cb61a P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:35.199366 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet 78a71904514a488083426f5fe07d12cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:35.205173 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 87) took 7257 ms. Trace:
I20260928 01:55:35.205518 20148 rpcz_store.cc:276] 0928 01:55:27.947758 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.947977 (+   219us) service_pool.cc:224] Handling call
0928 01:55:35.122714 (+7174737us) ts_tablet_manager.cc:1151] Deleting tablet efa8a7589d314c25aeccf678c938ecf0
0928 01:55:35.122792 (+    78us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.164716 (+ 41924us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.179793 (+ 15077us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.205107 (+ 25314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176,"tablet-delete.queue_time_us":7173832}
I20260928 01:55:35.207284 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet efa8a7589d314c25aeccf678c938ecf0 (table default.Table_2ba0a32bb9a441bdba3ac63f08ae026f [id=3e43587428fb4c679f8222cf3c30d08d]) successfully deleted
I20260928 01:55:35.209194 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfcdfe218414396824a8f3af4d673ff" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:35.209985 19766 raft_consensus.cc:2393] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:35.210940 20148 tablet_replica.cc:333] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:35.211244 19896 ts_tablet_manager.cc:1434] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260928 01:55:35.211815 20148 raft_consensus.cc:2243] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:35.212188 19896 tablet_bootstrap.cc:492] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:35.212620 20148 pending_rounds.cc:70] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614: Trying to abort 1 pending ops.
I20260928 01:55:35.212854 20148 pending_rounds.cc:77] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135950630805504 op_type: NO_OP noop_request { }
I20260928 01:55:35.213287 20148 raft_consensus.cc:2889] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:35.218279 20148 raft_consensus.cc:2272] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:35.194296 19114 rpcz_store.cc:276] 0928 01:55:33.662798 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.662927 (+   129us) service_pool.cc:224] Handling call
0928 01:55:33.664088 (+  1161us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:33.664619 (+   531us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:55:33.664746 (+   127us) catalog_manager.cc:2863] Locking tablets
0928 01:55:34.453387 (+788641us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:55:35.190417 (+737030us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:55:35.190682 (+   265us) catalog_manager.cc:2911] Committing in-memory state
0928 01:55:35.190801 (+   119us) catalog_manager.cc:2915] Aborting table tasks
0928 01:55:35.193722 (+  2921us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:34.522778 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:34.523262 (+   484us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:34.523292 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:55:34.523308 (+    16us) tablet.cc:662] Decoding operations
0928 01:55:34.523643 (+   335us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:34.523678 (+    35us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:34.523701 (+    23us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:34.523984 (+   283us) tablet.cc:701] Row locks acquired
0928 01:55:34.523997 (+    13us) write_op.cc:260] PREPARE: finished
0928 01:55:34.524106 (+   109us) write_op.cc:270] Start()
0928 01:55:34.525328 (+  1222us) write_op.cc:276] Timestamp: P: 1790560534524022 usec, L: 0
0928 01:55:34.525352 (+    24us) op_driver.cc:348] REPLICATION: starting
0928 01:55:34.525877 (+   525us) log.cc:844] Serialized 728 byte log entry
0928 01:55:35.174363 (+648486us) op_driver.cc:464] REPLICATION: finished
0928 01:55:35.178877 (+  4514us) write_op.cc:301] APPLY: starting
0928 01:55:35.179023 (+   146us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:35.179192 (+   169us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:35.179342 (+   150us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:35.179795 (+   453us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:35.180023 (+   228us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:35.180114 (+    91us) write_op.cc:312] APPLY: finished
0928 01:55:35.186044 (+  5930us) log.cc:844] Serialized 29 byte log entry
0928 01:55:35.189858 (+  3814us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:35.189986 (+   128us) write_op.cc:454] Released schema lock
0928 01:55:35.190041 (+    55us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":300,"child_traces":[["op",{"apply.queue_time_us":4306,"apply.run_cpu_time_us":2466,"apply.run_wall_time_us":12185,"num_ops":2,"prepare.queue_time_us":67036,"prepare.run_cpu_time_us":2208,"prepare.run_wall_time_us":3467,"replication_time_us":648899,"threads_started":1}]]}
I20260928 01:55:35.222342 19114 master_service.cc:960] ReplaceTablet: received request to replace tablet 599ef1523fcf43d1a1e2a91f03abaa60 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:35.165820 20029 raft_consensus.cc:359] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.223367 20029 raft_consensus.cc:385] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.223816 20029 raft_consensus.cc:740] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.224879 20029 consensus_queue.cc:260] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.233940 20029 ts_tablet_manager.cc:1434] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260928 01:55:35.238687 19115 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet f71e2109f8cd4dd4a288fbdc8e50b133
I20260928 01:55:35.240813 19115 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 190) took 1583 ms. Trace:
I20260928 01:55:35.242136 20029 tablet_bootstrap.cc:492] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:35.236280 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 141) took 2557 ms. Trace:
I20260928 01:55:35.243559 20239 rpcz_store.cc:276] 0928 01:55:32.679060 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.679264 (+   204us) service_pool.cc:224] Handling call
0928 01:55:34.818717 (+2139453us) ts_tablet_manager.cc:1151] Deleting tablet 63a3540d1441404092db723b7e5cb61a
0928 01:55:34.818793 (+    76us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.085636 (+266843us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.169687 (+ 84051us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.236167 (+ 66480us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74789,"tablet-delete.queue_time_us":2095441}
I20260928 01:55:35.241209 19115 rpcz_store.cc:276] 0928 01:55:33.657159 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.658623 (+  1464us) service_pool.cc:224] Handling call
0928 01:55:33.660184 (+  1561us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:33.661874 (+  1690us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:55:33.662051 (+   177us) catalog_manager.cc:2863] Locking tablets
0928 01:55:34.456529 (+794478us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:55:35.237760 (+781231us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:55:35.237997 (+   237us) catalog_manager.cc:2911] Committing in-memory state
0928 01:55:35.238124 (+   127us) catalog_manager.cc:2915] Aborting table tasks
0928 01:55:35.240724 (+  2600us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:34.526227 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:34.526643 (+   416us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:34.526666 (+    23us) write_op.cc:435] Acquired schema lock
0928 01:55:34.526679 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:34.526975 (+   296us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:34.527013 (+    38us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:34.527036 (+    23us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:34.527328 (+   292us) tablet.cc:701] Row locks acquired
0928 01:55:34.527342 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:34.527460 (+   118us) write_op.cc:270] Start()
0928 01:55:34.527547 (+    87us) write_op.cc:276] Timestamp: P: 1790560534527377 usec, L: 0
0928 01:55:34.527561 (+    14us) op_driver.cc:348] REPLICATION: starting
0928 01:55:34.528055 (+   494us) log.cc:844] Serialized 759 byte log entry
0928 01:55:35.234327 (+706272us) op_driver.cc:464] REPLICATION: finished
0928 01:55:35.235072 (+   745us) write_op.cc:301] APPLY: starting
0928 01:55:35.235184 (+   112us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:35.235349 (+   165us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:35.235549 (+   200us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:35.236034 (+   485us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:35.236282 (+   248us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:35.236354 (+    72us) write_op.cc:312] APPLY: finished
0928 01:55:35.236638 (+   284us) log.cc:844] Serialized 29 byte log entry
0928 01:55:35.237366 (+   728us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:35.237470 (+   104us) write_op.cc:454] Released schema lock
0928 01:55:35.237534 (+    64us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":482,"num_ops":2,"prepare.queue_time_us":67211,"prepare.run_cpu_time_us":2026,"prepare.run_wall_time_us":2025,"replication_time_us":706610}]]}
I20260928 01:55:35.245292 19115 master_service.cc:960] ReplaceTablet: received request to replace tablet c320eb2ca2ac4ac68293ef8f7400b45f from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:35.245501 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 147) took 1885 ms. Trace:
I20260928 01:55:35.245820 20239 rpcz_store.cc:276] 0928 01:55:33.360356 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.360499 (+   143us) service_pool.cc:224] Handling call
0928 01:55:35.245100 (+1884601us) ts_tablet_manager.cc:1151] Deleting tablet 158edf7a5d724c88992fecbadd2cedfa
0928 01:55:35.245151 (+    51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.245444 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1849178}
I20260928 01:55:35.218663 20289 leader_election.cc:290] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:35.251456 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet f71e2109f8cd4dd4a288fbdc8e50b133 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:35.253870 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 63a3540d1441404092db723b7e5cb61a (table default.Table_2720a066cdca41b4998342e7fb48de23 [id=58b8eec416eb437f92897594371a012f]) successfully deleted
I20260928 01:55:35.254366 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet f71e2109f8cd4dd4a288fbdc8e50b133 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:35.254738 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 158edf7a5d724c88992fecbadd2cedfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 158edf7a5d724c88992fecbadd2cedfa already in progress: creating tablet
I20260928 01:55:35.256367 20148 ts_tablet_manager.cc:1916] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:35.256880 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 149) took 1694 ms. Trace:
I20260928 01:55:35.257201 20239 rpcz_store.cc:276] 0928 01:55:33.562718 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.566002 (+  3284us) service_pool.cc:224] Handling call
0928 01:55:35.256448 (+1690446us) ts_tablet_manager.cc:1151] Deleting tablet 5d9b93f45ccf44e785b00849e49c8294
0928 01:55:35.256497 (+    49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.256809 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1689685}
I20260928 01:55:35.258589 19896 tablet_bootstrap.cc:654] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.261687 20239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 148) took 1853 ms. Trace:
I20260928 01:55:35.262069 20239 rpcz_store.cc:276] 0928 01:55:33.408743 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.408872 (+   129us) service_pool.cc:224] Handling call
0928 01:55:35.261319 (+1852447us) ts_tablet_manager.cc:1151] Deleting tablet 22606f012f1c44bd92c8e0341e9ca2b7
0928 01:55:35.261360 (+    41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.261627 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1680429}
I20260928 01:55:35.267535 20029 tablet_bootstrap.cc:654] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.272192 19896 tablet_bootstrap.cc:492] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:35.272660 19896 ts_tablet_manager.cc:1403] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.004s
I20260928 01:55:35.274948 19896 raft_consensus.cc:359] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.275583 19896 raft_consensus.cc:385] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.275825 19896 raft_consensus.cc:740] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.278163 19896 consensus_queue.cc:260] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.278541 19553 leader_election.cc:304] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:35.279182 19556 leader_election.cc:343] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:35.280810 19556 leader_election.cc:343] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:35.281232 19556 leader_election.cc:304] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:35.281914 20341 tablet.cc:1746] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614: Skipping requested alter to schema version 2, tablet already version 2
I20260928 01:55:35.282792 20341 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:39104 (request call id 134) took 3250 ms. Trace:
I20260928 01:55:35.289666 19896 ts_tablet_manager.cc:1434] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260928 01:55:35.290630 19896 tablet_bootstrap.cc:492] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:35.292621 19704 leader_election.cc:304] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:35.295190 20340 raft_consensus.cc:2804] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:35.295598 20340 raft_consensus.cc:697] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:35.296257 19896 tablet_bootstrap.cc:654] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:35.301743 19590 consensus_meta.cc:287] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.639s	user 0.001s	sys 0.010s
I20260928 01:55:35.283197 20341 rpcz_store.cc:276] 0928 01:55:32.032546 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.094442 (+ 61896us) service_pool.cc:224] Handling call
0928 01:55:35.282725 (+3188283us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:32.154877 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:55:32.155294 (+   417us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:55:34.465736 (+2310442us) alter_schema_op.cc:66] Acquired schema lock
0928 01:55:34.483678 (+ 17942us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:55:34.492071 (+  8393us) alter_schema_op.cc:128] START. Timestamp: 1790560534491979
0928 01:55:34.492108 (+    37us) op_driver.cc:348] REPLICATION: starting
0928 01:55:34.493648 (+  1540us) log.cc:844] Serialized 173 byte log entry
0928 01:55:35.281001 (+787353us) op_driver.cc:464] REPLICATION: finished
0928 01:55:35.281747 (+   746us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:55:35.282507 (+   760us) log.cc:844] Serialized 94 byte log entry
0928 01:55:35.282601 (+    94us) alter_schema_op.cc:73] Released schema lock
0928 01:55:35.282636 (+    35us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":557,"prepare.queue_time_us":262,"prepare.run_cpu_time_us":69770,"prepare.run_wall_time_us":2343339,"raft.queue_time_us":237,"raft.run_cpu_time_us":781,"raft.run_wall_time_us":865,"replication_time_us":788785}]]}
I20260928 01:55:35.303483 20340 consensus_queue.cc:237] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:35.317209 19593 consensus_meta.cc:287] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.500s	user 0.003s	sys 0.007s
I20260928 01:55:35.324256 19896 tablet_bootstrap.cc:492] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:35.324669 19896 ts_tablet_manager.cc:1403] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.004s
I20260928 01:55:35.326972 19896 raft_consensus.cc:359] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.327615 19896 raft_consensus.cc:385] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.327877 19896 raft_consensus.cc:740] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.328523 19896 consensus_queue.cc:260] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.330888 19896 ts_tablet_manager.cc:1434] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260928 01:55:35.331729 19896 tablet_bootstrap.cc:492] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:35.342701 20249 raft_consensus.cc:2804] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:35.347815 19896 tablet_bootstrap.cc:654] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:35.350926 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 70120.8us
I20260928 01:55:35.351496 20148 ts_tablet_manager.cc:1929] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:35.351881 20148 log.cc:1199] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/90d40050f85a4d6c90a4ce35cf15d134
I20260928 01:55:35.352610 20148 ts_tablet_manager.cc:1950] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
W20260928 01:55:35.354346 19553 consensus_peers.cc:597] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce41f63df46f4d0493ca22a13daadb4f. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:35.355990 20415 raft_consensus.cc:2749] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:35.356325 20029 tablet_bootstrap.cc:492] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:35.356751 20029 ts_tablet_manager.cc:1403] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.006s
I20260928 01:55:35.358801 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 92) took 6444 ms. Trace:
I20260928 01:55:35.359174 20029 raft_consensus.cc:359] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.359135 20148 rpcz_store.cc:276] 0928 01:55:28.934506 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:28.935200 (+   694us) service_pool.cc:224] Handling call
0928 01:55:35.210723 (+6275523us) ts_tablet_manager.cc:1151] Deleting tablet 90d40050f85a4d6c90a4ce35cf15d134
0928 01:55:35.210808 (+    85us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.293555 (+ 82747us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.351351 (+ 57796us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.358729 (+  7378us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6274820}
I20260928 01:55:35.359773 20029 raft_consensus.cc:385] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:55:35.328408 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 5d9b93f45ccf44e785b00849e49c8294 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d9b93f45ccf44e785b00849e49c8294 already in progress: creating tablet
I20260928 01:55:35.361295 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 90d40050f85a4d6c90a4ce35cf15d134 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]) successfully deleted
W20260928 01:55:35.361835 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 22606f012f1c44bd92c8e0341e9ca2b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22606f012f1c44bd92c8e0341e9ca2b7 already in progress: creating tablet
W20260928 01:55:35.362537 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 78a71904514a488083426f5fe07d12cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78a71904514a488083426f5fe07d12cd already in progress: creating tablet
W20260928 01:55:35.363164 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet f71e2109f8cd4dd4a288fbdc8e50b133 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f71e2109f8cd4dd4a288fbdc8e50b133 already in progress: creating tablet
I20260928 01:55:35.363487 20148 tablet_replica.cc:333] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:35.368489 20397 raft_consensus.cc:493] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:35.368947 20397 raft_consensus.cc:515] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.364292 20148 raft_consensus.cc:2243] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:35.370047 20148 pending_rounds.cc:70] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: Trying to abort 1 pending ops.
I20260928 01:55:35.370285 20148 pending_rounds.cc:77] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135950011965440 op_type: NO_OP noop_request { }
I20260928 01:55:35.370611 20148 raft_consensus.cc:2889] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:35.370927 20148 raft_consensus.cc:2272] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:35.370903 20397 leader_election.cc:290] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:35.374317 20148 ts_tablet_manager.cc:1916] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:35.374205 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599ef1523fcf43d1a1e2a91f03abaa60" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:35.374802 19468 raft_consensus.cc:2468] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:35.376808 19703 leader_election.cc:304] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:35.377239 19896 tablet_bootstrap.cc:492] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:35.377624 19896 ts_tablet_manager.cc:1403] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.002s
I20260928 01:55:35.378094 20292 raft_consensus.cc:2804] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:35.378407 20292 raft_consensus.cc:493] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:35.378700 20292 raft_consensus.cc:3060] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:35.386276 20292 raft_consensus.cc:515] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.390164 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599ef1523fcf43d1a1e2a91f03abaa60" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:35.390760 19468 raft_consensus.cc:3060] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:35.379868 19896 raft_consensus.cc:359] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.391499 19896 raft_consensus.cc:385] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.391773 19896 raft_consensus.cc:740] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.393075 19896 consensus_queue.cc:260] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.395675 19896 ts_tablet_manager.cc:1434] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260928 01:55:35.396700 19896 tablet_bootstrap.cc:492] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:35.396581 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 104039us
I20260928 01:55:35.356493 20249 raft_consensus.cc:697] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:35.405150 20249 consensus_queue.cc:237] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.366061 19890 tablet_bootstrap.cc:492] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:35.399675 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599ef1523fcf43d1a1e2a91f03abaa60" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:35.402029 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599ef1523fcf43d1a1e2a91f03abaa60" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:35.410532 19890 ts_tablet_manager.cc:1403] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.704s	user 0.012s	sys 0.003s
I20260928 01:55:35.412949 19896 tablet_bootstrap.cc:654] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.413374 20292 leader_election.cc:290] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:35.413507 19890 raft_consensus.cc:359] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.414139 19890 raft_consensus.cc:385] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.414409 19890 raft_consensus.cc:740] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.421329 19468 raft_consensus.cc:2468] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:35.423115 19703 leader_election.cc:304] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:35.424331 20292 raft_consensus.cc:2804] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:35.424907 20292 raft_consensus.cc:697] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:35.430872 19896 tablet_bootstrap.cc:492] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:35.426038 20292 consensus_queue.cc:237] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.431327 19896 ts_tablet_manager.cc:1403] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.001s
I20260928 01:55:35.433796 19896 raft_consensus.cc:359] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.360031 20029 raft_consensus.cc:740] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.434470 19896 raft_consensus.cc:385] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.434726 19896 raft_consensus.cc:740] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.435360 19896 consensus_queue.cc:260] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.438035 19896 ts_tablet_manager.cc:1434] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260928 01:55:35.439253 19896 tablet_bootstrap.cc:492] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:35.442757 20029 consensus_queue.cc:260] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.443877 20148 ts_tablet_manager.cc:1929] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:35.444321 20148 log.cc:1199] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/33e1cc46939b4932a344b81c3bc8ca82
I20260928 01:55:35.445039 20148 ts_tablet_manager.cc:1950] T 33e1cc46939b4932a344b81c3bc8ca82 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:35.447098 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 100) took 5205 ms. Trace:
I20260928 01:55:35.447424 20148 rpcz_store.cc:276] 0928 01:55:30.242226 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.242356 (+   130us) service_pool.cc:224] Handling call
0928 01:55:35.360238 (+5117882us) ts_tablet_manager.cc:1151] Deleting tablet 33e1cc46939b4932a344b81c3bc8ca82
0928 01:55:35.360295 (+    57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.401381 (+ 41086us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.443724 (+ 42343us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.447030 (+  3306us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4994023}
I20260928 01:55:35.448936 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 33e1cc46939b4932a344b81c3bc8ca82 (table default.Table_1a6a047e1e8f4430a6756891154a5e3b [id=c9816a660a324eb9a6eeb87f2f1e9422]) successfully deleted
I20260928 01:55:35.453080 20029 ts_tablet_manager.cc:1434] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.096s	user 0.004s	sys 0.002s
I20260928 01:55:35.453715 20302 raft_consensus.cc:493] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:55:23.813467 20040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:55:35.454185 20302 raft_consensus.cc:515] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:35.454936 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 97666.8us
I20260928 01:55:35.455180 19881 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
W20260928 01:55:23.722028 20036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:55:35.454012 20037 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 11735 milliseconds
I20260928 01:55:35.456938 19896 tablet_bootstrap.cc:654] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.458297 19881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:55:35.459904 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfcdfe218414396824a8f3af4d673ff" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:35.463565 20310 consensus_queue.cc:1048] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:35.458814 20302 leader_election.cc:290] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:35.469743 20148 tablet_replica.cc:333] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:35.470614 20148 raft_consensus.cc:2243] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:35.471114 20148 raft_consensus.cc:2272] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:35.457890 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a71904514a488083426f5fe07d12cd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:35.479523 19409 leader_election.cc:343] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:35.485105 20148 ts_tablet_manager.cc:1916] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:35.485842 19117 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_d64c4b140b0f41cea6c0cc6314e6fbaf" } new_table_name: "default.Table_00a9b004f2894ebb91ab3ebc4098cf0d" modify_external_catalogs: true
I20260928 01:55:35.487236 20029 tablet_bootstrap.cc:492] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:35.498960 20029 tablet_bootstrap.cc:654] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.504494 19881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:55:35.507907 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_001856018a3743328c46c694f06bb065"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:35.512310 19111 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8dc9a1c5be7c4e519f1415ba70397f01 consensus state has no leader
I20260928 01:55:35.512473 19881 hybrid_clock.cc:648] HybridClock initialized: now 1790560535512322 us; error 133 us; skew 500 ppm
I20260928 01:55:35.513515 19111 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_3ce866b8da2a4181bedfe396a59a2b76" } modify_external_catalogs: true
I20260928 01:55:35.513844 19881 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:55:35.514077 19111 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_3ce866b8da2a4181bedfe396a59a2b76" } modify_external_catalogs: true
I20260928 01:55:35.537362 19896 tablet_bootstrap.cc:492] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:35.537855 19896 ts_tablet_manager.cc:1403] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.099s	user 0.035s	sys 0.047s
I20260928 01:55:35.541026 20148 ts_tablet_manager.cc:1929] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:35.541481 20148 log.cc:1199] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/027f99abaacc4c169661e7db08512ebd
I20260928 01:55:35.542268 20148 ts_tablet_manager.cc:1950] T 027f99abaacc4c169661e7db08512ebd P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:35.544054 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a71904514a488083426f5fe07d12cd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:35.544556 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 109) took 4953 ms. Trace:
I20260928 01:55:35.544725 19620 raft_consensus.cc:2468] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:35.544903 20148 rpcz_store.cc:276] 0928 01:55:30.591169 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.700959 (+109790us) service_pool.cc:224] Handling call
0928 01:55:35.469547 (+4768588us) ts_tablet_manager.cc:1151] Deleting tablet 027f99abaacc4c169661e7db08512ebd
0928 01:55:35.469614 (+    67us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.518191 (+ 48577us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.540865 (+ 22674us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.544484 (+  3619us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4767595}
I20260928 01:55:35.545666 19896 raft_consensus.cc:359] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:35.546347 19896 raft_consensus.cc:385] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.546612 19896 raft_consensus.cc:740] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.546482 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 027f99abaacc4c169661e7db08512ebd (table default.Table_26116cab8a164e2cb26e73efbde6d923 [id=00aeb9f1892b4b009a69e32f201b081a]) successfully deleted
W20260928 01:55:35.547536 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 144715us
I20260928 01:55:35.548261 20029 tablet_bootstrap.cc:492] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:35.548697 20029 ts_tablet_manager.cc:1403] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.000s
I20260928 01:55:35.551394 20029 raft_consensus.cc:359] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.554070 19896 consensus_queue.cc:260] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:35.554649 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 115) took 4251 ms. Trace:
I20260928 01:55:35.555056 20148 rpcz_store.cc:276] 0928 01:55:31.302992 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.303133 (+   141us) service_pool.cc:224] Handling call
0928 01:55:35.554245 (+4251112us) ts_tablet_manager.cc:1151] Deleting tablet a43cfb32bd0043049cbdb2faaf10409f
0928 01:55:35.554330 (+    85us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.554575 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4250347}
W20260928 01:55:35.556635 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet a43cfb32bd0043049cbdb2faaf10409f because the tablet was not found. No further retry: Not found: Tablet not found: a43cfb32bd0043049cbdb2faaf10409f
I20260928 01:55:35.558655 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 116) took 4254 ms. Trace:
I20260928 01:55:35.559139 20148 rpcz_store.cc:276] 0928 01:55:31.304449 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.304564 (+   115us) service_pool.cc:224] Handling call
0928 01:55:35.558256 (+4253692us) ts_tablet_manager.cc:1151] Deleting tablet ad62475da6e74fb4971837a018e77c1c
0928 01:55:35.558343 (+    87us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.558588 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4253040}
W20260928 01:55:35.561151 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet ad62475da6e74fb4971837a018e77c1c because the tablet was not found. No further retry: Not found: Tablet not found: ad62475da6e74fb4971837a018e77c1c
I20260928 01:55:35.561837 19896 ts_tablet_manager.cc:1434] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260928 01:55:35.564819 20148 tablet_replica.cc:333] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:35.565665 20029 raft_consensus.cc:385] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.565990 20029 raft_consensus.cc:740] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.566617 20029 consensus_queue.cc:260] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.567459 20148 raft_consensus.cc:2243] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:35.567363 20424 tablet.cc:1746] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: Skipping requested alter to schema version 2, tablet already version 2
I20260928 01:55:35.568487 20148 raft_consensus.cc:2272] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:35.574895 20029 ts_tablet_manager.cc:1434] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260928 01:55:35.571461 19896 tablet_bootstrap.cc:492] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:35.582154 20029 tablet_bootstrap.cc:492] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:35.588964 20148 ts_tablet_manager.cc:1916] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:35.591341 20029 tablet_bootstrap.cc:654] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.592855 19896 tablet_bootstrap.cc:654] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.603609 20029 tablet_bootstrap.cc:492] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:35.604084 20029 ts_tablet_manager.cc:1403] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.005s
I20260928 01:55:35.606994 20029 raft_consensus.cc:359] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.607642 20029 raft_consensus.cc:385] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.607913 20029 raft_consensus.cc:740] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:55:35.608989 19704 leader_election.cc:343] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:35.609797 20148 ts_tablet_manager.cc:1929] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:35.610205 20148 log.cc:1199] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/457837143b0f4763a4b91bb25b580477
I20260928 01:55:35.610998 20148 ts_tablet_manager.cc:1950] T 457837143b0f4763a4b91bb25b580477 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:35.611131 19896 tablet_bootstrap.cc:492] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:35.611572 19896 ts_tablet_manager.cc:1403] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.005s
I20260928 01:55:35.613195 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 117) took 4307 ms. Trace:
I20260928 01:55:35.613559 20148 rpcz_store.cc:276] 0928 01:55:31.305597 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.305727 (+   130us) service_pool.cc:224] Handling call
0928 01:55:35.562229 (+4256502us) ts_tablet_manager.cc:1151] Deleting tablet 457837143b0f4763a4b91bb25b580477
0928 01:55:35.564669 (+  2440us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.601792 (+ 37123us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.609659 (+  7867us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.613125 (+  3466us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4255746}
I20260928 01:55:35.614306 19896 raft_consensus.cc:359] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.614957 19896 raft_consensus.cc:385] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.614959 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 457837143b0f4763a4b91bb25b580477 (table default.Table_f8fbaf65902f43be8bbe856cd5e13599 [id=3ce11f08674f49feacdef55232965124]) successfully deleted
I20260928 01:55:35.616390 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bfcdfe218414396824a8f3af4d673ff" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:35.616815 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 114) took 4314 ms. Trace:
I20260928 01:55:35.617038 19468 raft_consensus.cc:3060] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:35.617318 20148 rpcz_store.cc:276] 0928 01:55:31.302623 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.307140 (+  4517us) service_pool.cc:224] Handling call
0928 01:55:35.616470 (+4309330us) ts_tablet_manager.cc:1151] Deleting tablet 7dd4743c49314e8b8d86e1c6e553b13e
0928 01:55:35.616533 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.616755 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4308498}
W20260928 01:55:35.618981 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7dd4743c49314e8b8d86e1c6e553b13e because the tablet was not found. No further retry: Not found: Tablet not found: 7dd4743c49314e8b8d86e1c6e553b13e
I20260928 01:55:35.620314 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 113) took 4318 ms. Trace:
I20260928 01:55:35.621158 20148 rpcz_store.cc:276] 0928 01:55:31.302225 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.308222 (+  5997us) service_pool.cc:224] Handling call
0928 01:55:35.619938 (+4311716us) ts_tablet_manager.cc:1151] Deleting tablet 0e902da355b641868c207fc26578b739
0928 01:55:35.620020 (+    82us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.620262 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4308207}
I20260928 01:55:35.621138 19890 consensus_queue.cc:260] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:35.622622 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 0e902da355b641868c207fc26578b739 because the tablet was not found. No further retry: Not found: Tablet not found: 0e902da355b641868c207fc26578b739
I20260928 01:55:35.623549 20148 tablet_replica.cc:333] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:35.624042 19890 ts_tablet_manager.cc:1434] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.213s	user 0.006s	sys 0.001s
I20260928 01:55:35.624523 20148 raft_consensus.cc:2243] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:35.625101 20148 raft_consensus.cc:2272] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:35.627043 20148 ts_tablet_manager.cc:1916] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:35.620505 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 90d40050f85a4d6c90a4ce35cf15d134 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]) successfully deleted
I20260928 01:55:35.639140 19468 raft_consensus.cc:2468] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
W20260928 01:55:35.639806 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_001856018a3743328c46c694f06bb065 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:35.642177 20148 ts_tablet_manager.cc:1929] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 01:55:35.642817 20148 log.cc:1199] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/eaa1e9b7119d46a2ba2652a893877c8c
I20260928 01:55:35.644385 19896 raft_consensus.cc:740] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.645536 20148 ts_tablet_manager.cc:1950] T eaa1e9b7119d46a2ba2652a893877c8c P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:35.648747 20029 consensus_queue.cc:260] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.651091 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 119) took 4201 ms. Trace:
I20260928 01:55:35.651784 20148 rpcz_store.cc:276] 0928 01:55:31.449327 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.452782 (+  3455us) service_pool.cc:224] Handling call
0928 01:55:35.623380 (+4170598us) ts_tablet_manager.cc:1151] Deleting tablet eaa1e9b7119d46a2ba2652a893877c8c
0928 01:55:35.623439 (+    59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.634952 (+ 11513us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.642042 (+  7090us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.650982 (+  8940us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4169543}
I20260928 01:55:35.654965 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet eaa1e9b7119d46a2ba2652a893877c8c (table default.Table_9ebdf86862884825a8be67c95fd3f412 [id=2961b396aa0e488e8440ed77d774588c]) successfully deleted
I20260928 01:55:35.656109 20148 tablet_replica.cc:333] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:35.656939 20148 raft_consensus.cc:2243] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:35.657946 20148 raft_consensus.cc:2272] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:35.657642 19896 consensus_queue.cc:260] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.661545 20148 ts_tablet_manager.cc:1916] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:35.664667 19896 ts_tablet_manager.cc:1434] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.006s
I20260928 01:55:35.665380 19881 webserver.cc:533] Webserver started at http://127.18.161.60:34303/ using document root <none> and password file <none>
I20260928 01:55:35.666858 19881 fs_manager.cc:362] Metadata directory not provided
I20260928 01:55:35.667258 19881 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:55:35.669163 20029 ts_tablet_manager.cc:1434] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
W20260928 01:55:35.610853 19704 leader_election.cc:343] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:35.677966 19896 tablet_bootstrap.cc:492] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:35.678169 20148 ts_tablet_manager.cc:1929] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 01:55:35.678567 20148 log.cc:1199] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/05f875e126f04415a108f778a76bb0f5
W20260928 01:55:35.682785 19412 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:35.691022 19896 tablet_bootstrap.cc:654] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.679260 20148 ts_tablet_manager.cc:1950] T 05f875e126f04415a108f778a76bb0f5 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:35.700178 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 118) took 4251 ms. Trace:
I20260928 01:55:35.708696 19896 tablet_bootstrap.cc:492] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:35.716637 19896 ts_tablet_manager.cc:1403] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.051s	user 0.003s	sys 0.009s
W20260928 01:55:35.717645 19412 leader_election.cc:343] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 90d40050f85a4d6c90a4ce35cf15d134
I20260928 01:55:35.719241 19896 raft_consensus.cc:359] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.719867 19896 raft_consensus.cc:385] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:55:35.719935 19412 leader_election.cc:343] T 90d40050f85a4d6c90a4ce35cf15d134 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 90d40050f85a4d6c90a4ce35cf15d134
I20260928 01:55:35.716356 20148 rpcz_store.cc:276] 0928 01:55:31.448724 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.454515 (+  5791us) service_pool.cc:224] Handling call
0928 01:55:35.655927 (+4201412us) ts_tablet_manager.cc:1151] Deleting tablet 05f875e126f04415a108f778a76bb0f5
0928 01:55:35.655986 (+    59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.670179 (+ 14193us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.677097 (+  6918us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.700102 (+ 23005us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4199849}
I20260928 01:55:35.720835 19881 fs_manager.cc:714] Time spent opening directory manager: real 0.049s	user 0.011s	sys 0.007s
I20260928 01:55:35.721199 20148 tablet_replica.cc:333] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:35.721539 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 05f875e126f04415a108f778a76bb0f5 (table default.Table_2c6a423a3158495a98d244242381a423 [id=10dc4468b0ce4b2c87cecd4c66cc5300]) successfully deleted
I20260928 01:55:35.721901 20148 raft_consensus.cc:2243] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:35.685364 20029 tablet_bootstrap.cc:492] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:35.722383 20148 raft_consensus.cc:2272] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:35.724171 20148 ts_tablet_manager.cc:1916] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:35.700811 20397 raft_consensus.cc:493] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:35.725963 20397 raft_consensus.cc:515] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.720160 19896 raft_consensus.cc:740] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.728922 19896 consensus_queue.cc:260] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.730355 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a71904514a488083426f5fe07d12cd" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:35.730950 19468 raft_consensus.cc:2468] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:35.735100 19896 ts_tablet_manager.cc:1434] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260928 01:55:35.737493 19703 leader_election.cc:304] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:35.736052 19896 tablet_bootstrap.cc:492] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:35.738417 20292 raft_consensus.cc:2804] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:35.738750 20292 raft_consensus.cc:493] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:35.739054 20292 raft_consensus.cc:3060] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:35.741451 20441 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:55:35.742892 19881 fs_manager.cc:730] Time spent opening block manager: real 0.019s	user 0.005s	sys 0.000s
I20260928 01:55:35.728055 20397 leader_election.cc:290] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:35.743304 19881 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/wal
uuid: "04e48edd841a42d08a480be209f0d294"
format_stamp: "Formatted at 2026-09-28 01:55:09 on dist-test-slave-lrdp"
I20260928 01:55:35.747498 19881 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:55:35.745342 20029 tablet_bootstrap.cc:654] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.749500 19896 tablet_bootstrap.cc:654] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.754124 20292 raft_consensus.cc:515] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.756744 20302 raft_consensus.cc:493] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:35.757278 20302 raft_consensus.cc:515] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:35.759608 20302 leader_election.cc:290] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:35.761732 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:35.763669 19409 leader_election.cc:343] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:35.766340 19896 tablet_bootstrap.cc:492] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:35.767203 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a71904514a488083426f5fe07d12cd" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:35.767759 19468 raft_consensus.cc:3060] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:35.766732 19896 ts_tablet_manager.cc:1403] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.000s
I20260928 01:55:35.772228 20148 ts_tablet_manager.cc:1929] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 01:55:35.772584 20148 log.cc:1199] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/ce41f63df46f4d0493ca22a13daadb4f
I20260928 01:55:35.773280 20148 ts_tablet_manager.cc:1950] T ce41f63df46f4d0493ca22a13daadb4f P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:35.774997 19468 raft_consensus.cc:2468] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:35.775276 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 126) took 3746 ms. Trace:
I20260928 01:55:35.775564 20148 rpcz_store.cc:276] 0928 01:55:32.029204 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.081771 (+ 52567us) service_pool.cc:224] Handling call
0928 01:55:35.721021 (+3639250us) ts_tablet_manager.cc:1151] Deleting tablet ce41f63df46f4d0493ca22a13daadb4f
0928 01:55:35.721083 (+    62us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.743269 (+ 22186us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.772064 (+ 28795us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.775198 (+  3134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3635764}
I20260928 01:55:35.776436 19703 leader_election.cc:304] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:35.776822 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 125) took 3748 ms. Trace:
I20260928 01:55:35.776924 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet ce41f63df46f4d0493ca22a13daadb4f (table default.Table_f74d6b5e81d2457b88ab4456aa43c249 [id=9e114860728146b097bcfce77a95f9d0]) successfully deleted
I20260928 01:55:35.777107 20148 rpcz_store.cc:276] 0928 01:55:32.028061 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.095277 (+ 67216us) service_pool.cc:224] Handling call
0928 01:55:35.776491 (+3681214us) ts_tablet_manager.cc:1151] Deleting tablet f3741aec215343468b2d7bc952da03c8
0928 01:55:35.776531 (+    40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.776775 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3675922}
I20260928 01:55:35.777468 20397 raft_consensus.cc:2804] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:35.778677 20397 raft_consensus.cc:697] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:35.779558 20397 consensus_queue.cc:237] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:35.784263 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet f3741aec215343468b2d7bc952da03c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3741aec215343468b2d7bc952da03c8 already in progress: creating tablet
I20260928 01:55:35.790508 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 136) took 3637 ms. Trace:
I20260928 01:55:35.790884 20148 rpcz_store.cc:276] 0928 01:55:32.153762 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.153913 (+   151us) service_pool.cc:224] Handling call
0928 01:55:35.777962 (+3624049us) ts_tablet_manager.cc:1151] Deleting tablet e05925303152462e8ca25cd15f3bedff
0928 01:55:35.778004 (+    42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.790436 (+ 12432us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3623346}
I20260928 01:55:35.793795 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 137) took 3638 ms. Trace:
I20260928 01:55:35.794127 20148 rpcz_store.cc:276] 0928 01:55:32.155113 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.155257 (+   144us) service_pool.cc:224] Handling call
0928 01:55:35.793412 (+3638155us) ts_tablet_manager.cc:1151] Deleting tablet 9ca0b52215454a99b6c5d1956088829a
0928 01:55:35.793465 (+    53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.793734 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3636516}
W20260928 01:55:35.794971 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 184185us
I20260928 01:55:35.795250 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 143) took 2549 ms. Trace:
I20260928 01:55:35.795517 20148 rpcz_store.cc:276] 0928 01:55:33.245581 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.250668 (+  5087us) service_pool.cc:224] Handling call
0928 01:55:35.794904 (+2544236us) ts_tablet_manager.cc:1151] Deleting tablet 158edf7a5d724c88992fecbadd2cedfa
0928 01:55:35.794942 (+    38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.795197 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2541341}
I20260928 01:55:35.796507 20148 tablet_replica.cc:333] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
W20260928 01:55:35.797142 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet e05925303152462e8ca25cd15f3bedff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e05925303152462e8ca25cd15f3bedff already in progress: creating tablet
I20260928 01:55:35.797264 20148 raft_consensus.cc:2243] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:35.797735 20148 raft_consensus.cc:2272] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 01:55:35.797798 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 9ca0b52215454a99b6c5d1956088829a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ca0b52215454a99b6c5d1956088829a already in progress: creating tablet
W20260928 01:55:35.798446 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 158edf7a5d724c88992fecbadd2cedfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 158edf7a5d724c88992fecbadd2cedfa already in progress: creating tablet
I20260928 01:55:35.779683 19896 raft_consensus.cc:359] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.800293 19896 raft_consensus.cc:385] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.800621 19896 raft_consensus.cc:740] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.809288 19890 tablet_bootstrap.cc:492] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:35.805365 20148 ts_tablet_manager.cc:1916] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:35.816468 19896 consensus_queue.cc:260] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.819015 19896 ts_tablet_manager.cc:1434] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260928 01:55:35.819883 19896 tablet_bootstrap.cc:492] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:35.715596 20437 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 81ebb46a410e43ebaec3ef4dd13a71fc)
I20260928 01:55:35.828495 19896 tablet_bootstrap.cc:654] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.828974 20437 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:35.835927 20148 ts_tablet_manager.cc:1929] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:35.836359 20148 log.cc:1199] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/5d9b93f45ccf44e785b00849e49c8294
I20260928 01:55:35.837020 20148 ts_tablet_manager.cc:1950] T 5d9b93f45ccf44e785b00849e49c8294 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:35.838953 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 145) took 2439 ms. Trace:
I20260928 01:55:35.839253 20148 rpcz_store.cc:276] 0928 01:55:33.399916 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.400596 (+   680us) service_pool.cc:224] Handling call
0928 01:55:35.796359 (+2395763us) ts_tablet_manager.cc:1151] Deleting tablet 5d9b93f45ccf44e785b00849e49c8294
0928 01:55:35.796398 (+    39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.819101 (+ 22703us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.835796 (+ 16695us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.838889 (+  3093us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2394772}
I20260928 01:55:35.846381 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 5d9b93f45ccf44e785b00849e49c8294 (table default.Table_63f36a8d22184eac8a38565457441d09 [id=102958783e204ded94a67a96b0dec09b]) successfully deleted
I20260928 01:55:35.848459 20148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 144) took 2449 ms. Trace:
I20260928 01:55:35.849689 20148 rpcz_store.cc:276] 0928 01:55:33.399341 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.400251 (+   910us) service_pool.cc:224] Handling call
0928 01:55:35.848105 (+2447854us) ts_tablet_manager.cc:1151] Deleting tablet 22606f012f1c44bd92c8e0341e9ca2b7
0928 01:55:35.848149 (+    44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.848402 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2412174}
W20260928 01:55:35.853971 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 22606f012f1c44bd92c8e0341e9ca2b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22606f012f1c44bd92c8e0341e9ca2b7 already in progress: creating tablet
I20260928 01:55:35.852360 19896 tablet_bootstrap.cc:492] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:35.855233 19896 ts_tablet_manager.cc:1403] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.036s	user 0.003s	sys 0.007s
I20260928 01:55:35.857805 19896 raft_consensus.cc:359] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:35.860613 19896 raft_consensus.cc:385] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:35.861397 19896 raft_consensus.cc:740] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:35.862469 19896 consensus_queue.cc:260] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:35.859043 20148 tablet_replica.cc:333] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:35.864882 20148 raft_consensus.cc:2243] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:35.865398 20148 raft_consensus.cc:2272] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:35.866555 19412 leader_election.cc:304] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:35.867429 20148 ts_tablet_manager.cc:1916] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:35.867892 20302 raft_consensus.cc:2749] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:35.872015 19896 ts_tablet_manager.cc:1434] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260928 01:55:35.876156 19896 tablet_bootstrap.cc:492] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:35.896538 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 179743us
I20260928 01:55:35.897424 19896 tablet_bootstrap.cc:654] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:35.908385 20292 leader_election.cc:290] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:35.911824 19471 raft_consensus.cc:3060] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:35.935101 20148 ts_tablet_manager.cc:1929] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:35.935367 20302 raft_consensus.cc:493] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:35.935501 20148 log.cc:1199] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/78a71904514a488083426f5fe07d12cd
I20260928 01:55:35.935806 20302 raft_consensus.cc:515] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:35.940155 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:35.936149 20148 ts_tablet_manager.cc:1950] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:35.942970 20302 leader_election.cc:290] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:35.944919 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 78a71904514a488083426f5fe07d12cd (table default.Table_d6ec5f8939f84de7994041a54bdbe36b [id=ab54f23a53744160a4b2437b2b513937]) successfully deleted
I20260928 01:55:35.946247 19412 leader_election.cc:304] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:35.947194 19412 raft_consensus.cc:2686] T 78a71904514a488083426f5fe07d12cd P 37089d44fdba4b6488b5b5aea28af614: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 01:55:35.950067 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet f71e2109f8cd4dd4a288fbdc8e50b133 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f71e2109f8cd4dd4a288fbdc8e50b133 already in progress: creating tablet
I20260928 01:55:35.961460 20029 tablet_bootstrap.cc:492] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:35.963785 20302 raft_consensus.cc:493] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:35.964474 20302 raft_consensus.cc:515] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:35.971868 20302 leader_election.cc:290] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:35.991671 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 230 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:35.967549 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:36.006245 20029 ts_tablet_manager.cc:1403] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.327s	user 0.012s	sys 0.002s
I20260928 01:55:36.013792 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a71904514a488083426f5fe07d12cd" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:36.014411 19617 raft_consensus.cc:3060] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:36.026589 19617 raft_consensus.cc:2468] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:36.027601 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a71904514a488083426f5fe07d12cd" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:36.052373 20147 ts_tablet_manager.cc:1929] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:36.053109 20147 log.cc:1199] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/33e1cc46939b4932a344b81c3bc8ca82
I20260928 01:55:36.054237 20147 ts_tablet_manager.cc:1950] T 33e1cc46939b4932a344b81c3bc8ca82 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:36.100453 20437 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:36.102578 20302 raft_consensus.cc:493] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:36.103225 20302 raft_consensus.cc:515] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.106603 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca443386942e49d9a66143e1fde777c5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:36.107344 19767 raft_consensus.cc:2468] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:36.108937 19409 leader_election.cc:304] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:55:36.111467 19104 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8dc9a1c5be7c4e519f1415ba70397f01 consensus state has no leader
I20260928 01:55:36.055469 20249 raft_consensus.cc:493] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:36.149240 20249 raft_consensus.cc:515] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.057374 19595 tablet_service.cc:1558] Processing DeleteTablet for tablet 78a71904514a488083426f5fe07d12cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:36.058382 19593 tablet_service.cc:1558] Processing DeleteTablet for tablet f71e2109f8cd4dd4a288fbdc8e50b133 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:36.153760 20249 leader_election.cc:290] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:36.155377 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:36.157043 19553 leader_election.cc:343] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:36.166293 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 100) took 5670 ms. Trace:
I20260928 01:55:36.173882 20029 raft_consensus.cc:359] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:36.188994 19179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 123503us
I20260928 01:55:36.211683 20302 leader_election.cc:290] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:36.228648 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 119814us
I20260928 01:55:36.372772 20302 raft_consensus.cc:2804] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:36.379029 20453 raft_consensus.cc:493] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:36.384948 20029 raft_consensus.cc:385] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:36.385754 20029 raft_consensus.cc:740] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:55:36.417306 19117 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0669f9f51b05479aa9715e06d4c42423 has no consensus state
I20260928 01:55:36.419196 19117 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51212 (request call id 204) took 1436 ms. Trace:
I20260928 01:55:36.430874 19117 rpcz_store.cc:276] 0928 01:55:34.982545 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:35.389895 (+407350us) service_pool.cc:224] Handling call
0928 01:55:35.485712 (+ 95817us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c7be6 00007f19fd17b634 00007f19fd17b5c2 00007f19fd17b4f1 00007f19fd17b46c 00007f19fd17a722 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:35.486481 (+   769us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:35.487665 (+  1184us) catalog_manager.cc:3764] Apply alter schema
0928 01:55:35.488287 (+   622us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 01:55:35.488496 (+   209us) catalog_manager.cc:3954] Updating metadata on disk
0928 01:55:36.415349 (+926853us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 01:55:36.419065 (+  3716us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:35.569962 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:35.570494 (+   532us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:35.570529 (+    35us) write_op.cc:435] Acquired schema lock
0928 01:55:35.570547 (+    18us) tablet.cc:662] Decoding operations
0928 01:55:35.570884 (+   337us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:35.570950 (+    66us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:35.570989 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:35.571179 (+   190us) tablet.cc:701] Row locks acquired
0928 01:55:35.571196 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:55:35.571327 (+   131us) write_op.cc:270] Start()
0928 01:55:35.571409 (+    82us) write_op.cc:276] Timestamp: P: 1790560535571283 usec, L: 0
0928 01:55:35.571428 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:55:35.658888 (+ 87460us) log.cc:844] Serialized 405 byte log entry
0928 01:55:35.933643 (+274755us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b58000428d0. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd6a796c 00007f19fd6ae283 00007f19fd6ae209 00007f19fd6ae199 00007f19fd6ae161 00007f19fd6ad32d 00000000005bd4e4 00000000005bd319 00007f19f65eb3e5 00007f19f65ed751
0928 01:55:36.196353 (+262710us) op_driver.cc:464] REPLICATION: finished
0928 01:55:36.225806 (+ 29453us) write_op.cc:301] APPLY: starting
0928 01:55:36.225875 (+    69us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:36.225983 (+   108us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:36.226007 (+    24us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:36.226212 (+   205us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:36.226354 (+   142us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:36.226399 (+    45us) write_op.cc:312] APPLY: finished
0928 01:55:36.226625 (+   226us) log.cc:844] Serialized 23 byte log entry
0928 01:55:36.414663 (+188038us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:36.414760 (+    97us) write_op.cc:454] Released schema lock
0928 01:55:36.414800 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":217956224,"child_traces":[["op",{"apply.queue_time_us":29216,"num_ops":1,"prepare.queue_time_us":79523,"prepare.run_cpu_time_us":2603,"prepare.run_wall_time_us":90729,"raft.queue_time_us":99,"raft.run_cpu_time_us":2995,"raft.run_wall_time_us":273240,"replication_time_us":624802,"spinlock_wait_cycles":626864000,"thread_start_us":115245,"threads_started":2}]]}
I20260928 01:55:36.198343 20249 raft_consensus.cc:493] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:36.477640 20249 raft_consensus.cc:515] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.312978 19468 raft_consensus.cc:3060] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:36.517697 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:36.531702 19409 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 201957us
I20260928 01:55:36.514209 20249 leader_election.cc:290] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:36.529656 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:36.370990 19890 tablet_bootstrap.cc:700] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0: Time spent opening tablet: real 0.271s	user 0.001s	sys 0.000s
I20260928 01:55:36.485013 20147 rpcz_store.cc:276] 0928 01:55:30.496414 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.496527 (+   113us) service_pool.cc:224] Handling call
0928 01:55:34.946011 (+4449484us) ts_tablet_manager.cc:1151] Deleting tablet 33e1cc46939b4932a344b81c3bc8ca82
0928 01:55:34.946068 (+    57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:35.367867 (+421799us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:35.892753 (+524886us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:36.166190 (+273437us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4448859}
I20260928 01:55:36.376173 20302 raft_consensus.cc:493] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:36.604128 20302 raft_consensus.cc:3060] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:36.607040 20454 raft_consensus.cc:493] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:55:36.608016 19179 leader_election.cc:336] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095): Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111)
I20260928 01:55:36.609007 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:36.608057 20454 raft_consensus.cc:515] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.614246 19109 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 205) took 1250 ms. Trace:
I20260928 01:55:36.621043 20454 leader_election.cc:290] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:36.382601 20453 raft_consensus.cc:515] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.389330 20029 consensus_queue.cc:260] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.644802 19881 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:55:36.654129 20466 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:55:36.615150 19109 rpcz_store.cc:276] 0928 01:55:35.363998 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:35.507477 (+143479us) service_pool.cc:224] Handling call
0928 01:55:35.641031 (+133554us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:35.670173 (+ 29142us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:36.611590 (+941417us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:55:36.613300 (+  1710us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:55:36.614117 (+   817us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:35.671675 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:35.672118 (+   443us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:35.672145 (+    27us) write_op.cc:435] Acquired schema lock
0928 01:55:35.672160 (+    15us) tablet.cc:662] Decoding operations
0928 01:55:35.812946 (+140786us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:35.812997 (+    51us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:35.813023 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:35.813280 (+   257us) tablet.cc:701] Row locks acquired
0928 01:55:35.813294 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:35.813448 (+   154us) write_op.cc:270] Start()
0928 01:55:35.813564 (+   116us) write_op.cc:276] Timestamp: P: 1790560535813383 usec, L: 0
0928 01:55:35.813582 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:55:35.814172 (+   590us) log.cc:844] Serialized 433 byte log entry
0928 01:55:36.229488 (+415316us) op_driver.cc:464] REPLICATION: finished
0928 01:55:36.353161 (+123673us) write_op.cc:301] APPLY: starting
0928 01:55:36.353381 (+   220us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:36.353777 (+   396us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:36.355256 (+  1479us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:36.572108 (+216852us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:36.589808 (+ 17700us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:55:36.590028 (+   220us) write_op.cc:312] APPLY: finished
0928 01:55:36.590720 (+   692us) log.cc:844] Serialized 29 byte log entry
0928 01:55:36.600367 (+  9647us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:36.600528 (+   161us) write_op.cc:454] Released schema lock
0928 01:55:36.600721 (+   193us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":123025,"apply.run_cpu_time_us":7970,"apply.run_wall_time_us":272182,"num_ops":2,"prepare.queue_time_us":141,"prepare.run_cpu_time_us":3290,"prepare.run_wall_time_us":313292,"raft.queue_time_us":118308,"raft.run_cpu_time_us":20,"raft.run_wall_time_us":19,"replication_time_us":415757,"thread_start_us":296293,"threads_started":2}]]}
I20260928 01:55:36.656010 20454 raft_consensus.cc:493] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:36.683585 19881 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:55:36.685684 19881 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260928 01:55:36.570819 19556 consensus_peers.cc:597] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 027f99abaacc4c169661e7db08512ebd. This is attempt 1: this message will repeat every 5th retry.
W20260928 01:55:36.691423 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 121136us
I20260928 01:55:36.559541 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:36.569446 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca443386942e49d9a66143e1fde777c5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:36.555981 19617 raft_consensus.cc:2393] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:36.567431 19890 tablet_bootstrap.cc:654] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:36.710362 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 120084us
I20260928 01:55:36.712872 20310 consensus_queue.cc:1048] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:36.706840 19556 consensus_peers.cc:597] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce41f63df46f4d0493ca22a13daadb4f. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:36.667544 20147 tablet_replica.cc:333] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:36.733879 20147 raft_consensus.cc:2243] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:36.734611 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:36.746346 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 33e1cc46939b4932a344b81c3bc8ca82 (table default.Table_1a6a047e1e8f4430a6756891154a5e3b [id=c9816a660a324eb9a6eeb87f2f1e9422]) successfully deleted
I20260928 01:55:36.752851 19471 raft_consensus.cc:2468] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:36.751621 20147 raft_consensus.cc:2272] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:36.765457 19890 tablet_bootstrap.cc:492] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:36.778842 19890 ts_tablet_manager.cc:1403] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.970s	user 0.023s	sys 0.008s
W20260928 01:55:36.781890 19412 leader_election.cc:343] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:36.782439 19412 leader_election.cc:304] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:36.784168 20147 ts_tablet_manager.cc:1916] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:36.784757 20249 consensus_queue.cc:1048] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:36.785748 19556 leader_election.cc:304] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:36.788681 20249 raft_consensus.cc:2804] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:36.789019 20249 raft_consensus.cc:493] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:36.789330 20249 raft_consensus.cc:3060] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:36.794083 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6b59144fe14daab98b0965c7f8af02" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:36.796753 20249 raft_consensus.cc:515] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.798913 20249 leader_election.cc:290] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:36.809688 20470 raft_consensus.cc:2749] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:36.812585 20470 raft_consensus.cc:493] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:36.813179 20397 raft_consensus.cc:493] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:36.813035 20470 raft_consensus.cc:515] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:36.813689 20397 raft_consensus.cc:515] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.815723 20397 leader_election.cc:290] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:36.817508 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 187978us
I20260928 01:55:36.820971 20419 consensus_queue.cc:1048] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:36.828311 20029 ts_tablet_manager.cc:1434] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.822s	user 0.011s	sys 0.001s
W20260928 01:55:36.828617 20029 ts_tablet_manager.cc:1467] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da: Tablet startup took 821ms
W20260928 01:55:36.828867 20029 ts_tablet_manager.cc:1469] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da: Trace:
0928 01:55:27.154013 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:27.163460 (+  9447us) service_pool.cc:224] Handling call
0928 01:55:27.165995 (+  2535us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:27.166250 (+   255us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:27.298911 (+132661us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:27.858270 (+559359us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:27.858953 (+   683us) inbound_call.cc:177] Queueing success response
0928 01:55:35.678619 (+7819666us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0928 01:55:36.006702 (+328083us) ts_tablet_manager.cc:1435] Starting tablet replica
0928 01:55:36.007302 (+   600us) tablet_replica.cc:261] Starting instrumentation
0928 01:55:36.007809 (+   507us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":178931,"raft.queue_time_us":180072,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":192,"tablet-open.queue_time_us":7816107}
I20260928 01:55:36.821168 20397 raft_consensus.cc:493] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:36.831453 20397 raft_consensus.cc:515] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.833663 20397 leader_election.cc:290] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:36.838389 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9b93f45ccf44e785b00849e49c8294" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:36.839825 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6b59144fe14daab98b0965c7f8af02" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:36.840602 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:36.843039 19764 raft_consensus.cc:2468] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:36.841375 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b3c947794c48daaacc299a7d2dd4a9" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:36.839243 19767 raft_consensus.cc:2468] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:36.782354 19890 raft_consensus.cc:359] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.828406 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:36.845711 19619 raft_consensus.cc:2393] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:36.846949 19890 raft_consensus.cc:385] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:36.847625 19890 raft_consensus.cc:740] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:36.849169 19890 consensus_queue.cc:260] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:36.852967 19896 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.194s	sys 0.256s
W20260928 01:55:36.853930 19896 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.195s	sys 0.257s
I20260928 01:55:36.831110 20029 tablet_bootstrap.cc:492] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:36.859895 19896 tablet_bootstrap.cc:492] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:36.857152 20453 leader_election.cc:290] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:36.860396 19896 ts_tablet_manager.cc:1403] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.984s	user 0.202s	sys 0.257s
W20260928 01:55:36.870179 19179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 261990us
I20260928 01:55:36.853191 19890 ts_tablet_manager.cc:1434] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.001s
I20260928 01:55:36.876714 19890 tablet_bootstrap.cc:492] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:36.881516 20470 leader_election.cc:290] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:36.886736 19553 leader_election.cc:304] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:36.887650 20416 raft_consensus.cc:2804] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:36.888091 20416 raft_consensus.cc:493] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:36.888521 20416 raft_consensus.cc:3060] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:36.888613 19409 leader_election.cc:343] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:36.889511 19409 leader_election.cc:304] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:55:36.890637 19409 leader_election.cc:343] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:36.893049 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:36.893769 19471 raft_consensus.cc:2468] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:36.898270 20470 raft_consensus.cc:2804] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:36.896943 20416 raft_consensus.cc:515] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.901867 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9b93f45ccf44e785b00849e49c8294" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:36.902671 19619 raft_consensus.cc:2393] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:36.902604 20470 raft_consensus.cc:493] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:36.903092 20470 raft_consensus.cc:3060] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:36.900686 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 118774us
W20260928 01:55:36.905293 19412 leader_election.cc:343] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:36.907814 19704 consensus_peers.cc:597] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:36.908504 19412 leader_election.cc:304] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:36.912753 19412 leader_election.cc:304] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:36.662199 20454 raft_consensus.cc:515] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.915349 20454 leader_election.cc:290] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:36.919371 19896 raft_consensus.cc:359] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.920081 19896 raft_consensus.cc:385] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:36.920375 19896 raft_consensus.cc:740] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:36.921226 19896 consensus_queue.cc:260] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.923223 19896 ts_tablet_manager.cc:1434] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.000s
I20260928 01:55:36.929955 19703 leader_election.cc:304] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
W20260928 01:55:36.937206 19412 leader_election.cc:343] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:36.937769 19412 leader_election.cc:304] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:36.937919 20472 raft_consensus.cc:2749] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:36.938577 20416 leader_election.cc:290] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:36.938783 20469 raft_consensus.cc:2749] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:36.946238 20397 raft_consensus.cc:2804] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:36.946671 20397 raft_consensus.cc:493] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:36.947063 20397 raft_consensus.cc:3060] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:36.949038 20147 ts_tablet_manager.cc:1929] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 01:55:36.954154 19703 leader_election.cc:343] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 5d9b93f45ccf44e785b00849e49c8294
W20260928 01:55:36.954977 19703 consensus_peers.cc:597] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78a71904514a488083426f5fe07d12cd. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:36.954890 20147 log.cc:1199] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/027f99abaacc4c169661e7db08512ebd
I20260928 01:55:36.956878 20292 consensus_queue.cc:1048] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:36.958860 20453 raft_consensus.cc:2749] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:36.959156 19556 leader_election.cc:343] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 5d9b93f45ccf44e785b00849e49c8294
I20260928 01:55:36.962647 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:36.963698 19620 raft_consensus.cc:2393] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:36.964802 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bbed8181084cb88b7d33976c20fbb8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:36.965721 20147 ts_tablet_manager.cc:1950] T 027f99abaacc4c169661e7db08512ebd P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
W20260928 01:55:36.965920 19556 leader_election.cc:343] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 5d9b93f45ccf44e785b00849e49c8294
I20260928 01:55:36.961982 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b3c947794c48daaacc299a7d2dd4a9" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:36.972347 19104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 59567.9us
I20260928 01:55:36.972384 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
W20260928 01:55:36.977042 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 50555.9us
I20260928 01:55:36.978292 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 108) took 6231 ms. Trace:
I20260928 01:55:36.978158 19704 leader_election.cc:304] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:36.979650 20419 raft_consensus.cc:3060] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:36.983608 20147 rpcz_store.cc:276] 0928 01:55:30.747257 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.778141 (+ 30884us) service_pool.cc:224] Handling call
0928 01:55:36.614345 (+5836204us) ts_tablet_manager.cc:1151] Deleting tablet 027f99abaacc4c169661e7db08512ebd
0928 01:55:36.667105 (+ 52760us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:36.909142 (+242037us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:36.948902 (+ 39760us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:36.978204 (+ 29302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10768,"tablet-delete.queue_time_us":5797363}
I20260928 01:55:36.943934 20302 raft_consensus.cc:515] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:36.989159 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 027f99abaacc4c169661e7db08512ebd (table default.Table_26116cab8a164e2cb26e73efbde6d923 [id=00aeb9f1892b4b009a69e32f201b081a]) successfully deleted
I20260928 01:55:36.990000 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 109) took 6209 ms. Trace:
I20260928 01:55:36.993785 20419 raft_consensus.cc:2749] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:36.994871 20419 consensus_queue.cc:1048] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:36.995781 19412 leader_election.cc:343] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:36.995925 20147 rpcz_store.cc:276] 0928 01:55:30.780725 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:30.781154 (+   429us) service_pool.cc:224] Handling call
0928 01:55:36.989536 (+6208382us) ts_tablet_manager.cc:1151] Deleting tablet a43cfb32bd0043049cbdb2faaf10409f
0928 01:55:36.989623 (+    87us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:36.989937 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6172341}
W20260928 01:55:36.996548 19412 leader_election.cc:343] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:36.997347 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet a43cfb32bd0043049cbdb2faaf10409f because the tablet was not found. No further retry: Not found: Tablet not found: a43cfb32bd0043049cbdb2faaf10409f
I20260928 01:55:36.998381 19412 leader_election.cc:304] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:36.998720 20147 tablet_replica.cc:333] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:36.999722 20147 raft_consensus.cc:2243] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:37.000344 20416 consensus_queue.cc:1048] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:37.002753 20472 raft_consensus.cc:2749] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:37.006291 20470 raft_consensus.cc:515] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:37.008351 19476 raft_consensus.cc:2393] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:37.022634 20147 raft_consensus.cc:2272] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:37.024619 19593 tablet_service.cc:1511] Processing CreateTablet for tablet 0669f9f51b05479aa9715e06d4c42423 (DEFAULT_TABLE table=default.Table_00a9b004f2894ebb91ab3ebc4098cf0d [id=f071f9c1b9f74504b04a64c5d6a7c8a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.025440 20147 ts_tablet_manager.cc:1916] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:37.026314 19110 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:37.026485 19593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0669f9f51b05479aa9715e06d4c42423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.029001 19110 catalog_manager.cc:5838] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:37.035946 19890 tablet_bootstrap.cc:654] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:37.036988 19896 tablet_bootstrap.cc:492] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:36.996238 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:36.997720 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9b93f45ccf44e785b00849e49c8294" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:37.002544 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bbed8181084cb88b7d33976c20fbb8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:37.004747 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca443386942e49d9a66143e1fde777c5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:37.063657 19766 raft_consensus.cc:3060] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:37.014210 20292 consensus_queue.cc:1048] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:37.092379 20302 leader_election.cc:290] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:37.093746 19443 tablet_service.cc:1511] Processing CreateTablet for tablet 0669f9f51b05479aa9715e06d4c42423 (DEFAULT_TABLE table=default.Table_00a9b004f2894ebb91ab3ebc4098cf0d [id=f071f9c1b9f74504b04a64c5d6a7c8a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.093899 19763 raft_consensus.cc:2468] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:37.095068 19443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0669f9f51b05479aa9715e06d4c42423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.097122 19444 tablet_service.cc:1511] Processing CreateTablet for tablet 8b48eacc1cec49baabe2d87bdd06cd5c (DEFAULT_TABLE table=default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.097414 20470 leader_election.cc:290] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:37.098337 20470 raft_consensus.cc:493] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:37.099035 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b48eacc1cec49baabe2d87bdd06cd5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.117038 19441 tablet_service.cc:1511] Processing CreateTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 (DEFAULT_TABLE table=default.Table_4e2fdca3bbd348fa97286ef3e47f76ec [id=8e39f7a29aaa45e4914447ea47c3c81e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.118769 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f709eccf4ab5413bbbd8b4746f185db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.122408 20470 raft_consensus.cc:515] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:37.125233 19409 leader_election.cc:343] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:37.133057 19409 leader_election.cc:304] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:37.146481 19111 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 89e1d60db21f4a8294792df3fadf5d90
I20260928 01:55:37.153144 19115 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet c320eb2ca2ac4ac68293ef8f7400b45f
I20260928 01:55:37.072688 19595 tablet_service.cc:1511] Processing CreateTablet for tablet 8b48eacc1cec49baabe2d87bdd06cd5c (DEFAULT_TABLE table=default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.177240 19595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b48eacc1cec49baabe2d87bdd06cd5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.134590 20302 raft_consensus.cc:2749] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:37.094677 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca443386942e49d9a66143e1fde777c5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:37.184235 19412 leader_election.cc:343] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:37.100028 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:37.185264 19620 raft_consensus.cc:2393] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:37.117156 19592 tablet_service.cc:1511] Processing CreateTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 (DEFAULT_TABLE table=default.Table_4e2fdca3bbd348fa97286ef3e47f76ec [id=8e39f7a29aaa45e4914447ea47c3c81e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.121711 20147 ts_tablet_manager.cc:1929] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 01:55:37.186185 20147 log.cc:1199] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/eaa1e9b7119d46a2ba2652a893877c8c
I20260928 01:55:37.186640 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f709eccf4ab5413bbbd8b4746f185db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.187057 20147 ts_tablet_manager.cc:1950] T eaa1e9b7119d46a2ba2652a893877c8c P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:37.186936 20470 leader_election.cc:290] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:37.189697 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 113) took 5810 ms. Trace:
I20260928 01:55:37.156524 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f with delete_type TABLET_DATA_DELETED (replaced by tablet 6546cfe6f3a6405fab41a4ebdcffb288) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:37.148742 19591 tablet_service.cc:1558] Processing DeleteTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:35 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:37.191395 20147 rpcz_store.cc:276] 0928 01:55:31.379030 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.379139 (+   109us) service_pool.cc:224] Handling call
0928 01:55:36.998517 (+5619378us) ts_tablet_manager.cc:1151] Deleting tablet eaa1e9b7119d46a2ba2652a893877c8c
0928 01:55:36.998596 (+    79us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:37.070928 (+ 72332us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:37.121588 (+ 50660us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:37.189632 (+ 68044us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5618713}
I20260928 01:55:37.192860 20147 tablet_replica.cc:333] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:37.194169 20147 raft_consensus.cc:2243] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:37.194881 20147 raft_consensus.cc:2272] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:37.195437 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet eaa1e9b7119d46a2ba2652a893877c8c (table default.Table_9ebdf86862884825a8be67c95fd3f412 [id=2961b396aa0e488e8440ed77d774588c]) successfully deleted
I20260928 01:55:37.197434 20147 ts_tablet_manager.cc:1916] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:37.199155 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a753f894ae94b1eaf9b445df3545ded" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:37.200850 19412 leader_election.cc:343] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:37.202873 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 599ef1523fcf43d1a1e2a91f03abaa60 (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 599ef1523fcf43d1a1e2a91f03abaa60 consensus state has no leader
I20260928 01:55:37.235378 19115 catalog_manager.cc:6934] ReplaceTablet: tablet c320eb2ca2ac4ac68293ef8f7400b45f deleted and replaced by tablet 6546cfe6f3a6405fab41a4ebdcffb288
I20260928 01:55:37.041603 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 0669f9f51b05479aa9715e06d4c42423 (DEFAULT_TABLE table=default.Table_00a9b004f2894ebb91ab3ebc4098cf0d [id=f071f9c1b9f74504b04a64c5d6a7c8a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.236532 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0669f9f51b05479aa9715e06d4c42423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.050807 20397 raft_consensus.cc:515] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:37.141273 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:37.153475 19742 tablet_service.cc:1511] Processing CreateTablet for tablet 8b48eacc1cec49baabe2d87bdd06cd5c (DEFAULT_TABLE table=default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.247063 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b48eacc1cec49baabe2d87bdd06cd5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.156054 19734 tablet_service.cc:1511] Processing CreateTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 (DEFAULT_TABLE table=default.Table_4e2fdca3bbd348fa97286ef3e47f76ec [id=8e39f7a29aaa45e4914447ea47c3c81e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.249316 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f709eccf4ab5413bbbd8b4746f185db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.236423 19115 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51212 (request call id 203) took 2467 ms. Trace:
I20260928 01:55:37.254423 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 49a73835e2854976b40b31fe752d1b1b (DEFAULT_TABLE table=default.Table_63f36a8d22184eac8a38565457441d09 [id=102958783e204ded94a67a96b0dec09b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.255450 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a73835e2854976b40b31fe752d1b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.252753 19115 rpcz_store.cc:276] 0928 01:55:34.769210 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:35.245163 (+475953us) service_pool.cc:224] Handling call
0928 01:55:35.491089 (+245926us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5ca0e1 00007f19fd192d37 00007f19fd192cc2 00007f19fd192bf1 00007f19fd192b6c 00007f19fd191e22 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:37.235225 (+1744136us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b4c00002680. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fb3abfe0 00007f19fb3bcfc9 00007f19fb3bd6af 00007f19fb380e9b 00007f19fb3af4fc 00007f19fb3af9be 00007f19fcd46c1b 00007f19ff511391 00007f19ff4b7ba0 00007f19ff4b31a0 00007f19ff4c47c8
0928 01:55:37.236288 (+  1063us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:37.037724 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:37.038849 (+  1125us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:37.038897 (+    48us) write_op.cc:435] Acquired schema lock
0928 01:55:37.038935 (+    38us) tablet.cc:662] Decoding operations
0928 01:55:37.039566 (+   631us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:37.039654 (+    88us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:37.039701 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:37.040094 (+   393us) tablet.cc:701] Row locks acquired
0928 01:55:37.040124 (+    30us) write_op.cc:260] PREPARE: finished
0928 01:55:37.040354 (+   230us) write_op.cc:270] Start()
0928 01:55:37.040496 (+   142us) write_op.cc:276] Timestamp: P: 1790560537040265 usec, L: 0
0928 01:55:37.040531 (+    35us) op_driver.cc:348] REPLICATION: starting
0928 01:55:37.041363 (+   832us) log.cc:844] Serialized 625 byte log entry
0928 01:55:37.141735 (+100372us) op_driver.cc:464] REPLICATION: finished
0928 01:55:37.143762 (+  2027us) write_op.cc:301] APPLY: starting
0928 01:55:37.143816 (+    54us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:37.143927 (+   111us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:37.144011 (+    84us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:37.144415 (+   404us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:37.144610 (+   195us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:37.144654 (+    44us) write_op.cc:312] APPLY: finished
0928 01:55:37.144831 (+   177us) log.cc:844] Serialized 29 byte log entry
0928 01:55:37.144970 (+   139us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.145031 (+    61us) write_op.cc:454] Released schema lock
0928 01:55:37.145058 (+    27us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":727875200,"child_traces":[["op",{"apply.queue_time_us":1870,"apply.run_cpu_time_us":1579,"apply.run_wall_time_us":12462,"num_ops":2,"prepare.queue_time_us":6906,"prepare.run_cpu_time_us":4234,"prepare.run_wall_time_us":39532,"raft.queue_time_us":498,"raft.run_cpu_time_us":944,"raft.run_wall_time_us":943,"replication_time_us":101035,"threads_started":1}]]}
I20260928 01:55:37.262069 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f with delete_type TABLET_DATA_DELETED (replaced by tablet 6546cfe6f3a6405fab41a4ebdcffb288) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:37.264516 19442 tablet_service.cc:1558] Processing DeleteTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:35 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:37.270056 19767 raft_consensus.cc:2393] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:37.273317 19111 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 206) took 1771 ms. Trace:
W20260928 01:55:37.276629 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet c320eb2ca2ac4ac68293ef8f7400b45f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c320eb2ca2ac4ac68293ef8f7400b45f already in progress: creating tablet
W20260928 01:55:37.277935 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 89e1d60db21f4a8294792df3fadf5d90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89e1d60db21f4a8294792df3fadf5d90 already in progress: creating tablet
I20260928 01:55:37.279724 20397 leader_election.cc:290] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:37.304823 19896 tablet_bootstrap.cc:654] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:37.273705 19111 rpcz_store.cc:276] 0928 01:55:35.502386 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:35.513210 (+ 10824us) service_pool.cc:224] Handling call
0928 01:55:35.514468 (+  1258us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:35.514984 (+   516us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:55:35.515131 (+   147us) catalog_manager.cc:2863] Locking tablets
0928 01:55:37.023873 (+1508742us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:55:37.146098 (+122225us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:55:37.146295 (+   197us) catalog_manager.cc:2911] Committing in-memory state
0928 01:55:37.146391 (+    96us) catalog_manager.cc:2915] Aborting table tasks
0928 01:55:37.273009 (+126618us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b4c00002680. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fb3abfe0 00007f19fb3bcfc9 00007f19fb3bd6af 00007f19fb380e9b 00007f19fb3af4fc 00007f19fb3af9be 00007f19fcd46c1b 00007f19ff511391 00007f19ff4b7ba0 00007f19ff4b31a0 00007f19ff4a83d0
0928 01:55:37.273228 (+   219us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:37.031401 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:37.032177 (+   776us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:37.032239 (+    62us) write_op.cc:435] Acquired schema lock
0928 01:55:37.032271 (+    32us) tablet.cc:662] Decoding operations
0928 01:55:37.033012 (+   741us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:37.033080 (+    68us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:37.033124 (+    44us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:37.033683 (+   559us) tablet.cc:701] Row locks acquired
0928 01:55:37.033698 (+    15us) write_op.cc:260] PREPARE: finished
0928 01:55:37.033909 (+   211us) write_op.cc:270] Start()
0928 01:55:37.034049 (+   140us) write_op.cc:276] Timestamp: P: 1790560537033850 usec, L: 0
0928 01:55:37.034066 (+    17us) op_driver.cc:348] REPLICATION: starting
0928 01:55:37.034866 (+   800us) log.cc:844] Serialized 728 byte log entry
0928 01:55:37.134903 (+100037us) op_driver.cc:464] REPLICATION: finished
0928 01:55:37.135256 (+   353us) write_op.cc:301] APPLY: starting
0928 01:55:37.135330 (+    74us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:37.135521 (+   191us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:37.135648 (+   127us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:37.136100 (+   452us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:37.142416 (+  6316us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:37.142498 (+    82us) write_op.cc:312] APPLY: finished
0928 01:55:37.142803 (+   305us) log.cc:844] Serialized 29 byte log entry
0928 01:55:37.143033 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.143137 (+   104us) write_op.cc:454] Released schema lock
0928 01:55:37.143206 (+    69us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:37.143456 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.143484 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":202785664,"child_traces":[["op",{"apply.queue_time_us":131,"apply.run_cpu_time_us":2142,"apply.run_wall_time_us":8175,"num_ops":2,"prepare.queue_time_us":5351,"prepare.run_cpu_time_us":4025,"prepare.run_wall_time_us":6005,"raft.queue_time_us":561,"raft.run_cpu_time_us":1376,"raft.run_wall_time_us":3812,"replication_time_us":100669,"spinlock_wait_cycles":64896}]]}
I20260928 01:55:37.322432 19112 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:37.322696 19444 tablet_service.cc:1511] Processing CreateTablet for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (DEFAULT_TABLE table=default.Table_9ed6c2517322426b846b7a00c9d19b22 [id=55616d2998544e568042a46ef7f958e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.323907 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.339380 19409 leader_election.cc:304] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:37.340373 20470 raft_consensus.cc:2749] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:37.039961 20029 tablet_bootstrap.cc:654] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:37.288471 19766 raft_consensus.cc:2468] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
W20260928 01:55:37.328156 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 180108us
W20260928 01:55:37.330695 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 109639us
I20260928 01:55:37.331313 19738 tablet_service.cc:1558] Processing DeleteTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:35 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:37.332233 19745 tablet_service.cc:1558] Processing DeleteTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f with delete_type TABLET_DATA_DELETED (replaced by tablet 6546cfe6f3a6405fab41a4ebdcffb288) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:37.333197 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 49a73835e2854976b40b31fe752d1b1b (DEFAULT_TABLE table=default.Table_63f36a8d22184eac8a38565457441d09 [id=102958783e204ded94a67a96b0dec09b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.350021 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a73835e2854976b40b31fe752d1b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.334901 19743 tablet_service.cc:1511] Processing CreateTablet for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (DEFAULT_TABLE table=default.Table_9ed6c2517322426b846b7a00c9d19b22 [id=55616d2998544e568042a46ef7f958e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.354012 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.336508 19740 tablet_service.cc:1511] Processing CreateTablet for tablet bab12ba3e1f542949e3f203dae0fa80e (DEFAULT_TABLE table=default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.357968 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bab12ba3e1f542949e3f203dae0fa80e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.364434 19114 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 599ef1523fcf43d1a1e2a91f03abaa60
I20260928 01:55:37.367522 19114 catalog_manager.cc:6934] ReplaceTablet: tablet 599ef1523fcf43d1a1e2a91f03abaa60 deleted and replaced by tablet 502c0f4e07ff4479af8d33c99031b6fc
I20260928 01:55:37.370528 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 599ef1523fcf43d1a1e2a91f03abaa60 with delete_type TABLET_DATA_DELETED (replaced by tablet 502c0f4e07ff4479af8d33c99031b6fc) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:37.371367 20502 tablet_replica.cc:333] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:37.367918 19114 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51212 (request call id 202) took 2599 ms. Trace:
I20260928 01:55:37.373226 20502 raft_consensus.cc:2243] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:37.375589 20502 raft_consensus.cc:2272] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:37.403008 20502 ts_tablet_manager.cc:1916] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:37.468755 19896 tablet_bootstrap.cc:492] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:37.469777 19896 ts_tablet_manager.cc:1403] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.433s	user 0.016s	sys 0.003s
I20260928 01:55:37.472277 19450 tablet_service.cc:1511] Processing CreateTablet for tablet bab12ba3e1f542949e3f203dae0fa80e (DEFAULT_TABLE table=default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.400177 19117 catalog_manager.cc:5838] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } }
I20260928 01:55:37.482491 20029 tablet_bootstrap.cc:492] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:37.482972 20029 ts_tablet_manager.cc:1403] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.652s	user 0.010s	sys 0.002s
I20260928 01:55:37.484359 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bab12ba3e1f542949e3f203dae0fa80e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.491691 20029 raft_consensus.cc:359] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:37.492394 20029 raft_consensus.cc:385] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:37.492657 20029 raft_consensus.cc:740] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:37.493227 20029 consensus_queue.cc:260] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:37.509910 20029 ts_tablet_manager.cc:1434] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260928 01:55:37.510035 19117 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:37.512034 19117 catalog_manager.cc:5838] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:37.514034 19117 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]). Expected version 1 got 0
I20260928 01:55:37.517797 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:37.518584 19473 raft_consensus.cc:2393] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:37.521689 20029 tablet_bootstrap.cc:492] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:37.521770 19441 tablet_service.cc:1511] Processing CreateTablet for tablet ba89039dcfa848159112caa76802b5f1 (DEFAULT_TABLE table=default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.522900 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba89039dcfa848159112caa76802b5f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.526656 19896 raft_consensus.cc:359] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:37.527441 19896 raft_consensus.cc:385] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:37.527714 19896 raft_consensus.cc:740] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:37.528158 20029 tablet_bootstrap.cc:654] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:37.338502 19553 leader_election.cc:304] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:37.541230 19443 tablet_service.cc:1511] Processing CreateTablet for tablet c53d75604ee3405d83fe9ecaa824ea68 (DEFAULT_TABLE table=default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.542555 19443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53d75604ee3405d83fe9ecaa824ea68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.556725 19896 consensus_queue.cc:260] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:37.569621 19593 tablet_service.cc:1558] Processing DeleteTablet for tablet 599ef1523fcf43d1a1e2a91f03abaa60 with delete_type TABLET_DATA_DELETED (replaced by tablet 502c0f4e07ff4479af8d33c99031b6fc) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:37.571221 19598 tablet_service.cc:1511] Processing CreateTablet for tablet bab12ba3e1f542949e3f203dae0fa80e (DEFAULT_TABLE table=default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.572520 19598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bab12ba3e1f542949e3f203dae0fa80e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.577672 19590 tablet_service.cc:1511] Processing CreateTablet for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (DEFAULT_TABLE table=default.Table_9ed6c2517322426b846b7a00c9d19b22 [id=55616d2998544e568042a46ef7f958e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.578886 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.593714 19896 ts_tablet_manager.cc:1434] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.123s	user 0.007s	sys 0.002s
I20260928 01:55:37.620869 19896 tablet_bootstrap.cc:492] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:37.622119 20147 ts_tablet_manager.cc:1929] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 01:55:37.622632 20147 log.cc:1199] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/05f875e126f04415a108f778a76bb0f5
I20260928 01:55:37.623509 20147 ts_tablet_manager.cc:1950] T 05f875e126f04415a108f778a76bb0f5 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:37.632231 19600 tablet_service.cc:1511] Processing CreateTablet for tablet ba89039dcfa848159112caa76802b5f1 (DEFAULT_TABLE table=default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.632418 19591 tablet_service.cc:1511] Processing CreateTablet for tablet 49a73835e2854976b40b31fe752d1b1b (DEFAULT_TABLE table=default.Table_63f36a8d22184eac8a38565457441d09 [id=102958783e204ded94a67a96b0dec09b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.634647 20473 raft_consensus.cc:2804] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:37.635311 20416 raft_consensus.cc:493] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:37.636020 19593 tablet_service.cc:1511] Processing CreateTablet for tablet c53d75604ee3405d83fe9ecaa824ea68 (DEFAULT_TABLE table=default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:37.665051 19896 tablet_bootstrap.cc:654] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:37.675580 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba89039dcfa848159112caa76802b5f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.676514 20416 raft_consensus.cc:515] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:37.676743 20502 ts_tablet_manager.cc:1929] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:37.678747 20416 leader_election.cc:290] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:37.679962 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a73835e2854976b40b31fe752d1b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.679025 20502 log.cc:1199] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/599ef1523fcf43d1a1e2a91f03abaa60
I20260928 01:55:37.684255 20502 ts_tablet_manager.cc:1950] T 599ef1523fcf43d1a1e2a91f03abaa60 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:37.688417 19593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53d75604ee3405d83fe9ecaa824ea68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:37.695556 19896 tablet_bootstrap.cc:492] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:37.696064 19896 ts_tablet_manager.cc:1403] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.075s	user 0.005s	sys 0.007s
I20260928 01:55:37.696067 20473 raft_consensus.cc:697] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:37.696949 20473 consensus_queue.cc:237] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:37.698647 19896 raft_consensus.cc:359] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:37.699332 19896 raft_consensus.cc:385] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:37.699571 19896 raft_consensus.cc:740] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:37.709957 19896 consensus_queue.cc:260] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:37.728533 19896 ts_tablet_manager.cc:1434] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.004s
I20260928 01:55:37.729538 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 112) took 6350 ms. Trace:
I20260928 01:55:37.730011 20147 rpcz_store.cc:276] 0928 01:55:31.378678 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.602368 (+223690us) service_pool.cc:224] Handling call
0928 01:55:37.192670 (+5590302us) ts_tablet_manager.cc:1151] Deleting tablet 05f875e126f04415a108f778a76bb0f5
0928 01:55:37.192745 (+    75us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:37.225741 (+ 32996us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:37.614708 (+388967us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:37.729459 (+114751us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5478089}
I20260928 01:55:37.745915 19896 tablet_bootstrap.cc:492] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:37.756446 19117 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:37.685966 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 599ef1523fcf43d1a1e2a91f03abaa60 (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]) successfully deleted
W20260928 01:55:37.757196 19104 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 71257.1us
I20260928 01:55:37.381835 19114 rpcz_store.cc:276] 0928 01:55:34.768928 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:35.221979 (+453051us) service_pool.cc:224] Handling call
0928 01:55:35.477381 (+255402us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5ca0e1 00007f19fd192d37 00007f19fd192cc2 00007f19fd192bf1 00007f19fd192b6c 00007f19fd191e22 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:37.367859 (+1890478us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:37.227465 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:37.228297 (+   832us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:37.228348 (+    51us) write_op.cc:435] Acquired schema lock
0928 01:55:37.228380 (+    32us) tablet.cc:662] Decoding operations
0928 01:55:37.228930 (+   550us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:37.229012 (+    82us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:37.229056 (+    44us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:37.229448 (+   392us) tablet.cc:701] Row locks acquired
0928 01:55:37.229479 (+    31us) write_op.cc:260] PREPARE: finished
0928 01:55:37.229671 (+   192us) write_op.cc:270] Start()
0928 01:55:37.229813 (+   142us) write_op.cc:276] Timestamp: P: 1790560537229598 usec, L: 0
0928 01:55:37.229847 (+    34us) op_driver.cc:348] REPLICATION: starting
0928 01:55:37.320790 (+ 90943us) log.cc:844] Serialized 625 byte log entry
0928 01:55:37.321749 (+   959us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b6aa1 00007f19fd7495e8 00007f19fdbd9791 00007f19fdbd8f68 00007f19fdbddc01 00007f19fdbddbb9 00007f19fdbddb49 00007f19fdbddb11 00007f19fdbdcd3d 00000000005bd4e4 00000000005bd319
0928 01:55:37.349157 (+ 27408us) op_driver.cc:464] REPLICATION: finished
0928 01:55:37.357075 (+  7918us) write_op.cc:301] APPLY: starting
0928 01:55:37.357218 (+   143us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:37.357573 (+   355us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:37.357593 (+    20us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:37.358088 (+   495us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:37.358304 (+   216us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:37.358347 (+    43us) write_op.cc:312] APPLY: finished
0928 01:55:37.358538 (+   191us) log.cc:844] Serialized 29 byte log entry
0928 01:55:37.358699 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.358766 (+    67us) write_op.cc:454] Released schema lock
0928 01:55:37.358797 (+    31us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:37.359053 (+   256us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.359077 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4564,"spinlock_wait_cycles":582296832,"child_traces":[["op",{"apply.queue_time_us":7247,"apply.run_cpu_time_us":1959,"apply.run_wall_time_us":1968,"num_ops":2,"prepare.queue_time_us":170694,"prepare.run_cpu_time_us":5062,"prepare.run_wall_time_us":109339,"raft.queue_time_us":11119,"raft.run_cpu_time_us":856,"raft.run_wall_time_us":1788,"replication_time_us":119215,"spinlock_wait_cycles":207164288}]]}
I20260928 01:55:37.760385 20029 tablet_bootstrap.cc:492] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:37.760828 20029 ts_tablet_manager.cc:1403] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.239s	user 0.006s	sys 0.004s
I20260928 01:55:37.761148 19114 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_9aeb2b485111496ea1fed85fd4c55531" } modify_external_catalogs: true
I20260928 01:55:37.761803 19114 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_9aeb2b485111496ea1fed85fd4c55531" } modify_external_catalogs: true
I20260928 01:55:37.764619 20029 raft_consensus.cc:359] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:37.765251 20029 raft_consensus.cc:385] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:37.765504 20029 raft_consensus.cc:740] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:37.766119 20029 consensus_queue.cc:260] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:37.773837 20147 tablet_replica.cc:333] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:37.774746 20147 raft_consensus.cc:2243] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:37.775738 20029 ts_tablet_manager.cc:1434] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260928 01:55:37.780809 20029 tablet_bootstrap.cc:492] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:37.784142 19896 tablet_bootstrap.cc:654] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:37.797892 20029 tablet_bootstrap.cc:654] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:37.802497 19896 tablet_bootstrap.cc:492] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:37.802947 19896 ts_tablet_manager.cc:1403] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.000s
I20260928 01:55:37.812489 19896 raft_consensus.cc:359] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:37.813127 19896 raft_consensus.cc:385] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:37.813374 19896 raft_consensus.cc:740] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:37.814010 19896 consensus_queue.cc:260] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:37.817788 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 05f875e126f04415a108f778a76bb0f5 (table default.Table_2c6a423a3158495a98d244242381a423 [id=10dc4468b0ce4b2c87cecd4c66cc5300]) successfully deleted
W20260928 01:55:37.811205 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 472787us
I20260928 01:55:37.839830 19114 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet c1f73a301c84482f897990ac5e5dd162
I20260928 01:55:37.847260 19896 ts_tablet_manager.cc:1434] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260928 01:55:37.851557 20029 tablet_bootstrap.cc:492] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:37.851991 20029 ts_tablet_manager.cc:1403] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.002s
I20260928 01:55:37.854334 19115 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]). Expected version 1 got 0
I20260928 01:55:37.855707 19115 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:37.857160 19115 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:37.857887 19115 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:37.867836 19109 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:37.870076 20029 raft_consensus.cc:359] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:37.870754 20029 raft_consensus.cc:385] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:37.870790 19109 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:37.871012 20029 raft_consensus.cc:740] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:37.871619 19109 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]). Expected version 1 got 0
I20260928 01:55:37.872818 19896 tablet_bootstrap.cc:492] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:37.875978 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet c1f73a301c84482f897990ac5e5dd162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:37 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:37.820226 19890 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.002s	sys 0.005s
W20260928 01:55:37.877179 19890 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.002s	sys 0.005s
W20260928 01:55:37.878682 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet c1f73a301c84482f897990ac5e5dd162 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1f73a301c84482f897990ac5e5dd162 already in progress: creating tablet
W20260928 01:55:37.728140 19592 consensus_meta.cc:287] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.004s
I20260928 01:55:37.897816 19890 tablet_bootstrap.cc:492] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
W20260928 01:55:37.899173 19556 leader_election.cc:343] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 599ef1523fcf43d1a1e2a91f03abaa60
I20260928 01:55:37.901672 19890 ts_tablet_manager.cc:1403] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 1.025s	user 0.013s	sys 0.006s
I20260928 01:55:37.910741 19114 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 207) took 2408 ms. Trace:
I20260928 01:55:37.911158 19114 rpcz_store.cc:276] 0928 01:55:35.502657 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:37.760703 (+2258046us) service_pool.cc:224] Handling call
0928 01:55:37.762343 (+  1640us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:37.762906 (+   563us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:55:37.763051 (+   145us) catalog_manager.cc:2863] Locking tablets
0928 01:55:37.763597 (+   546us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:55:37.839284 (+ 75687us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:55:37.839613 (+   329us) catalog_manager.cc:2911] Committing in-memory state
0928 01:55:37.839723 (+   110us) catalog_manager.cc:2915] Aborting table tasks
0928 01:55:37.910648 (+ 70925us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:37.765972 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:37.766461 (+   489us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:37.766517 (+    56us) write_op.cc:435] Acquired schema lock
0928 01:55:37.766531 (+    14us) tablet.cc:662] Decoding operations
0928 01:55:37.766933 (+   402us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:37.766981 (+    48us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:37.767015 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:37.767356 (+   341us) tablet.cc:701] Row locks acquired
0928 01:55:37.767370 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:37.767511 (+   141us) write_op.cc:270] Start()
0928 01:55:37.767614 (+   103us) write_op.cc:276] Timestamp: P: 1790560537767361 usec, L: 0
0928 01:55:37.767634 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:55:37.768232 (+   598us) log.cc:844] Serialized 728 byte log entry
0928 01:55:37.777940 (+  9708us) op_driver.cc:464] REPLICATION: finished
0928 01:55:37.778516 (+   576us) write_op.cc:301] APPLY: starting
0928 01:55:37.778586 (+    70us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:37.778715 (+   129us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:37.778829 (+   114us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:37.779115 (+   286us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:37.779260 (+   145us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:37.779303 (+    43us) write_op.cc:312] APPLY: finished
0928 01:55:37.779516 (+   213us) log.cc:844] Serialized 29 byte log entry
0928 01:55:37.779673 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.779745 (+    72us) write_op.cc:454] Released schema lock
0928 01:55:37.779776 (+    31us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:37.780011 (+   235us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.780038 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":404,"apply.run_cpu_time_us":1478,"apply.run_wall_time_us":1477,"num_ops":2,"prepare.queue_time_us":170,"prepare.run_cpu_time_us":2668,"prepare.run_wall_time_us":2668,"raft.queue_time_us":605,"raft.run_cpu_time_us":894,"raft.run_wall_time_us":893,"replication_time_us":10206}]]}
I20260928 01:55:37.915441 20147 raft_consensus.cc:2272] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:37.919931 19597 tablet_service.cc:1558] Processing DeleteTablet for tablet c1f73a301c84482f897990ac5e5dd162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:37 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:37.923494 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_1c064907f1024f8e96ecbc0422212255"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:37.925135 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c064907f1024f8e96ecbc0422212255 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:37.871630 20029 consensus_queue.cc:260] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:37.975984 20498 raft_consensus.cc:493] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:37.978262 20029 ts_tablet_manager.cc:1434] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.126s	user 0.005s	sys 0.003s
I20260928 01:55:37.982342 19114 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 208) took 2273 ms. Trace:
W20260928 01:55:37.924338 19555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:37.993587 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:37.994501 19619 raft_consensus.cc:2393] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:37.996601 19553 leader_election.cc:304] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:38.004513 19896 tablet_bootstrap.cc:654] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:38.025942 19890 raft_consensus.cc:359] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.028645 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a753f894ae94b1eaf9b445df3545ded" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:38.030946 19409 leader_election.cc:304] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:38.032058 20470 raft_consensus.cc:2804] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:37.977366 20498 raft_consensus.cc:515] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:38.033591 19896 tablet_bootstrap.cc:492] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:38.034071 19896 ts_tablet_manager.cc:1403] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.161s	user 0.002s	sys 0.008s
I20260928 01:55:38.035163 20475 raft_consensus.cc:493] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:37.982779 19114 rpcz_store.cc:276] 0928 01:55:35.709248 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:37.922922 (+2213674us) service_pool.cc:224] Handling call
0928 01:55:37.925624 (+  2702us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:37.927232 (+  1608us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:37.981436 (+ 54204us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.981475 (+    39us) write_op.cc:454] Released schema lock
0928 01:55:37.981723 (+   248us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:55:37.982004 (+   281us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:55:37.982268 (+   264us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:37.928829 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:37.929327 (+   498us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:37.929357 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:55:37.929374 (+    17us) tablet.cc:662] Decoding operations
0928 01:55:37.929774 (+   400us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:37.929829 (+    55us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:37.929860 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:37.930131 (+   271us) tablet.cc:701] Row locks acquired
0928 01:55:37.930152 (+    21us) write_op.cc:260] PREPARE: finished
0928 01:55:37.930301 (+   149us) write_op.cc:270] Start()
0928 01:55:37.930401 (+   100us) write_op.cc:276] Timestamp: P: 1790560537930149 usec, L: 0
0928 01:55:37.930416 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:37.931050 (+   634us) log.cc:844] Serialized 433 byte log entry
0928 01:55:37.941995 (+ 10945us) op_driver.cc:464] REPLICATION: finished
0928 01:55:37.942497 (+   502us) write_op.cc:301] APPLY: starting
0928 01:55:37.942561 (+    64us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:37.942679 (+   118us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:37.942776 (+    97us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:37.943222 (+   446us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:37.943368 (+   146us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:55:37.943414 (+    46us) write_op.cc:312] APPLY: finished
0928 01:55:37.943624 (+   210us) log.cc:844] Serialized 29 byte log entry
0928 01:55:37.943781 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.943861 (+    80us) write_op.cc:454] Released schema lock
0928 01:55:37.943896 (+    35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":330,"apply.run_cpu_time_us":1593,"apply.run_wall_time_us":1593,"num_ops":2,"prepare.queue_time_us":147,"prepare.run_cpu_time_us":2592,"prepare.run_wall_time_us":2596,"raft.queue_time_us":2899,"raft.run_cpu_time_us":829,"raft.run_wall_time_us":830,"replication_time_us":11470}]]}
I20260928 01:55:38.041617 19443 tablet_service.cc:1511] Processing CreateTablet for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (DEFAULT_TABLE table=default.Table_001856018a3743328c46c694f06bb065 [id=804b1e68ce9949f0b7fe1e527311afee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.042785 19443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.043074 20029 tablet_bootstrap.cc:492] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:38.041868 20475 raft_consensus.cc:515] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:38.046811 20475 leader_election.cc:290] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:38.048357 19890 raft_consensus.cc:385] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:38.048668 19890 raft_consensus.cc:740] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:38.049234 19890 consensus_queue.cc:260] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:38.033203 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 89e1d60db21f4a8294792df3fadf5d90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89e1d60db21f4a8294792df3fadf5d90 already in progress: creating tablet
W20260928 01:55:38.050357 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet c320eb2ca2ac4ac68293ef8f7400b45f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c320eb2ca2ac4ac68293ef8f7400b45f already in progress: creating tablet
I20260928 01:55:38.051152 19890 ts_tablet_manager.cc:1434] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.149s	user 0.003s	sys 0.001s
I20260928 01:55:38.052050 19890 tablet_bootstrap.cc:492] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:38.053068 19441 tablet_service.cc:1511] Processing CreateTablet for tablet fcf1b727e86a43b08bd464647fa529a3 (DEFAULT_TABLE table=default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.054293 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf1b727e86a43b08bd464647fa529a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.054708 20498 leader_election.cc:290] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:38.049721 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_8973fdce291e4b6eaef470916578c577"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:38.066763 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8973fdce291e4b6eaef470916578c577 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:38.044451 20511 raft_consensus.cc:2749] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:38.077423 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599ef1523fcf43d1a1e2a91f03abaa60" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:38.080854 19896 raft_consensus.cc:359] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.081593 19896 raft_consensus.cc:385] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:38.081841 19896 raft_consensus.cc:740] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:38.082759 20029 tablet_bootstrap.cc:654] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:38.082659 19896 consensus_queue.cc:260] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:38.087617 19739 consensus_meta.cc:287] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da: Time spent flushing consensus metadata: real 0.534s	user 0.003s	sys 0.007s
I20260928 01:55:38.091017 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 65d70a8be7244c86864187420a4fd5f5 (DEFAULT_TABLE table=default.Table_a7be235b87c5430196c28409590e15e8 [id=0bc4ca4de24f45e4843eb09cce780435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.092278 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d70a8be7244c86864187420a4fd5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.043869 20147 ts_tablet_manager.cc:1916] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:55:38.103231 19409 leader_election.cc:343] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:38.103634 19409 leader_election.cc:304] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:38.024173 19111 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:38.116155 19111 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:38.094781 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet 599ef1523fcf43d1a1e2a91f03abaa60 with delete_type TABLET_DATA_DELETED (replaced by tablet 502c0f4e07ff4479af8d33c99031b6fc) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:38.096771 19734 tablet_service.cc:1511] Processing CreateTablet for tablet c53d75604ee3405d83fe9ecaa824ea68 (DEFAULT_TABLE table=default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.116952 19111 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]). Expected version 1 got 0
I20260928 01:55:38.117988 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53d75604ee3405d83fe9ecaa824ea68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.118083 19116 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: default.Table_2171ab69dd564f6897eb22381bb0a5b6 [id=328e52a4270e476faf1b10d89af3a56c] alter complete (version 1)
W20260928 01:55:38.119901 19116 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 19) took 4196 ms (client timeout 1000 ms). Trace:
I20260928 01:55:38.098686 19742 tablet_service.cc:1511] Processing CreateTablet for tablet ba89039dcfa848159112caa76802b5f1 (DEFAULT_TABLE table=default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.120985 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba89039dcfa848159112caa76802b5f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:38.120247 19116 rpcz_store.cc:269] 0928 01:55:33.923711 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.923864 (+   153us) service_pool.cc:224] Handling call
0928 01:55:38.119814 (+4195950us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:34.529870 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:34.530247 (+   377us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:34.530271 (+    24us) write_op.cc:435] Acquired schema lock
0928 01:55:34.530283 (+    12us) tablet.cc:662] Decoding operations
0928 01:55:34.530537 (+   254us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:34.530571 (+    34us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:34.530592 (+    21us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:34.530720 (+   128us) tablet.cc:701] Row locks acquired
0928 01:55:34.530732 (+    12us) write_op.cc:260] PREPARE: finished
0928 01:55:34.530833 (+   101us) write_op.cc:270] Start()
0928 01:55:34.531095 (+   262us) write_op.cc:276] Timestamp: P: 1790560534530753 usec, L: 0
0928 01:55:34.531143 (+    48us) op_driver.cc:348] REPLICATION: starting
0928 01:55:34.532006 (+   863us) log.cc:844] Serialized 356 byte log entry
0928 01:55:35.234707 (+702701us) op_driver.cc:464] REPLICATION: finished
0928 01:55:35.246733 (+ 12026us) write_op.cc:301] APPLY: starting
0928 01:55:35.246837 (+   104us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:35.248038 (+  1201us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:35.248172 (+   134us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:35.248459 (+   287us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:35.248680 (+   221us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:35.248750 (+    70us) write_op.cc:312] APPLY: finished
0928 01:55:35.249004 (+   254us) log.cc:844] Serialized 23 byte log entry
0928 01:55:35.249711 (+   707us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:35.249798 (+    87us) write_op.cc:454] Released schema lock
0928 01:55:35.249843 (+    45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":11678,"apply.run_cpu_time_us":1875,"apply.run_wall_time_us":3511,"num_ops":1,"prepare.queue_time_us":64984,"prepare.run_cpu_time_us":1953,"prepare.run_wall_time_us":2447,"replication_time_us":703443}]]}
I20260928 01:55:38.099917 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet c1f73a301c84482f897990ac5e5dd162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:37 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:38.101575 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (DEFAULT_TABLE table=default.Table_001856018a3743328c46c694f06bb065 [id=804b1e68ce9949f0b7fe1e527311afee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.125255 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.127043 19444 tablet_service.cc:1558] Processing DeleteTablet for tablet ce41f63df46f4d0493ca22a13daadb4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:38.127753 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a3540d1441404092db723b7e5cb61a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:26 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:38.122287 19118 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 34) took 3743 ms (client timeout 1000 ms). Trace:
W20260928 01:55:38.128111 19118 rpcz_store.cc:269] 0928 01:55:34.379010 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:34.467195 (+ 88185us) service_pool.cc:224] Handling call
0928 01:55:38.122214 (+3655019us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":6}
I20260928 01:55:38.128509 19112 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: default.Table_25f5d9bf8f154b87b16032e2ce9ec169 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9] alter complete (version 4)
W20260928 01:55:38.129395 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet ce41f63df46f4d0493ca22a13daadb4f because the tablet was not found. No further retry: Not found: Tablet not found: ce41f63df46f4d0493ca22a13daadb4f
I20260928 01:55:38.129896 20542 raft_consensus.cc:2749] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:38.130573 20542 raft_consensus.cc:493] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:38.131130 20542 raft_consensus.cc:515] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.103242 19745 tablet_service.cc:1511] Processing CreateTablet for tablet fcf1b727e86a43b08bd464647fa529a3 (DEFAULT_TABLE table=default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:38.132068 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 63a3540d1441404092db723b7e5cb61a because the tablet was not found. No further retry: Not found: Tablet not found: 63a3540d1441404092db723b7e5cb61a
I20260928 01:55:38.132987 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf1b727e86a43b08bd464647fa529a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.133191 20542 leader_election.cc:290] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:38.134946 19896 ts_tablet_manager.cc:1434] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.001s
I20260928 01:55:38.130478 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_03092b9603354c0db5923e1d87791230"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:38.137432 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03092b9603354c0db5923e1d87791230 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:38.104471 19746 tablet_service.cc:1511] Processing CreateTablet for tablet 65d70a8be7244c86864187420a4fd5f5 (DEFAULT_TABLE table=default.Table_a7be235b87c5430196c28409590e15e8 [id=0bc4ca4de24f45e4843eb09cce780435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.138768 19896 tablet_bootstrap.cc:492] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:38.139503 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d70a8be7244c86864187420a4fd5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.142155 19113 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4] alter complete (version 1)
I20260928 01:55:38.066212 19590 tablet_service.cc:1511] Processing CreateTablet for tablet fcf1b727e86a43b08bd464647fa529a3 (DEFAULT_TABLE table=default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.150960 19445 tablet_service.cc:1511] Processing CreateTablet for tablet 29f65b0966c04012bfec3c67a37acc25 (DEFAULT_TABLE table=default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.151403 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf1b727e86a43b08bd464647fa529a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.152154 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f65b0966c04012bfec3c67a37acc25. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:38.155503 19110 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 20) took 3114 ms (client timeout 1000 ms). Trace:
I20260928 01:55:38.165683 19444 tablet_service.cc:1558] Processing DeleteTablet for tablet ce41f63df46f4d0493ca22a13daadb4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:38.167729 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet ce41f63df46f4d0493ca22a13daadb4f because the tablet was not found. No further retry: Not found: Tablet not found: ce41f63df46f4d0493ca22a13daadb4f
I20260928 01:55:38.168365 20470 raft_consensus.cc:697] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:38.169735 19444 tablet_service.cc:1558] Processing DeleteTablet for tablet eaa1e9b7119d46a2ba2652a893877c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:30 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:38.171504 19442 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bfcdfe218414396824a8f3af4d673ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:38.178694 20502 tablet_replica.cc:333] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
W20260928 01:55:38.179296 19115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 36) took 1186 ms (client timeout 1000 ms). Trace:
I20260928 01:55:38.179740 20502 raft_consensus.cc:2243] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:38.180684 20502 raft_consensus.cc:2272] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:38.180857 19450 tablet_service.cc:1558] Processing DeleteTablet for tablet 90d40050f85a4d6c90a4ce35cf15d134 with delete_type TABLET_DATA_DELETED (replaced by tablet d0cb771766b44b149d3ed3ddf75a7474) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:38.181504 19113 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 30) took 4166 ms (client timeout 1000 ms). Trace:
I20260928 01:55:38.183921 20502 ts_tablet_manager.cc:1916] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:55:38.188287 19117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 21) took 2194 ms (client timeout 1000 ms). Trace:
I20260928 01:55:38.189030 19442 tablet_service.cc:1558] Processing DeleteTablet for tablet 599ef1523fcf43d1a1e2a91f03abaa60 with delete_type TABLET_DATA_DELETED (replaced by tablet 502c0f4e07ff4479af8d33c99031b6fc) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:38.191128 19442 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6cfc9ff3344a48b09730dfde79d6cf (DEFAULT_TABLE table=default.Table_919e392236f9437fb1c2f9fee1f94f84 [id=e8373f635df4445ca4acdbab7cdeb448]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.192444 19442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cfc9ff3344a48b09730dfde79d6cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.098466 19618 raft_consensus.cc:3060] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:38.197561 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 502c0f4e07ff4479af8d33c99031b6fc (DEFAULT_TABLE table=default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.200778 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502c0f4e07ff4479af8d33c99031b6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.205940 19703 leader_election.cc:304] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:38.206792 20475 raft_consensus.cc:2749] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 01:55:38.211966 19117 rpcz_store.cc:269] 0928 01:55:35.993928 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:36.538069 (+544141us) service_pool.cc:224] Handling call
0928 01:55:38.188178 (+1650109us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:37.822808 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:37.823253 (+   445us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:37.823280 (+    27us) write_op.cc:435] Acquired schema lock
0928 01:55:37.823295 (+    15us) tablet.cc:662] Decoding operations
0928 01:55:37.823636 (+   341us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:37.823682 (+    46us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:37.823709 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:37.824001 (+   292us) tablet.cc:701] Row locks acquired
0928 01:55:37.824018 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:55:37.824144 (+   126us) write_op.cc:270] Start()
0928 01:55:37.824269 (+   125us) write_op.cc:276] Timestamp: P: 1790560537824005 usec, L: 0
0928 01:55:37.824287 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:55:37.824850 (+   563us) log.cc:844] Serialized 907 byte log entry
0928 01:55:37.834131 (+  9281us) op_driver.cc:464] REPLICATION: finished
0928 01:55:37.834577 (+   446us) write_op.cc:301] APPLY: starting
0928 01:55:37.834632 (+    55us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:37.834739 (+   107us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:37.834830 (+    91us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:37.835153 (+   323us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:37.835285 (+   132us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:37.835324 (+    39us) write_op.cc:312] APPLY: finished
0928 01:55:37.835519 (+   195us) log.cc:844] Serialized 29 byte log entry
0928 01:55:37.835670 (+   151us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.835738 (+    68us) write_op.cc:454] Released schema lock
0928 01:55:37.835769 (+    31us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:37.835989 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.836011 (+    22us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2192,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":295,"apply.run_cpu_time_us":1382,"apply.run_wall_time_us":1382,"num_ops":2,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":2407,"prepare.run_wall_time_us":2407,"raft.queue_time_us":518,"raft.run_cpu_time_us":721,"raft.run_wall_time_us":720,"replication_time_us":9737}]]}
I20260928 01:55:38.222096 20470 consensus_queue.cc:237] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.236394 19117 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_07316c39d6b94592bfd855c58d6259ef" } new_table_name: "default.Table_166fa0660a6a4034b6d1aae617f868e0" modify_external_catalogs: true
I20260928 01:55:38.240659 19114 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 209) took 2531 ms. Trace:
I20260928 01:55:38.240680 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 29f65b0966c04012bfec3c67a37acc25 (DEFAULT_TABLE table=default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.241825 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f65b0966c04012bfec3c67a37acc25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.241070 19114 rpcz_store.cc:276] 0928 01:55:35.709540 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.049335 (+2339795us) service_pool.cc:224] Handling call
0928 01:55:38.105045 (+ 55710us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:38.106492 (+  1447us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:38.161873 (+ 55381us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:55:38.240335 (+ 78462us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:55:38.240597 (+   262us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:38.107716 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:38.108172 (+   456us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:38.108230 (+    58us) write_op.cc:435] Acquired schema lock
0928 01:55:38.108244 (+    14us) tablet.cc:662] Decoding operations
0928 01:55:38.108551 (+   307us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:38.108591 (+    40us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:38.108617 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:38.108850 (+   233us) tablet.cc:701] Row locks acquired
0928 01:55:38.108880 (+    30us) write_op.cc:260] PREPARE: finished
0928 01:55:38.109021 (+   141us) write_op.cc:270] Start()
0928 01:55:38.109114 (+    93us) write_op.cc:276] Timestamp: P: 1790560538108971 usec, L: 0
0928 01:55:38.109131 (+    17us) op_driver.cc:348] REPLICATION: starting
0928 01:55:38.109687 (+   556us) log.cc:844] Serialized 433 byte log entry
0928 01:55:38.140854 (+ 31167us) op_driver.cc:464] REPLICATION: finished
0928 01:55:38.141241 (+   387us) write_op.cc:301] APPLY: starting
0928 01:55:38.141309 (+    68us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:38.141441 (+   132us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:38.141539 (+    98us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:38.142001 (+   462us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:38.142132 (+   131us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:55:38.142171 (+    39us) write_op.cc:312] APPLY: finished
0928 01:55:38.142359 (+   188us) log.cc:844] Serialized 29 byte log entry
0928 01:55:38.142500 (+   141us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:38.142569 (+    69us) write_op.cc:454] Released schema lock
0928 01:55:38.142602 (+    33us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:38.142822 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:38.142846 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":215,"apply.run_cpu_time_us":1545,"apply.run_wall_time_us":1545,"num_ops":2,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":2270,"prepare.run_wall_time_us":2279,"raft.queue_time_us":1274,"raft.run_cpu_time_us":742,"raft.run_wall_time_us":742,"replication_time_us":31599}]]}
I20260928 01:55:38.244925 19114 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_9ed6c2517322426b846b7a00c9d19b22" } new_table_name: "default.Table_dba14cbe11f54bef81b2bb5b2b9e2068" modify_external_catalogs: true
W20260928 01:55:38.205358 19112 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 35) took 2914 ms (client timeout 1000 ms). Trace:
W20260928 01:55:38.181846 19113 rpcz_store.cc:269] 0928 01:55:34.015550 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:34.015753 (+   203us) service_pool.cc:224] Handling call
0928 01:55:38.181368 (+4165615us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:34.517840 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:34.518393 (+   553us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:34.518440 (+    47us) write_op.cc:435] Acquired schema lock
0928 01:55:34.518479 (+    39us) tablet.cc:662] Decoding operations
0928 01:55:34.518907 (+   428us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:34.518992 (+    85us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:34.519023 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:34.519398 (+   375us) tablet.cc:701] Row locks acquired
0928 01:55:34.519431 (+    33us) write_op.cc:260] PREPARE: finished
0928 01:55:34.519621 (+   190us) write_op.cc:270] Start()
0928 01:55:34.519794 (+   173us) write_op.cc:276] Timestamp: P: 1790560534519507 usec, L: 0
0928 01:55:34.519836 (+    42us) op_driver.cc:348] REPLICATION: starting
0928 01:55:34.522012 (+  2176us) log.cc:844] Serialized 356 byte log entry
0928 01:55:35.174006 (+651994us) op_driver.cc:464] REPLICATION: finished
0928 01:55:35.176388 (+  2382us) write_op.cc:301] APPLY: starting
0928 01:55:35.176481 (+    93us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:35.176638 (+   157us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:35.176788 (+   150us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:35.177135 (+   347us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:35.177340 (+   205us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:35.177416 (+    76us) write_op.cc:312] APPLY: finished
0928 01:55:35.177774 (+   358us) log.cc:844] Serialized 23 byte log entry
0928 01:55:35.178020 (+   246us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:35.178108 (+    88us) write_op.cc:454] Released schema lock
0928 01:55:35.178156 (+    48us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:35.178510 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:35.178548 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":2158,"apply.run_cpu_time_us":2027,"apply.run_wall_time_us":2027,"num_ops":1,"prepare.queue_time_us":82797,"prepare.run_cpu_time_us":3091,"prepare.run_wall_time_us":4660,"replication_time_us":654021}]]}
W20260928 01:55:38.189540 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet eaa1e9b7119d46a2ba2652a893877c8c because the tablet was not found. No further retry: Not found: Tablet not found: eaa1e9b7119d46a2ba2652a893877c8c
W20260928 01:55:38.257335 19104 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 67817.2us
W20260928 01:55:38.220813 19109 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 31) took 2027 ms (client timeout 1000 ms). Trace:
W20260928 01:55:38.259775 19109 rpcz_store.cc:269] 0928 01:55:36.193774 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:36.678842 (+485068us) service_pool.cc:224] Handling call
0928 01:55:38.220729 (+1541887us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24,"reported_tablets":17}
I20260928 01:55:38.260371 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_45790ef1ddd242aeac56787eb4a556e1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:38.155889 19110 rpcz_store.cc:269] 0928 01:55:35.040634 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:35.073231 (+ 32597us) service_pool.cc:224] Handling call
0928 01:55:38.155416 (+3082185us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:37.077494 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:37.078482 (+   988us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:37.078536 (+    54us) write_op.cc:435] Acquired schema lock
0928 01:55:37.078569 (+    33us) tablet.cc:662] Decoding operations
0928 01:55:37.079047 (+   478us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:37.079120 (+    73us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:37.079165 (+    45us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:37.079443 (+   278us) tablet.cc:701] Row locks acquired
0928 01:55:37.079458 (+    15us) write_op.cc:260] PREPARE: finished
0928 01:55:37.079688 (+   230us) write_op.cc:270] Start()
0928 01:55:37.079837 (+   149us) write_op.cc:276] Timestamp: P: 1790560537079606 usec, L: 0
0928 01:55:37.079854 (+    17us) op_driver.cc:348] REPLICATION: starting
0928 01:55:37.131683 (+ 51829us) log.cc:844] Serialized 530 byte log entry
0928 01:55:37.305384 (+173701us) op_driver.cc:464] REPLICATION: finished
0928 01:55:37.310318 (+  4934us) write_op.cc:301] APPLY: starting
0928 01:55:37.310390 (+    72us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:37.310496 (+   106us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:37.310619 (+   123us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:37.310843 (+   224us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:37.311114 (+   271us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:37.311178 (+    64us) write_op.cc:312] APPLY: finished
0928 01:55:37.311438 (+   260us) log.cc:844] Serialized 23 byte log entry
0928 01:55:37.312108 (+   670us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.312177 (+    69us) write_op.cc:454] Released schema lock
0928 01:55:37.312236 (+    59us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:37.312500 (+   264us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.312530 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1217,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":4714,"apply.run_cpu_time_us":1614,"apply.run_wall_time_us":2183,"num_ops":1,"prepare.queue_time_us":44893,"prepare.run_cpu_time_us":4075,"prepare.run_wall_time_us":149729,"raft.queue_time_us":482,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":302,"replication_time_us":225406}]]}
I20260928 01:55:38.264169 19110 master_service.cc:960] ReplaceTablet: received request to replace tablet c320eb2ca2ac4ac68293ef8f7400b45f from {username='slave'} at 127.0.0.1:51212
W20260928 01:55:38.179657 19115 rpcz_store.cc:269] 0928 01:55:36.993179 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:37.263601 (+270422us) service_pool.cc:224] Handling call
0928 01:55:37.306415 (+ 42814us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:38.179212 (+872797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19450,"reported_tablets":17,"spinlock_wait_cycles":77227264}
I20260928 01:55:38.268151 19115 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_4a2d24baaa4742b0aa00abd564613b46" } modify_external_catalogs: true
W20260928 01:55:38.265512 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45790ef1ddd242aeac56787eb4a556e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:38.270766 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 75309.9us
I20260928 01:55:38.274039 19553 leader_election.cc:304] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:38.277284 19109 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_fa2cc70b96124fedb7f77c2fd58c9d89" } modify_external_catalogs: true
W20260928 01:55:38.278362 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 175170us
I20260928 01:55:38.097209 19890 tablet_bootstrap.cc:654] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:38.251528 19112 rpcz_store.cc:269] 0928 01:55:35.290700 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:35.382717 (+ 92017us) service_pool.cc:224] Handling call
0928 01:55:35.478791 (+ 96074us) spinlock_profiling.cc:243] Waited 92.2 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:38.205276 (+2726485us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:37.336948 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:37.337423 (+   475us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:37.337451 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:55:37.337467 (+    16us) tablet.cc:662] Decoding operations
0928 01:55:37.337773 (+   306us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:37.337812 (+    39us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:37.337838 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:37.338028 (+   190us) tablet.cc:701] Row locks acquired
0928 01:55:37.338047 (+    19us) write_op.cc:260] PREPARE: finished
0928 01:55:37.338185 (+   138us) write_op.cc:270] Start()
0928 01:55:37.338275 (+    90us) write_op.cc:276] Timestamp: P: 1790560537338117 usec, L: 0
0928 01:55:37.338294 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:55:37.338857 (+   563us) log.cc:844] Serialized 356 byte log entry
0928 01:55:37.395133 (+ 56276us) op_driver.cc:464] REPLICATION: finished
0928 01:55:37.397584 (+  2451us) write_op.cc:301] APPLY: starting
0928 01:55:37.397770 (+   186us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:37.397900 (+   130us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:37.398219 (+   319us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:37.414281 (+ 16062us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:37.414434 (+   153us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:37.414481 (+    47us) write_op.cc:312] APPLY: finished
0928 01:55:37.415031 (+   550us) log.cc:844] Serialized 23 byte log entry
0928 01:55:37.415608 (+   577us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.416014 (+   406us) write_op.cc:454] Released schema lock
0928 01:55:37.416326 (+   312us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:37.417058 (+   732us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:37.417206 (+   148us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":16,"spinlock_wait_cycles":212111616,"child_traces":[["op",{"apply.queue_time_us":1924,"apply.run_cpu_time_us":4074,"apply.run_wall_time_us":19198,"num_ops":1,"prepare.queue_time_us":9506,"prepare.run_cpu_time_us":2315,"prepare.run_wall_time_us":23511,"raft.queue_time_us":9267,"raft.run_cpu_time_us":14,"raft.run_wall_time_us":15,"replication_time_us":56603}]]}
I20260928 01:55:38.291518 20543 raft_consensus.cc:493] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:38.294859 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6cfc9ff3344a48b09730dfde79d6cf (DEFAULT_TABLE table=default.Table_919e392236f9437fb1c2f9fee1f94f84 [id=e8373f635df4445ca4acdbab7cdeb448]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.296106 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cfc9ff3344a48b09730dfde79d6cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.299042 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet 33e1cc46939b4932a344b81c3bc8ca82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:38.304102 19444 tablet_service.cc:1511] Processing CreateTablet for tablet 6546cfe6f3a6405fab41a4ebdcffb288 (DEFAULT_TABLE table=default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.305446 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet 33e1cc46939b4932a344b81c3bc8ca82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:38.305936 19593 tablet_service.cc:1511] Processing CreateTablet for tablet 65d70a8be7244c86864187420a4fd5f5 (DEFAULT_TABLE table=default.Table_a7be235b87c5430196c28409590e15e8 [id=0bc4ca4de24f45e4843eb09cce780435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.306401 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet 78a71904514a488083426f5fe07d12cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:38.306437 19446 tablet_service.cc:1558] Processing DeleteTablet for tablet 05f875e126f04415a108f778a76bb0f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:30 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:38.307111 19593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d70a8be7244c86864187420a4fd5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.307035 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet 457837143b0f4763a4b91bb25b580477 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:22 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:38.308342 20249 raft_consensus.cc:493] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:38.308518 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bfcdfe218414396824a8f3af4d673ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:38.308830 20249 raft_consensus.cc:515] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.310058 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6546cfe6f3a6405fab41a4ebdcffb288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.310792 20249 leader_election.cc:290] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:38.287474 20536 raft_consensus.cc:493] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:38.314121 20536 raft_consensus.cc:515] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.314697 19592 tablet_service.cc:1511] Processing CreateTablet for tablet 29f65b0966c04012bfec3c67a37acc25 (DEFAULT_TABLE table=default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:38.322536 19703 leader_election.cc:343] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 90d40050f85a4d6c90a4ce35cf15d134
I20260928 01:55:38.285352 19595 tablet_service.cc:1511] Processing CreateTablet for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (DEFAULT_TABLE table=default.Table_001856018a3743328c46c694f06bb065 [id=804b1e68ce9949f0b7fe1e527311afee]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:38.325205 19703 leader_election.cc:343] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 33e1cc46939b4932a344b81c3bc8ca82
I20260928 01:55:38.330849 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:38.333724 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d9b93f45ccf44e785b00849e49c8294 with delete_type TABLET_DATA_DELETED (replaced by tablet 49a73835e2854976b40b31fe752d1b1b) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:38.334802 19595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.334815 19896 tablet_bootstrap.cc:654] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:38.335842 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet 78a71904514a488083426f5fe07d12cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:38.336241 20546 tablet_replica.cc:333] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:38.337287 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f65b0966c04012bfec3c67a37acc25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.336683 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 90d40050f85a4d6c90a4ce35cf15d134 with delete_type TABLET_DATA_DELETED (replaced by tablet d0cb771766b44b149d3ed3ddf75a7474) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:38.341361 20546 raft_consensus.cc:2243] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:38.346916 20029 tablet_bootstrap.cc:492] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:38.347383 20029 ts_tablet_manager.cc:1403] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.305s	user 0.009s	sys 0.005s
I20260928 01:55:38.353338 20029 raft_consensus.cc:359] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:38.354314 20029 raft_consensus.cc:385] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:38.354665 20029 raft_consensus.cc:740] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:38.355381 20029 consensus_queue.cc:260] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:38.358193 20029 ts_tablet_manager.cc:1434] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260928 01:55:38.380290 20536 leader_election.cc:290] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:38.380939 19591 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6cfc9ff3344a48b09730dfde79d6cf (DEFAULT_TABLE table=default.Table_919e392236f9437fb1c2f9fee1f94f84 [id=e8373f635df4445ca4acdbab7cdeb448]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.382783 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cfc9ff3344a48b09730dfde79d6cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.384438 19598 tablet_service.cc:1558] Processing DeleteTablet for tablet eaa1e9b7119d46a2ba2652a893877c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:30 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:38.385187 19597 tablet_service.cc:1558] Processing DeleteTablet for tablet 05f875e126f04415a108f778a76bb0f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:30 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:38.385931 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet 027f99abaacc4c169661e7db08512ebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:28 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:38.387297 19601 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bfcdfe218414396824a8f3af4d673ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:38.367339 20543 raft_consensus.cc:515] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.391892 19599 tablet_service.cc:1511] Processing CreateTablet for tablet 502c0f4e07ff4479af8d33c99031b6fc (DEFAULT_TABLE table=default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.393520 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502c0f4e07ff4479af8d33c99031b6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.407613 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 6546cfe6f3a6405fab41a4ebdcffb288 (DEFAULT_TABLE table=default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.408999 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6546cfe6f3a6405fab41a4ebdcffb288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.418087 20029 tablet_bootstrap.cc:492] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:38.362787 20546 raft_consensus.cc:2272] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 01:55:38.366153 19704 leader_election.cc:343] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 90d40050f85a4d6c90a4ce35cf15d134
I20260928 01:55:38.419667 20543 leader_election.cc:290] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:38.420099 19704 leader_election.cc:304] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
W20260928 01:55:38.421036 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 55559.2us
W20260928 01:55:38.421957 19704 leader_election.cc:343] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 33e1cc46939b4932a344b81c3bc8ca82
I20260928 01:55:38.422335 19704 leader_election.cc:304] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:38.423393 20498 raft_consensus.cc:2749] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:38.424471 20475 raft_consensus.cc:2749] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:38.437652 20498 raft_consensus.cc:493] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:38.438495 20498 raft_consensus.cc:515] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.442039 20498 leader_election.cc:290] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:38.444262 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bbed8181084cb88b7d33976c20fbb8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:38.445174 19619 raft_consensus.cc:2468] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:38.446259 20498 raft_consensus.cc:493] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:38.447000 20498 raft_consensus.cc:515] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:38.385550 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 59480.4us
I20260928 01:55:38.378841 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 502c0f4e07ff4479af8d33c99031b6fc (DEFAULT_TABLE table=default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.449508 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502c0f4e07ff4479af8d33c99031b6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.412889 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 6546cfe6f3a6405fab41a4ebdcffb288 (DEFAULT_TABLE table=default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:38.453524 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6546cfe6f3a6405fab41a4ebdcffb288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:38.447979 19704 leader_election.cc:304] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:38.457388 20340 raft_consensus.cc:2804] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:38.457881 20340 raft_consensus.cc:493] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:38.458521 20340 raft_consensus.cc:3060] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:38.479126 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bbed8181084cb88b7d33976c20fbb8" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:38.479492 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:38.481607 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:38.482914 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bbed8181084cb88b7d33976c20fbb8" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:38.483784 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:38.483839 19476 raft_consensus.cc:2468] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
W20260928 01:55:38.485567 19409 leader_election.cc:343] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:38.486112 19412 leader_election.cc:343] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:38.486500 19412 leader_election.cc:304] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:38.487617 20543 raft_consensus.cc:2749] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:38.487048 20502 ts_tablet_manager.cc:1929] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:38.491210 20502 log.cc:1199] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/7bfcdfe218414396824a8f3af4d673ff
I20260928 01:55:38.492179 20502 ts_tablet_manager.cc:1950] T 7bfcdfe218414396824a8f3af4d673ff P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:38.510679 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 7bfcdfe218414396824a8f3af4d673ff (table default.Table_ef217ae2f1514ce99c1f8993333e2ec6 [id=2a9bea4b8e2a4df68e6bc995f08258b1]) successfully deleted
I20260928 01:55:38.511339 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:38.518198 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_a79e352afb4447d2a5ecb0abeac39b50"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:38.519917 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a79e352afb4447d2a5ecb0abeac39b50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:38.530352 19409 leader_election.cc:343] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:38.533504 19890 tablet_bootstrap.cc:492] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
W20260928 01:55:38.533514 19409 leader_election.cc:343] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:38.533967 19890 ts_tablet_manager.cc:1403] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.482s	user 0.009s	sys 0.004s
I20260928 01:55:38.547356 20543 raft_consensus.cc:493] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:38.547252 19890 raft_consensus.cc:359] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.547992 19890 raft_consensus.cc:385] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:38.548288 19890 raft_consensus.cc:740] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:38.548028 20543 raft_consensus.cc:515] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:38.549083 19890 consensus_queue.cc:260] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.551136 20543 leader_election.cc:290] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:38.551489 19890 ts_tablet_manager.cc:1434] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260928 01:55:38.554406 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bbed8181084cb88b7d33976c20fbb8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:38.555454 19473 raft_consensus.cc:2468] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:38.534523 19115 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_4a2d24baaa4742b0aa00abd564613b46" } modify_external_catalogs: true
I20260928 01:55:38.535357 19118 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 210) took 2637 ms. Trace:
I20260928 01:55:38.535741 19109 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_fa2cc70b96124fedb7f77c2fd58c9d89" } modify_external_catalogs: true
I20260928 01:55:38.564965 19890 tablet_bootstrap.cc:492] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:38.562788 19118 rpcz_store.cc:276] 0928 01:55:35.899743 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.130101 (+2230358us) service_pool.cc:224] Handling call
0928 01:55:38.232683 (+102582us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:38.234303 (+  1620us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:38.251171 (+ 16868us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:55:38.535038 (+283867us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:55:38.535296 (+   258us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:38.235772 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:38.236299 (+   527us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:38.236331 (+    32us) write_op.cc:435] Acquired schema lock
0928 01:55:38.236350 (+    19us) tablet.cc:662] Decoding operations
0928 01:55:38.236666 (+   316us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:38.236712 (+    46us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:38.236746 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:38.236967 (+   221us) tablet.cc:701] Row locks acquired
0928 01:55:38.236979 (+    12us) write_op.cc:260] PREPARE: finished
0928 01:55:38.237113 (+   134us) write_op.cc:270] Start()
0928 01:55:38.237204 (+    91us) write_op.cc:276] Timestamp: P: 1790560538237058 usec, L: 0
0928 01:55:38.237217 (+    13us) op_driver.cc:348] REPLICATION: starting
0928 01:55:38.237796 (+   579us) log.cc:844] Serialized 433 byte log entry
0928 01:55:38.248346 (+ 10550us) op_driver.cc:464] REPLICATION: finished
0928 01:55:38.248706 (+   360us) write_op.cc:301] APPLY: starting
0928 01:55:38.248766 (+    60us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:38.248894 (+   128us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:38.248989 (+    95us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:38.249405 (+   416us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:38.249539 (+   134us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:55:38.249579 (+    40us) write_op.cc:312] APPLY: finished
0928 01:55:38.249791 (+   212us) log.cc:844] Serialized 29 byte log entry
0928 01:55:38.250064 (+   273us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:38.250137 (+    73us) write_op.cc:454] Released schema lock
0928 01:55:38.250170 (+    33us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:38.250425 (+   255us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:38.250460 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":214,"apply.run_cpu_time_us":1688,"apply.run_wall_time_us":1688,"num_ops":2,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":2369,"prepare.run_wall_time_us":2369,"raft.queue_time_us":1205,"raft.run_cpu_time_us":844,"raft.run_wall_time_us":871,"replication_time_us":10938}]]}
I20260928 01:55:38.572482 20147 ts_tablet_manager.cc:1929] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 01:55:38.554178 19110 master_service.cc:960] ReplaceTablet: received request to replace tablet 89e1d60db21f4a8294792df3fadf5d90 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:38.553385 19116 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
W20260928 01:55:38.570034 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 599ef1523fcf43d1a1e2a91f03abaa60 because the tablet was not found. No further retry: Not found: Tablet not found: 599ef1523fcf43d1a1e2a91f03abaa60
I20260928 01:55:38.586102 19116 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]). Expected version 1 got 0
I20260928 01:55:38.588079 19116 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:38.589274 19116 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:38.600394 20147 log.cc:1199] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/ce41f63df46f4d0493ca22a13daadb4f
I20260928 01:55:38.601329 20147 ts_tablet_manager.cc:1950] T ce41f63df46f4d0493ca22a13daadb4f P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:38.585894 19890 tablet_bootstrap.cc:654] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:38.602301 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 120) took 6753 ms. Trace:
I20260928 01:55:38.602658 20147 rpcz_store.cc:276] 0928 01:55:31.849344 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.881733 (+ 32389us) service_pool.cc:224] Handling call
0928 01:55:37.773633 (+5891900us) ts_tablet_manager.cc:1151] Deleting tablet ce41f63df46f4d0493ca22a13daadb4f
0928 01:55:37.773699 (+    66us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:38.346584 (+572885us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:38.572361 (+225777us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:38.602242 (+ 29881us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5867227}
I20260928 01:55:38.590485 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:38.583981 19556 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.Ping -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 56368us
I20260928 01:55:38.604296 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 119) took 6755 ms. Trace:
W20260928 01:55:38.605072 19412 leader_election.cc:343] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:38.605249 19556 consensus_peers.cc:597] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:38.605461 19412 leader_election.cc:304] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:38.605824 19556 leader_election.cc:304] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:38.606581 20249 raft_consensus.cc:2804] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:38.606953 20249 raft_consensus.cc:493] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:38.607259 20249 raft_consensus.cc:3060] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:38.608179 19896 tablet_bootstrap.cc:492] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:38.608623 19896 ts_tablet_manager.cc:1403] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.470s	user 0.013s	sys 0.018s
I20260928 01:55:38.608887 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3741aec215343468b2d7bc952da03c8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:38.609949 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_00c07b4e719b4bdbab8d16df1d23985c"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:38.611502 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00c07b4e719b4bdbab8d16df1d23985c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:38.611928 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 90d40050f85a4d6c90a4ce35cf15d134 because the tablet was not found. No further retry: Not found: Tablet not found: 90d40050f85a4d6c90a4ce35cf15d134
W20260928 01:55:38.613900 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 33e1cc46939b4932a344b81c3bc8ca82 because the tablet was not found. No further retry: Not found: Tablet not found: 33e1cc46939b4932a344b81c3bc8ca82
I20260928 01:55:38.614714 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet ce41f63df46f4d0493ca22a13daadb4f (table default.Table_f74d6b5e81d2457b88ab4456aa43c249 [id=9e114860728146b097bcfce77a95f9d0]) successfully deleted
W20260928 01:55:38.616026 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 78a71904514a488083426f5fe07d12cd because the tablet was not found. No further retry: Not found: Tablet not found: 78a71904514a488083426f5fe07d12cd
W20260928 01:55:38.618144 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 457837143b0f4763a4b91bb25b580477 because the tablet was not found. No further retry: Not found: Tablet not found: 457837143b0f4763a4b91bb25b580477
I20260928 01:55:38.618952 19890 tablet_bootstrap.cc:492] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
W20260928 01:55:38.618906 19412 leader_election.cc:343] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:38.619359 19890 ts_tablet_manager.cc:1403] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.055s	user 0.004s	sys 0.009s
I20260928 01:55:38.619390 19412 leader_election.cc:304] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:55:38.620451 19412 leader_election.cc:343] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:38.621269 20543 raft_consensus.cc:2749] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:38.622218 20543 raft_consensus.cc:2749] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:38.622792 19890 raft_consensus.cc:359] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:38.623409 19890 raft_consensus.cc:385] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:38.623656 19890 raft_consensus.cc:740] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:38.634553 20416 raft_consensus.cc:2749] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:38.634788 19890 consensus_queue.cc:260] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:38.636916 19890 ts_tablet_manager.cc:1434] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260928 01:55:38.637939 19890 tablet_bootstrap.cc:492] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:38.645962 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 05f875e126f04415a108f778a76bb0f5 because the tablet was not found. No further retry: Not found: Tablet not found: 05f875e126f04415a108f778a76bb0f5
I20260928 01:55:38.649417 19896 raft_consensus.cc:359] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.651582 19890 tablet_bootstrap.cc:654] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:38.659345 19111 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 32) took 1588 ms (client timeout 1000 ms). Trace:
I20260928 01:55:38.661057 19896 raft_consensus.cc:385] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:38.517771 20546 ts_tablet_manager.cc:1916] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:38.664278 19896 raft_consensus.cc:740] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
W20260928 01:55:38.664889 19111 rpcz_store.cc:269] 0928 01:55:37.070527 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:37.318645 (+248118us) service_pool.cc:224] Handling call
0928 01:55:38.659258 (+1340613us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122822,"reported_tablets":17}
I20260928 01:55:38.666517 19599 tablet_service.cc:1558] Processing DeleteTablet for tablet ce41f63df46f4d0493ca22a13daadb4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:38.668928 20419 raft_consensus.cc:493] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:38.669411 20419 raft_consensus.cc:515] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:38.661988 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3741aec215343468b2d7bc952da03c8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:38.672626 19896 consensus_queue.cc:260] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:38.673906 19105 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_00a9b004f2894ebb91ab3ebc4098cf0d [id=f071f9c1b9f74504b04a64c5d6a7c8a6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0669f9f51b05479aa9715e06d4c42423 consensus state has no leader
I20260928 01:55:38.627703 20249 raft_consensus.cc:515] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.681835 20249 leader_election.cc:290] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:38.687963 19896 ts_tablet_manager.cc:1434] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.000s
W20260928 01:55:38.690423 19114 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 consensus state has no leader
I20260928 01:55:38.691036 19114 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51212 (request call id 212) took 1949 ms. Trace:
I20260928 01:55:38.691408 19114 rpcz_store.cc:276] 0928 01:55:36.742467 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.244550 (+1502083us) service_pool.cc:224] Handling call
0928 01:55:38.245608 (+  1058us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:38.246277 (+   669us) catalog_manager.cc:3764] Apply alter schema
0928 01:55:38.533560 (+287283us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 01:55:38.533796 (+   236us) catalog_manager.cc:3954] Updating metadata on disk
0928 01:55:38.623520 (+ 89724us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 01:55:38.690975 (+ 67455us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:38.535480 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:38.536396 (+   916us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:38.536444 (+    48us) write_op.cc:435] Acquired schema lock
0928 01:55:38.536478 (+    34us) tablet.cc:662] Decoding operations
0928 01:55:38.536971 (+   493us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:38.537052 (+    81us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:38.537095 (+    43us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:38.537382 (+   287us) tablet.cc:701] Row locks acquired
0928 01:55:38.537394 (+    12us) write_op.cc:260] PREPARE: finished
0928 01:55:38.537599 (+   205us) write_op.cc:270] Start()
0928 01:55:38.537750 (+   151us) write_op.cc:276] Timestamp: P: 1790560538537539 usec, L: 0
0928 01:55:38.537786 (+    36us) op_driver.cc:348] REPLICATION: starting
0928 01:55:38.538581 (+   795us) log.cc:844] Serialized 405 byte log entry
0928 01:55:38.613019 (+ 74438us) op_driver.cc:464] REPLICATION: finished
0928 01:55:38.613731 (+   712us) write_op.cc:301] APPLY: starting
0928 01:55:38.613798 (+    67us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:38.613896 (+    98us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:38.614003 (+   107us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:38.614193 (+   190us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:38.614330 (+   137us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:38.614371 (+    41us) write_op.cc:312] APPLY: finished
0928 01:55:38.614544 (+   173us) log.cc:844] Serialized 23 byte log entry
0928 01:55:38.614690 (+   146us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:38.614761 (+    71us) write_op.cc:454] Released schema lock
0928 01:55:38.614796 (+    35us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:38.615030 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:38.615059 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":530,"apply.run_cpu_time_us":1281,"apply.run_wall_time_us":1285,"num_ops":1,"prepare.queue_time_us":138,"prepare.run_cpu_time_us":3568,"prepare.run_wall_time_us":4498,"raft.queue_time_us":4747,"raft.run_cpu_time_us":1446,"raft.run_wall_time_us":1446,"replication_time_us":75113}]]}
I20260928 01:55:38.700640 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bbed8181084cb88b7d33976c20fbb8" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:38.701225 19476 raft_consensus.cc:3060] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:38.703775 19115 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 3f08e6838341436f8a85d6dbafc805df
I20260928 01:55:38.704819 19113 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 213) took 1818 ms. Trace:
I20260928 01:55:38.709373 19476 raft_consensus.cc:2468] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:38.676985 19766 raft_consensus.cc:2468] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:38.727198 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bbed8181084cb88b7d33976c20fbb8" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:38.688885 19896 tablet_bootstrap.cc:492] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:38.757098 20498 leader_election.cc:290] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:38.758425 19896 tablet_bootstrap.cc:654] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:38.762197 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:38.762485 20419 leader_election.cc:290] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:38.762408 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6b59144fe14daab98b0965c7f8af02" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:38.763268 19890 tablet_bootstrap.cc:492] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:38.763680 19890 ts_tablet_manager.cc:1403] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.013s
W20260928 01:55:38.764540 19704 leader_election.cc:343] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:38.765244 19704 leader_election.cc:343] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:38.765975 19890 raft_consensus.cc:359] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.766566 19890 raft_consensus.cc:385] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:38.766824 19890 raft_consensus.cc:740] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:38.773483 20340 raft_consensus.cc:515] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.774629 19767 raft_consensus.cc:2393] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:38.779122 19890 consensus_queue.cc:260] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.781440 19890 ts_tablet_manager.cc:1434] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260928 01:55:38.784508 19890 tablet_bootstrap.cc:492] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:38.784497 20557 log.cc:927] Time spent T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.118s	user 0.004s	sys 0.002s
I20260928 01:55:38.786932 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bbed8181084cb88b7d33976c20fbb8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:38.787729 19618 raft_consensus.cc:2393] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:38.789709 20340 leader_election.cc:290] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:38.794266 19896 tablet_bootstrap.cc:492] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:38.794332 19409 leader_election.cc:304] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:38.794725 19896 ts_tablet_manager.cc:1403] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.106s	user 0.007s	sys 0.005s
I20260928 01:55:38.795552 20470 raft_consensus.cc:2804] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:38.795900 20470 raft_consensus.cc:493] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:38.796222 20470 raft_consensus.cc:3060] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:38.797324 19896 raft_consensus.cc:359] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.797969 19896 raft_consensus.cc:385] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:38.798224 19896 raft_consensus.cc:740] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:38.812358 20470 raft_consensus.cc:515] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:38.821370 19890 tablet_bootstrap.cc:654] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:38.826319 19896 consensus_queue.cc:260] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.828414 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3741aec215343468b2d7bc952da03c8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:38.831604 19412 leader_election.cc:343] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:38.833454 20249 raft_consensus.cc:493] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:38.833959 20249 raft_consensus.cc:515] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:38.835826 20249 leader_election.cc:290] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:38.836589 20470 leader_election.cc:290] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:38.837705 20543 raft_consensus.cc:493] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:38.837662 19556 leader_election.cc:304] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:38.838142 20543 raft_consensus.cc:515] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.604713 20147 rpcz_store.cc:276] 0928 01:55:31.849004 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:31.875047 (+ 26043us) service_pool.cc:224] Handling call
0928 01:55:38.603859 (+6728812us) ts_tablet_manager.cc:1151] Deleting tablet f3741aec215343468b2d7bc952da03c8
0928 01:55:38.603918 (+    59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:38.604237 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6644598}
I20260928 01:55:38.841059 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 128) took 6652 ms. Trace:
I20260928 01:55:38.841387 20147 rpcz_store.cc:276] 0928 01:55:32.188913 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.189039 (+   126us) service_pool.cc:224] Handling call
0928 01:55:38.840605 (+6651566us) ts_tablet_manager.cc:1151] Deleting tablet e05925303152462e8ca25cd15f3bedff
0928 01:55:38.840669 (+    64us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:38.840994 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6650907}
I20260928 01:55:38.842170 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6b59144fe14daab98b0965c7f8af02" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:38.842705 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 129) took 6652 ms. Trace:
I20260928 01:55:38.842758 19473 raft_consensus.cc:2468] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:38.843003 20147 rpcz_store.cc:276] 0928 01:55:32.190194 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:32.190305 (+   111us) service_pool.cc:224] Handling call
0928 01:55:38.842342 (+6652037us) ts_tablet_manager.cc:1151] Deleting tablet 9ca0b52215454a99b6c5d1956088829a
0928 01:55:38.842398 (+    56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:38.842656 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6651278}
I20260928 01:55:38.843999 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bbed8181084cb88b7d33976c20fbb8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:38.844661 19473 raft_consensus.cc:2393] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:38.846930 19703 leader_election.cc:304] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:38.847214 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:38.847952 19476 raft_consensus.cc:2468] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:38.847992 19703 leader_election.cc:304] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:38.848905 20340 raft_consensus.cc:2804] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:38.849152 20397 raft_consensus.cc:2749] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:38.849306 20340 raft_consensus.cc:493] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:38.849725 20340 raft_consensus.cc:3060] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:38.852993 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b3c947794c48daaacc299a7d2dd4a9" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:38.839993 20543 leader_election.cc:290] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:38.856624 19703 leader_election.cc:304] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:38.857367 20397 raft_consensus.cc:2804] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:38.857828 20397 raft_consensus.cc:493] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:38.858235 20397 raft_consensus.cc:3060] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:38.860663 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3741aec215343468b2d7bc952da03c8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:38.861057 19896 ts_tablet_manager.cc:1434] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.000s
I20260928 01:55:38.861395 19765 raft_consensus.cc:3060] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:38.870198 19896 tablet_bootstrap.cc:492] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:38.708926 19113 rpcz_store.cc:276] 0928 01:55:36.886671 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.259778 (+1373107us) service_pool.cc:224] Handling call
0928 01:55:38.547913 (+288135us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:38.549519 (+  1606us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:38.704098 (+154579us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:55:38.704442 (+   344us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:55:38.704743 (+   301us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:38.554857 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:38.555823 (+   966us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:38.555869 (+    46us) write_op.cc:435] Acquired schema lock
0928 01:55:38.555904 (+    35us) tablet.cc:662] Decoding operations
0928 01:55:38.564562 (+  8658us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:38.564627 (+    65us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:38.564675 (+    48us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:38.565144 (+   469us) tablet.cc:701] Row locks acquired
0928 01:55:38.565182 (+    38us) write_op.cc:260] PREPARE: finished
0928 01:55:38.565401 (+   219us) write_op.cc:270] Start()
0928 01:55:38.565556 (+   155us) write_op.cc:276] Timestamp: P: 1790560538565355 usec, L: 0
0928 01:55:38.565595 (+    39us) op_driver.cc:348] REPLICATION: starting
0928 01:55:38.567003 (+  1408us) log.cc:844] Serialized 433 byte log entry
0928 01:55:38.698232 (+131229us) op_driver.cc:464] REPLICATION: finished
0928 01:55:38.698909 (+   677us) write_op.cc:301] APPLY: starting
0928 01:55:38.698986 (+    77us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:38.699093 (+   107us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:38.699195 (+   102us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:38.699575 (+   380us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:38.699707 (+   132us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:55:38.699747 (+    40us) write_op.cc:312] APPLY: finished
0928 01:55:38.699936 (+   189us) log.cc:844] Serialized 29 byte log entry
0928 01:55:38.700089 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:38.700152 (+    63us) write_op.cc:454] Released schema lock
0928 01:55:38.700184 (+    32us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:38.700422 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:38.700445 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":488,"apply.run_cpu_time_us":1484,"apply.run_wall_time_us":1483,"num_ops":2,"prepare.queue_time_us":2681,"prepare.run_cpu_time_us":4405,"prepare.run_wall_time_us":13652,"replication_time_us":132536}]]}
W20260928 01:55:38.877184 19116 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 22) took 795 ms (client timeout 1000 ms). Trace:
W20260928 01:55:38.877564 19116 rpcz_store.cc:269] 0928 01:55:38.081756 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.122949 (+ 41193us) service_pool.cc:224] Handling call
0928 01:55:38.877113 (+754164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":296144,"reported_tablets":18}
I20260928 01:55:38.882091 19890 tablet_bootstrap.cc:492] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:38.884325 19890 ts_tablet_manager.cc:1403] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.000s
I20260928 01:55:38.884250 19442 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f08e6838341436f8a85d6dbafc805df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:38.884070 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_b573e4ef396d40db9c2826cfe0f16a50"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:38.885078 20502 tablet_replica.cc:333] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
W20260928 01:55:38.885634 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b573e4ef396d40db9c2826cfe0f16a50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:38.885914 20502 raft_consensus.cc:2243] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:38.886044 20340 raft_consensus.cc:515] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.886475 20502 raft_consensus.cc:2272] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:38.889129 20502 ts_tablet_manager.cc:1916] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:38.890744 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6b59144fe14daab98b0965c7f8af02" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:38.891870 19618 raft_consensus.cc:3060] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:38.901476 19896 tablet_bootstrap.cc:654] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:38.912667 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71e2109f8cd4dd4a288fbdc8e50b133" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:38.914042 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6b59144fe14daab98b0965c7f8af02" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:38.914656 19476 raft_consensus.cc:3060] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:38.916325 20340 leader_election.cc:290] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:38.918848 19409 leader_election.cc:343] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:38.930985 19896 tablet_bootstrap.cc:492] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:38.930934 20502 ts_tablet_manager.cc:1929] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 01:55:38.931509 19896 ts_tablet_manager.cc:1403] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.000s
I20260928 01:55:38.931578 20397 raft_consensus.cc:515] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:38.933867 20397 leader_election.cc:290] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:38.931540 20502 log.cc:1199] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/3f08e6838341436f8a85d6dbafc805df
I20260928 01:55:38.935086 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:38.935520 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:38.922003 19476 raft_consensus.cc:2468] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:38.936134 19473 raft_consensus.cc:3060] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:38.936565 20502 ts_tablet_manager.cc:1950] T 3f08e6838341436f8a85d6dbafc805df P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
W20260928 01:55:38.937945 19704 leader_election.cc:343] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:38.940495 19115 master_service.cc:960] ReplaceTablet: received request to replace tablet 12c7284250084d6299cafe8310cfd257 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:38.943737 19473 raft_consensus.cc:2468] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:38.945102 19703 leader_election.cc:304] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:38.933954 19896 raft_consensus.cc:359] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.949754 19896 raft_consensus.cc:385] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:38.950103 19896 raft_consensus.cc:740] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:38.899993 19618 raft_consensus.cc:2468] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:38.952868 19704 leader_election.cc:304] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:38.953986 20419 raft_consensus.cc:2804] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:38.954457 20419 raft_consensus.cc:697] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:38.954742 20475 raft_consensus.cc:2804] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:38.955175 20475 raft_consensus.cc:697] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:38.955312 20419 consensus_queue.cc:237] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.955992 20475 consensus_queue.cc:237] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:38.959955 19739 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f08e6838341436f8a85d6dbafc805df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:38.966064 20249 raft_consensus.cc:2804] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:38.966622 20249 raft_consensus.cc:697] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:38.967499 20249 consensus_queue.cc:237] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:38.969391 19890 raft_consensus.cc:359] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:38.971470 19890 raft_consensus.cc:385] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:38.971743 19890 raft_consensus.cc:740] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:38.972349 19890 consensus_queue.cc:260] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:38.971249 19896 consensus_queue.cc:260] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:38.974619 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 137053us
I20260928 01:55:38.975385 20029 tablet_bootstrap.cc:654] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:38.970048 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 52146.6us
I20260928 01:55:38.970495 20511 consensus_queue.cc:1048] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:38.978664 19896 ts_tablet_manager.cc:1434] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.047s	user 0.002s	sys 0.004s
W20260928 01:55:38.985198 19104 consensus_peers.cc:597] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc -> Peer 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095): Couldn't send request to peer 04e48edd841a42d08a480be209f0d294. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.60:39095: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260928 01:55:38.986212 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 3f08e6838341436f8a85d6dbafc805df (table default.Table_4a2d24baaa4742b0aa00abd564613b46 [id=e17a4562755a46b6922715042f9d07d3]) successfully deleted
I20260928 01:55:38.844131 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 135) took 5612 ms. Trace:
I20260928 01:55:38.987334 20147 rpcz_store.cc:276] 0928 01:55:33.231977 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.279714 (+ 47737us) service_pool.cc:224] Handling call
0928 01:55:38.843762 (+5564048us) ts_tablet_manager.cc:1151] Deleting tablet 158edf7a5d724c88992fecbadd2cedfa
0928 01:55:38.843817 (+    55us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:38.844080 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5543094}
I20260928 01:55:38.992851 20029 tablet_bootstrap.cc:492] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:38.997339 20029 ts_tablet_manager.cc:1403] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.579s	user 0.013s	sys 0.004s
I20260928 01:55:38.997514 19896 tablet_bootstrap.cc:492] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:39.000037 19116 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_a7be235b87c5430196c28409590e15e8" } new_table_name: "default.Table_436557f9b1b0478aa8544ec1f3a86132" modify_external_catalogs: true
I20260928 01:55:38.989296 19890 ts_tablet_manager.cc:1434] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.000s
I20260928 01:55:39.014902 19896 tablet_bootstrap.cc:654] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:39.015967 19890 tablet_bootstrap.cc:492] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:39.018194 20029 raft_consensus.cc:359] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.005801 20601 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.60:39095 every 8 connection(s)
I20260928 01:55:39.016500 19881 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.60:39095
I20260928 01:55:39.021829 19890 tablet_bootstrap.cc:654] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:39.024392 19881 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
I20260928 01:55:39.025810 19112 master_service.cc:960] ReplaceTablet: received request to replace tablet 03bbed8181084cb88b7d33976c20fbb8 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:39.026935 20029 raft_consensus.cc:385] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:39.027323 20029 raft_consensus.cc:740] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:39.028048 20029 consensus_queue.cc:260] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.033058 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 19881
I20260928 01:55:39.033363 20029 ts_tablet_manager.cc:1434] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260928 01:55:39.040464 20029 tablet_bootstrap.cc:492] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:39.069584 20029 tablet_bootstrap.cc:654] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:38.996088 19556 consensus_peers.cc:597] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d9b93f45ccf44e785b00849e49c8294. This is attempt 1: this message will repeat every 5th retry.
W20260928 01:55:39.079885 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 104618us
I20260928 01:55:39.081658 19896 tablet_bootstrap.cc:492] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:39.082142 19896 ts_tablet_manager.cc:1403] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.002s
I20260928 01:55:39.085220 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b3c947794c48daaacc299a7d2dd4a9" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:39.086053 19473 raft_consensus.cc:2468] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
W20260928 01:55:39.095755 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet f3741aec215343468b2d7bc952da03c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3741aec215343468b2d7bc952da03c8 already in progress: creating tablet
W20260928 01:55:39.096570 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet e05925303152462e8ca25cd15f3bedff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e05925303152462e8ca25cd15f3bedff already in progress: creating tablet
I20260928 01:55:39.097143 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 137) took 5717 ms. Trace:
W20260928 01:55:39.097240 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 9ca0b52215454a99b6c5d1956088829a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ca0b52215454a99b6c5d1956088829a already in progress: creating tablet
I20260928 01:55:39.097648 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f08e6838341436f8a85d6dbafc805df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:47670
W20260928 01:55:39.098438 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 158edf7a5d724c88992fecbadd2cedfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 158edf7a5d724c88992fecbadd2cedfa already in progress: creating tablet
W20260928 01:55:39.098492 20596 log.cc:927] Time spent T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260928 01:55:39.099216 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71e2109f8cd4dd4a288fbdc8e50b133" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:39.099444 19556 leader_election.cc:304] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:39.097498 20147 rpcz_store.cc:276] 0928 01:55:33.380126 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.380305 (+   179us) service_pool.cc:224] Handling call
0928 01:55:39.022403 (+5642098us) ts_tablet_manager.cc:1151] Deleting tablet 22606f012f1c44bd92c8e0341e9ca2b7
0928 01:55:39.022456 (+    53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:39.097082 (+ 74626us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5641303}
I20260928 01:55:39.101220 19765 raft_consensus.cc:2468] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:39.101238 20147 tablet_replica.cc:333] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:39.106663 20147 raft_consensus.cc:2243] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:39.107925 19620 raft_consensus.cc:3060] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:39.091332 19896 raft_consensus.cc:359] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:39.118420 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 141483us
I20260928 01:55:39.118657 20029 tablet_bootstrap.cc:492] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:39.119119 20029 ts_tablet_manager.cc:1403] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.006s
I20260928 01:55:39.120731 19409 leader_election.cc:304] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
W20260928 01:55:39.124754 19553 leader_election.cc:343] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:39.126348 20543 raft_consensus.cc:2804] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:39.126904 20543 raft_consensus.cc:697] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:39.128278 20543 consensus_queue.cc:237] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:39.126237 20029 raft_consensus.cc:359] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:39.136976 20029 raft_consensus.cc:385] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:39.137405 20029 raft_consensus.cc:740] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:39.142158 20029 consensus_queue.cc:260] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:39.146353 19890 tablet_bootstrap.cc:492] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:39.151425 19890 ts_tablet_manager.cc:1403] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.136s	user 0.007s	sys 0.004s
I20260928 01:55:39.119050 19896 raft_consensus.cc:385] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:39.152483 19896 raft_consensus.cc:740] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:39.155881 20546 ts_tablet_manager.cc:1929] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:39.159677 20546 log.cc:1199] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/599ef1523fcf43d1a1e2a91f03abaa60
I20260928 01:55:39.160972 19896 consensus_queue.cc:260] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.166025 19896 ts_tablet_manager.cc:1434] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.083s	user 0.004s	sys 0.003s
I20260928 01:55:39.167089 19896 tablet_bootstrap.cc:492] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:39.157284 20029 ts_tablet_manager.cc:1434] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260928 01:55:39.180683 20147 pending_rounds.cc:70] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0: Trying to abort 1 pending ops.
I20260928 01:55:39.181080 20147 pending_rounds.cc:77] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135962305921024 op_type: NO_OP noop_request { }
I20260928 01:55:39.181270 20029 tablet_bootstrap.cc:492] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:39.181496 20147 raft_consensus.cc:2889] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:39.181355 20597 raft_consensus.cc:2804] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:39.181893 20147 raft_consensus.cc:2272] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:39.181941 20597 raft_consensus.cc:493] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:39.182483 20597 raft_consensus.cc:3060] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:39.183759 20147 ts_tablet_manager.cc:1916] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:39.186203 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_b4909725798043e3b60ea75cfa351347"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:39.187915 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4909725798043e3b60ea75cfa351347 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:39.189025 19118 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_a3ed770c6c6f410ba1b6c0db32c665bc" } modify_external_catalogs: true
I20260928 01:55:39.192618 19118 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_a3ed770c6c6f410ba1b6c0db32c665bc" } modify_external_catalogs: true
I20260928 01:55:39.203509 20543 raft_consensus.cc:493] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:39.204015 20543 raft_consensus.cc:515] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.207427 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f73a301c84482f897990ac5e5dd162" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:39.207973 20543 leader_election.cc:290] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:39.209126 19409 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:39.219496 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 120145us
W20260928 01:55:39.220453 19412 leader_election.cc:343] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:39.220860 19412 leader_election.cc:304] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:39.222440 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f73a301c84482f897990ac5e5dd162" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:39.222733 20610 log.cc:927] Time spent T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260928 01:55:39.224061 20470 raft_consensus.cc:2749] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:39.224715 20470 consensus_queue.cc:1048] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:55:39.226717 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 22606f012f1c44bd92c8e0341e9ca2b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22606f012f1c44bd92c8e0341e9ca2b7 already in progress: creating tablet
W20260928 01:55:39.235004 19412 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:39.235060 19890 raft_consensus.cc:359] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:39.235767 19890 raft_consensus.cc:385] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:39.235427 19412 leader_election.cc:304] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:39.236052 19890 raft_consensus.cc:740] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:39.240548 20543 raft_consensus.cc:2749] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:39.246920 19896 tablet_bootstrap.cc:654] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:39.261394 19442 tablet_service.cc:1511] Processing CreateTablet for tablet 8e39fce4f0a149a898de678d73052f52 (DEFAULT_TABLE table=default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:39.263170 19442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e39fce4f0a149a898de678d73052f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:39.264050 19738 tablet_service.cc:1511] Processing CreateTablet for tablet b8cacb4a90a54cd3b5b3e7a9310e06ed (DEFAULT_TABLE table=default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:39.265900 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8cacb4a90a54cd3b5b3e7a9310e06ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:39.267787 20147 ts_tablet_manager.cc:1929] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:39.268234 20147 log.cc:1199] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/5d9b93f45ccf44e785b00849e49c8294
I20260928 01:55:39.268971 20147 ts_tablet_manager.cc:1950] T 5d9b93f45ccf44e785b00849e49c8294 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:39.273576 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 8e39fce4f0a149a898de678d73052f52 (DEFAULT_TABLE table=default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:39.275645 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e39fce4f0a149a898de678d73052f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:39.278613 19110 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:39.279866 19110 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:39.281349 19444 tablet_service.cc:1511] Processing CreateTablet for tablet b8cacb4a90a54cd3b5b3e7a9310e06ed (DEFAULT_TABLE table=default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:39.283062 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8cacb4a90a54cd3b5b3e7a9310e06ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:39.284672 20603 sys_catalog.cc:263] Verifying existing consensus state
I20260928 01:55:39.299077 19592 tablet_service.cc:1511] Processing CreateTablet for tablet 8e39fce4f0a149a898de678d73052f52 (DEFAULT_TABLE table=default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:39.300236 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e39fce4f0a149a898de678d73052f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:39.302155 20543 raft_consensus.cc:493] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:39.302656 20543 raft_consensus.cc:515] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.305058 20543 leader_election.cc:290] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:39.307394 19595 tablet_service.cc:1511] Processing CreateTablet for tablet b8cacb4a90a54cd3b5b3e7a9310e06ed (DEFAULT_TABLE table=default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:39.308444 19595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8cacb4a90a54cd3b5b3e7a9310e06ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:39.308570 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699e0d862fa4a54bbd756625f4e692b" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:39.310029 19412 leader_election.cc:343] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:39.310081 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699e0d862fa4a54bbd756625f4e692b" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:39.312418 19409 leader_election.cc:343] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:39.312834 19409 leader_election.cc:304] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:39.313477 20543 raft_consensus.cc:2749] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:39.316176 19890 consensus_queue.cc:260] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:39.321687 19110 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:39.322546 19110 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]). Expected version 1 got 0
W20260928 01:55:39.324039 19117 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67be39a8cae04ff9ae99c2c3b02713cd consensus state has no leader
I20260928 01:55:39.334373 19111 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
W20260928 01:55:39.337877 19116 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 65d70a8be7244c86864187420a4fd5f5 consensus state has no leader
I20260928 01:55:39.338529 19896 tablet_bootstrap.cc:492] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:39.339255 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_472f586201dd40db9fd84403594d81ed"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:39.340992 19117 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51212 (request call id 211) took 3440 ms. Trace:
I20260928 01:55:39.341229 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 138) took 5955 ms. Trace:
I20260928 01:55:39.341568 20147 rpcz_store.cc:276] 0928 01:55:33.385794 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:33.385970 (+   176us) service_pool.cc:224] Handling call
0928 01:55:39.101039 (+5715069us) ts_tablet_manager.cc:1151] Deleting tablet 5d9b93f45ccf44e785b00849e49c8294
0928 01:55:39.101119 (+    80us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:39.204672 (+103553us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:39.255909 (+ 51237us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:39.341144 (+ 85235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99109,"tablet-delete.queue_time_us":5714255}
I20260928 01:55:39.161602 20546 ts_tablet_manager.cc:1950] T 599ef1523fcf43d1a1e2a91f03abaa60 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:39.342526 19111 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:39.342887 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 5d9b93f45ccf44e785b00849e49c8294 (table default.Table_63f36a8d22184eac8a38565457441d09 [id=102958783e204ded94a67a96b0dec09b]) successfully deleted
I20260928 01:55:39.343155 19111 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]). Expected version 1 got 0
I20260928 01:55:39.343302 20147 tablet_replica.cc:333] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:39.341362 19117 rpcz_store.cc:276] 0928 01:55:35.900129 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.235997 (+2335868us) service_pool.cc:224] Handling call
0928 01:55:38.238574 (+  2577us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:38.239860 (+  1286us) catalog_manager.cc:3764] Apply alter schema
0928 01:55:38.536153 (+296293us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 01:55:38.536399 (+   246us) catalog_manager.cc:3954] Updating metadata on disk
0928 01:55:38.622383 (+ 85984us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 01:55:39.340927 (+718544us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:38.540186 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:38.541055 (+   869us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:38.541098 (+    43us) write_op.cc:435] Acquired schema lock
0928 01:55:38.541131 (+    33us) tablet.cc:662] Decoding operations
0928 01:55:38.541612 (+   481us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:38.541670 (+    58us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:38.541731 (+    61us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:38.542013 (+   282us) tablet.cc:701] Row locks acquired
0928 01:55:38.542049 (+    36us) write_op.cc:260] PREPARE: finished
0928 01:55:38.542251 (+   202us) write_op.cc:270] Start()
0928 01:55:38.542450 (+   199us) write_op.cc:276] Timestamp: P: 1790560538542191 usec, L: 0
0928 01:55:38.542466 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:55:38.543435 (+   969us) log.cc:844] Serialized 405 byte log entry
0928 01:55:38.613282 (+ 69847us) op_driver.cc:464] REPLICATION: finished
0928 01:55:38.615297 (+  2015us) write_op.cc:301] APPLY: starting
0928 01:55:38.615347 (+    50us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:38.615433 (+    86us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:38.615521 (+    88us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:38.615672 (+   151us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:38.615797 (+   125us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:38.615835 (+    38us) write_op.cc:312] APPLY: finished
0928 01:55:38.616003 (+   168us) log.cc:844] Serialized 23 byte log entry
0928 01:55:38.616133 (+   130us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:38.616192 (+    59us) write_op.cc:454] Released schema lock
0928 01:55:38.616261 (+    69us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1886,"apply.run_cpu_time_us":1132,"apply.run_wall_time_us":1141,"num_ops":1,"prepare.queue_time_us":2488,"prepare.run_cpu_time_us":3589,"prepare.run_wall_time_us":6220,"replication_time_us":70714,"thread_start_us":17878,"threads_started":1}]]}
I20260928 01:55:39.345645 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_87c7744e9ee94b63a143377632aaf826"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:39.347350 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87c7744e9ee94b63a143377632aaf826 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:39.350579 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_472f586201dd40db9fd84403594d81ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:39.342299 19521 heartbeater.cc:344] Connected to a master server at 127.18.161.60:39095
I20260928 01:55:39.354511 19896 ts_tablet_manager.cc:1403] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.188s	user 0.014s	sys 0.004s
I20260928 01:55:39.362107 20029 tablet_bootstrap.cc:654] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:39.363560 19896 raft_consensus.cc:359] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.378016 19896 raft_consensus.cc:385] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:39.378643 20147 raft_consensus.cc:2243] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:39.378831 19896 raft_consensus.cc:740] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:39.380290 20147 raft_consensus.cc:2272] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:39.380297 19896 consensus_queue.cc:260] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.381928 19890 ts_tablet_manager.cc:1434] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.208s	user 0.009s	sys 0.000s
I20260928 01:55:39.383030 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 170) took 1289 ms. Trace:
I20260928 01:55:39.388279 20546 rpcz_store.cc:276] 0928 01:55:38.094135 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.094270 (+   135us) service_pool.cc:224] Handling call
0928 01:55:38.335909 (+241639us) ts_tablet_manager.cc:1151] Deleting tablet 599ef1523fcf43d1a1e2a91f03abaa60
0928 01:55:38.335972 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:38.362270 (+ 26298us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5800081bd0. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a211f5aa1 00007f0a211e85da 00007f0a2126a977 00007f0a21294b45 00007f0a216d555c 00007f0a2233ec3a 00007f0a2236f960 00007f0a22355e6d 00007f0a22355e19 00007f0a22355da9 00007f0a22355d71
0928 01:55:38.814509 (+452239us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:39.155712 (+341203us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:39.382922 (+227210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3335,"spinlock_wait_cycles":43809664,"tablet-delete.queue_time_us":219067,"thread_start_us":203727,"threads_started":1}
I20260928 01:55:39.397804 19896 ts_tablet_manager.cc:1434] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260928 01:55:39.399446 20597 raft_consensus.cc:515] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:39.403378 19114 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_49cf0e3df4ac4673927287e5ff629fbf"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:39.405404 19114 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49cf0e3df4ac4673927287e5ff629fbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:39.432586 19109 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 0ae3663fbe024a4e946e47339a4b9090
I20260928 01:55:39.434548 19109 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 214) took 1913 ms. Trace:
I20260928 01:55:39.435797 20603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Bootstrap starting.
I20260928 01:55:39.437542 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ae3663fbe024a4e946e47339a4b9090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:39.436951 19703 consensus_peers.cc:597] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f08e6838341436f8a85d6dbafc805df. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:39.438832 19739 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ae3663fbe024a4e946e47339a4b9090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:39.444679 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 599ef1523fcf43d1a1e2a91f03abaa60 (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]) successfully deleted
I20260928 01:55:39.446218 19813 heartbeater.cc:344] Connected to a master server at 127.18.161.60:39095
I20260928 01:55:39.446664 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 173) took 1347 ms. Trace:
I20260928 01:55:39.446796 19813 heartbeater.cc:499] Master 127.18.161.60:39095 was elected leader, sending a full tablet report...
I20260928 01:55:39.447130 20546 rpcz_store.cc:276] 0928 01:55:38.099451 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.099613 (+   162us) service_pool.cc:224] Handling call
0928 01:55:39.446251 (+1346638us) ts_tablet_manager.cc:1151] Deleting tablet c1f73a301c84482f897990ac5e5dd162
0928 01:55:39.446309 (+    58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:39.446606 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1321760}
I20260928 01:55:39.448757 20546 tablet_replica.cc:333] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:39.449678 20546 raft_consensus.cc:2243] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 01:55:39.451901 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet c1f73a301c84482f897990ac5e5dd162 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1f73a301c84482f897990ac5e5dd162 already in progress: creating tablet
I20260928 01:55:39.457616 20470 consensus_queue.cc:1048] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:39.436919 19666 heartbeater.cc:344] Connected to a master server at 127.18.161.60:39095
I20260928 01:55:39.441067 19595 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ae3663fbe024a4e946e47339a4b9090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:39.450059 19890 tablet_bootstrap.cc:492] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:39.434891 19109 rpcz_store.cc:276] 0928 01:55:37.520805 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.261253 (+740448us) service_pool.cc:224] Handling call
0928 01:55:38.564517 (+303264us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:38.565093 (+   576us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:55:38.565330 (+   237us) catalog_manager.cc:2863] Locking tablets
0928 01:55:39.257797 (+692467us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:55:39.432094 (+174297us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:55:39.432370 (+   276us) catalog_manager.cc:2911] Committing in-memory state
0928 01:55:39.432483 (+   113us) catalog_manager.cc:2915] Aborting table tasks
0928 01:55:39.434459 (+  1976us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:39.410198 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:39.411066 (+   868us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:39.411109 (+    43us) write_op.cc:435] Acquired schema lock
0928 01:55:39.411123 (+    14us) tablet.cc:662] Decoding operations
0928 01:55:39.411702 (+   579us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:39.411761 (+    59us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:39.411828 (+    67us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:39.412339 (+   511us) tablet.cc:701] Row locks acquired
0928 01:55:39.412370 (+    31us) write_op.cc:260] PREPARE: finished
0928 01:55:39.412563 (+   193us) write_op.cc:270] Start()
0928 01:55:39.412712 (+   149us) write_op.cc:276] Timestamp: P: 1790560539412368 usec, L: 0
0928 01:55:39.412745 (+    33us) op_driver.cc:348] REPLICATION: starting
0928 01:55:39.413671 (+   926us) log.cc:844] Serialized 728 byte log entry
0928 01:55:39.430137 (+ 16466us) op_driver.cc:464] REPLICATION: finished
0928 01:55:39.430529 (+   392us) write_op.cc:301] APPLY: starting
0928 01:55:39.430592 (+    63us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:39.430708 (+   116us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:39.430790 (+    82us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:39.431068 (+   278us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:39.431197 (+   129us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:39.431236 (+    39us) write_op.cc:312] APPLY: finished
0928 01:55:39.431434 (+   198us) log.cc:844] Serialized 29 byte log entry
0928 01:55:39.431587 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:39.431660 (+    73us) write_op.cc:454] Released schema lock
0928 01:55:39.431691 (+    31us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":225,"apply.run_cpu_time_us":1379,"apply.run_wall_time_us":1378,"num_ops":2,"prepare.queue_time_us":150270,"raft.queue_time_us":115,"raft.run_cpu_time_us":806,"raft.run_wall_time_us":3802,"replication_time_us":17283}]]}
I20260928 01:55:39.466774 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b3c947794c48daaacc299a7d2dd4a9" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:39.467346 19476 raft_consensus.cc:3060] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:39.467693 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bfcdfe218414396824a8f3af4d673ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:39.469233 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet f3741aec215343468b2d7bc952da03c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:39.471098 19890 tablet_bootstrap.cc:654] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:39.480690 19476 raft_consensus.cc:2468] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:39.481118 19890 tablet_bootstrap.cc:492] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:39.481691 19890 ts_tablet_manager.cc:1403] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.000s
I20260928 01:55:39.482653 19556 leader_election.cc:304] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:39.489925 20511 raft_consensus.cc:2804] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:39.490464 20511 raft_consensus.cc:697] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:39.491246 20511 consensus_queue.cc:237] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:39.443044 20029 tablet_bootstrap.cc:492] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:39.492571 20029 ts_tablet_manager.cc:1403] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.312s	user 0.011s	sys 0.005s
I20260928 01:55:39.494831 19118 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 57a81b9455a340728fea713318e1e77a
I20260928 01:55:39.495270 20029 raft_consensus.cc:359] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.495890 20029 raft_consensus.cc:385] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:39.498095 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 57a81b9455a340728fea713318e1e77a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:39.498544 19110 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 37) took 923 ms (client timeout 1000 ms). Trace:
W20260928 01:55:39.498862 19110 rpcz_store.cc:269] 0928 01:55:38.575092 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.581011 (+  5919us) service_pool.cc:224] Handling call
0928 01:55:39.498481 (+917470us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57494,"reported_tablets":20}
I20260928 01:55:39.496186 20029 raft_consensus.cc:740] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:39.500468 20029 consensus_queue.cc:260] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.501446 19595 tablet_service.cc:1558] Processing DeleteTablet for tablet 57a81b9455a340728fea713318e1e77a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:39.502789 20029 ts_tablet_manager.cc:1434] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260928 01:55:39.503703 20029 tablet_bootstrap.cc:492] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:39.497373 19739 tablet_service.cc:1558] Processing DeleteTablet for tablet 57a81b9455a340728fea713318e1e77a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:39.496552 20546 raft_consensus.cc:2272] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:39.506865 20546 ts_tablet_manager.cc:1916] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:39.509449 19890 raft_consensus.cc:359] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.510131 19890 raft_consensus.cc:385] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:39.510393 19890 raft_consensus.cc:740] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:39.511019 19890 consensus_queue.cc:260] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.416322 20147 ts_tablet_manager.cc:1916] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:39.515092 20597 leader_election.cc:290] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:39.515336 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b3c947794c48daaacc299a7d2dd4a9" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:39.515949 19767 raft_consensus.cc:3060] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:39.521703 19890 ts_tablet_manager.cc:1434] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260928 01:55:39.522701 19890 tablet_bootstrap.cc:492] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:39.525297 19767 raft_consensus.cc:2468] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:39.528887 19595 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d9b93f45ccf44e785b00849e49c8294 with delete_type TABLET_DATA_DELETED (replaced by tablet 49a73835e2854976b40b31fe752d1b1b) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:39.551878 19890 tablet_bootstrap.cc:654] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:39.561498 19111 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_2ba0a32bb9a441bdba3ac63f08ae026f" } new_table_name: "default.Table_6fceefa6f594468cbc929496b59d8bb3" modify_external_catalogs: true
I20260928 01:55:39.562994 19110 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_00a9b004f2894ebb91ab3ebc4098cf0d" } new_table_name: "default.Table_bd6fee77f196438ca5e90da78527c241" modify_external_catalogs: true
I20260928 01:55:39.572511 19896 tablet_bootstrap.cc:492] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:39.577313 19115 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 12c7284250084d6299cafe8310cfd257
I20260928 01:55:39.579073 19115 catalog_manager.cc:6934] ReplaceTablet: tablet 12c7284250084d6299cafe8310cfd257 deleted and replaced by tablet 13c395a6a87f4927b10973720aa4d868
I20260928 01:55:39.581328 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 12c7284250084d6299cafe8310cfd257 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c395a6a87f4927b10973720aa4d868) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:39.586550 19595 tablet_service.cc:1558] Processing DeleteTablet for tablet 12c7284250084d6299cafe8310cfd257 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c395a6a87f4927b10973720aa4d868) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:39.588140 19739 tablet_service.cc:1558] Processing DeleteTablet for tablet 12c7284250084d6299cafe8310cfd257 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c395a6a87f4927b10973720aa4d868) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:39.594848 19115 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_2b02108aba00496e82910dfcb4866a83"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:39.596848 19115 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b02108aba00496e82910dfcb4866a83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:39.604188 20029 tablet_bootstrap.cc:654] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:39.588441 19896 tablet_bootstrap.cc:654] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:39.623018 19112 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 03bbed8181084cb88b7d33976c20fbb8
I20260928 01:55:39.624902 19112 catalog_manager.cc:6934] ReplaceTablet: tablet 03bbed8181084cb88b7d33976c20fbb8 deleted and replaced by tablet 2c007b068b1d414298cce3fe44a91daa
I20260928 01:55:39.627384 20502 tablet_replica.cc:333] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
W20260928 01:55:39.629217 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 0ae3663fbe024a4e946e47339a4b9090 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ae3663fbe024a4e946e47339a4b9090 already in progress: creating tablet
I20260928 01:55:39.629760 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 03bbed8181084cb88b7d33976c20fbb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c007b068b1d414298cce3fe44a91daa) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:39.629956 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7bfcdfe218414396824a8f3af4d673ff because the tablet was not found. No further retry: Not found: Tablet not found: 7bfcdfe218414396824a8f3af4d673ff
I20260928 01:55:39.631335 20502 raft_consensus.cc:2243] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:39.632542 20502 pending_rounds.cc:70] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614: Trying to abort 1 pending ops.
I20260928 01:55:39.632987 20502 pending_rounds.cc:77] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135968328781824 op_type: NO_OP noop_request { }
I20260928 01:55:39.633598 20502 raft_consensus.cc:2889] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:39.634188 20502 raft_consensus.cc:2272] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:39.637251 20502 ts_tablet_manager.cc:1916] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:39.643666 19595 tablet_service.cc:1558] Processing DeleteTablet for tablet 03bbed8181084cb88b7d33976c20fbb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c007b068b1d414298cce3fe44a91daa) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:39.643740 19738 tablet_service.cc:1558] Processing DeleteTablet for tablet 03bbed8181084cb88b7d33976c20fbb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c007b068b1d414298cce3fe44a91daa) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:39.647857 20029 tablet_bootstrap.cc:492] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:39.648396 20029 ts_tablet_manager.cc:1403] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.145s	user 0.009s	sys 0.007s
I20260928 01:55:39.648607 20419 raft_consensus.cc:493] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:39.649121 20419 raft_consensus.cc:515] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.653935 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555e557370a4e92915a9c55107b573b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:39.654776 19473 raft_consensus.cc:2468] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:39.667712 19112 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_919e392236f9437fb1c2f9fee1f94f84" } modify_external_catalogs: true
I20260928 01:55:39.668354 19112 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_919e392236f9437fb1c2f9fee1f94f84" } modify_external_catalogs: true
I20260928 01:55:39.674034 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555e557370a4e92915a9c55107b573b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:39.684547 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 65d70a8be7244c86864187420a4fd5f5 consensus state has no leader
I20260928 01:55:39.697222 19890 tablet_bootstrap.cc:492] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:39.656244 19703 leader_election.cc:304] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:39.652678 20419 leader_election.cc:290] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:39.698685 19704 leader_election.cc:343] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:39.651834 20029 raft_consensus.cc:359] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.699615 20029 raft_consensus.cc:385] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:39.699874 20029 raft_consensus.cc:740] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:39.698764 20419 raft_consensus.cc:2804] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:39.700568 20029 consensus_queue.cc:260] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.700878 20419 raft_consensus.cc:493] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:39.701351 20419 raft_consensus.cc:3060] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:39.708606 20546 ts_tablet_manager.cc:1929] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:39.710841 20603 log.cc:826] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Log is configured to *not* fsync() on all Append() calls
I20260928 01:55:39.720441 19118 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_63f36a8d22184eac8a38565457441d09" } modify_external_catalogs: true
I20260928 01:55:39.721033 19118 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_63f36a8d22184eac8a38565457441d09" } modify_external_catalogs: true
I20260928 01:55:39.697654 19890 ts_tablet_manager.cc:1403] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.175s	user 0.016s	sys 0.002s
I20260928 01:55:39.733435 20147 ts_tablet_manager.cc:1929] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:39.733824 20147 log.cc:1199] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/78a71904514a488083426f5fe07d12cd
I20260928 01:55:39.734498 20147 ts_tablet_manager.cc:1950] T 78a71904514a488083426f5fe07d12cd P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:39.733132 20029 ts_tablet_manager.cc:1434] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.000s
I20260928 01:55:39.743744 20029 tablet_bootstrap.cc:492] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:39.745807 19896 tablet_bootstrap.cc:492] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:39.746286 19896 ts_tablet_manager.cc:1403] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.174s	user 0.012s	sys 0.002s
I20260928 01:55:39.742138 20546 log.cc:1199] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/33e1cc46939b4932a344b81c3bc8ca82
I20260928 01:55:39.750602 19896 raft_consensus.cc:359] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.751325 19896 raft_consensus.cc:385] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:39.751612 19896 raft_consensus.cc:740] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:39.752279 20546 ts_tablet_manager.cc:1950] T 33e1cc46939b4932a344b81c3bc8ca82 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:39.761813 20419 raft_consensus.cc:515] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.764732 19896 consensus_queue.cc:260] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.768524 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 181) took 1508 ms. Trace:
I20260928 01:55:39.771651 20546 rpcz_store.cc:276] 0928 01:55:38.259946 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.298786 (+ 38840us) service_pool.cc:224] Handling call
0928 01:55:39.448572 (+1149786us) ts_tablet_manager.cc:1151] Deleting tablet 33e1cc46939b4932a344b81c3bc8ca82
0928 01:55:39.448619 (+    47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:39.623034 (+174415us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:39.708462 (+ 85428us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:39.768441 (+ 59979us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1149096}
I20260928 01:55:39.773460 19896 ts_tablet_manager.cc:1434] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.006s
I20260928 01:55:39.774415 19896 tablet_bootstrap.cc:492] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:39.777099 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 33e1cc46939b4932a344b81c3bc8ca82 (table default.Table_1a6a047e1e8f4430a6756891154a5e3b [id=c9816a660a324eb9a6eeb87f2f1e9422]) successfully deleted
I20260928 01:55:39.779101 20546 tablet_replica.cc:333] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:39.785640 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555e557370a4e92915a9c55107b573b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:39.787366 19704 leader_election.cc:343] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:39.727895 19890 raft_consensus.cc:359] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.788640 19890 raft_consensus.cc:385] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:39.788944 19890 raft_consensus.cc:740] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:39.802189 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 146) took 3745 ms. Trace:
I20260928 01:55:39.802662 20147 rpcz_store.cc:276] 0928 01:55:36.056895 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:36.057065 (+   170us) service_pool.cc:224] Handling call
0928 01:55:39.343139 (+3286074us) ts_tablet_manager.cc:1151] Deleting tablet 78a71904514a488083426f5fe07d12cd
0928 01:55:39.343188 (+    49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:39.608103 (+264915us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:39.733305 (+125202us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:39.802090 (+ 68785us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3191733}
I20260928 01:55:39.789680 19890 consensus_queue.cc:260] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.804705 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 147) took 3746 ms. Trace:
I20260928 01:55:39.805176 20147 rpcz_store.cc:276] 0928 01:55:36.058100 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:36.058223 (+   123us) service_pool.cc:224] Handling call
0928 01:55:39.804341 (+3746118us) ts_tablet_manager.cc:1151] Deleting tablet f71e2109f8cd4dd4a288fbdc8e50b133
0928 01:55:39.804386 (+    45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:39.804653 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3652565}
I20260928 01:55:39.806303 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 78a71904514a488083426f5fe07d12cd (table default.Table_d6ec5f8939f84de7994041a54bdbe36b [id=ab54f23a53744160a4b2437b2b513937]) successfully deleted
W20260928 01:55:39.807317 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet f71e2109f8cd4dd4a288fbdc8e50b133 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f71e2109f8cd4dd4a288fbdc8e50b133 already in progress: creating tablet
I20260928 01:55:39.808622 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 152) took 2652 ms. Trace:
I20260928 01:55:39.812470 20147 rpcz_store.cc:276] 0928 01:55:37.156046 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:37.156245 (+   199us) service_pool.cc:224] Handling call
0928 01:55:39.807402 (+2651157us) ts_tablet_manager.cc:1151] Deleting tablet c320eb2ca2ac4ac68293ef8f7400b45f
0928 01:55:39.808258 (+   856us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:39.808569 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2616612}
W20260928 01:55:39.813740 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet c320eb2ca2ac4ac68293ef8f7400b45f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c320eb2ca2ac4ac68293ef8f7400b45f already in progress: creating tablet
I20260928 01:55:39.814375 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 151) took 2666 ms. Trace:
I20260928 01:55:39.814667 20147 rpcz_store.cc:276] 0928 01:55:37.148296 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:37.148500 (+   204us) service_pool.cc:224] Handling call
0928 01:55:39.814001 (+2665501us) ts_tablet_manager.cc:1151] Deleting tablet 89e1d60db21f4a8294792df3fadf5d90
0928 01:55:39.814075 (+    74us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:39.814322 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2622820}
W20260928 01:55:39.815750 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 89e1d60db21f4a8294792df3fadf5d90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89e1d60db21f4a8294792df3fadf5d90 already in progress: creating tablet
I20260928 01:55:39.815987 20147 tablet_replica.cc:333] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:39.816747 20147 raft_consensus.cc:2243] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:39.817236 20147 raft_consensus.cc:2272] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:39.819620 19890 ts_tablet_manager.cc:1434] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.000s
I20260928 01:55:39.820601 19890 tablet_bootstrap.cc:492] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:39.826764 20543 raft_consensus.cc:493] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:39.827227 20543 raft_consensus.cc:515] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.833137 20543 leader_election.cc:290] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:39.836297 19896 tablet_bootstrap.cc:654] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:39.840003 20597 raft_consensus.cc:493] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:39.840648 20597 raft_consensus.cc:515] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:39.841245 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca0b52215454a99b6c5d1956088829a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:39.843431 20597 leader_election.cc:290] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:39.784732 20029 tablet_bootstrap.cc:654] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:39.860694 19553 consensus_peers.cc:597] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
W20260928 01:55:39.871799 19412 leader_election.cc:343] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:39.876590 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:39.877426 19476 raft_consensus.cc:2393] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:39.888832 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca0b52215454a99b6c5d1956088829a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:39.890754 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:39.892105 20419 leader_election.cc:290] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:39.896790 19409 leader_election.cc:343] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:39.897074 19553 leader_election.cc:304] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:39.897219 19409 leader_election.cc:304] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:39.898303 20543 raft_consensus.cc:2749] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:39.901952 19110 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0669f9f51b05479aa9715e06d4c42423 consensus state has no leader
I20260928 01:55:39.906157 20502 ts_tablet_manager.cc:1929] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:39.906812 20502 log.cc:1199] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/f3741aec215343468b2d7bc952da03c8
I20260928 01:55:39.906992 20147 ts_tablet_manager.cc:1916] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:39.907800 20502 ts_tablet_manager.cc:1950] T f3741aec215343468b2d7bc952da03c8 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:39.915064 20511 raft_consensus.cc:3060] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:39.920609 20597 consensus_queue.cc:1048] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:39.947388 20511 raft_consensus.cc:2749] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:39.959650 19896 tablet_bootstrap.cc:492] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:39.960114 19896 ts_tablet_manager.cc:1403] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.186s	user 0.011s	sys 0.002s
I20260928 01:55:39.963364 19896 raft_consensus.cc:359] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.963995 19896 raft_consensus.cc:385] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:39.966001 20511 raft_consensus.cc:493] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:39.966050 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_f65413c2f8584805a3186fb775ed4e59"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:39.967747 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f65413c2f8584805a3186fb775ed4e59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:39.968569 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet f3741aec215343468b2d7bc952da03c8 (table default.Table_1d40de09d743485db2f538534e097074 [id=c314147c39ca4ef695e61de1652cf804]) successfully deleted
I20260928 01:55:39.968861 19890 tablet_bootstrap.cc:654] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:39.969432 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 57a81b9455a340728fea713318e1e77a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57a81b9455a340728fea713318e1e77a already in progress: creating tablet
W20260928 01:55:39.970081 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 12c7284250084d6299cafe8310cfd257 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12c7284250084d6299cafe8310cfd257 already in progress: creating tablet
I20260928 01:55:39.974380 20630 raft_consensus.cc:493] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:39.975184 20630 raft_consensus.cc:515] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:39.988889 20546 raft_consensus.cc:2243] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:39.990212 20546 raft_consensus.cc:2272] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:39.990199 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699e0d862fa4a54bbd756625f4e692b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:39.992084 19704 leader_election.cc:343] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:40.004458 20629 raft_consensus.cc:493] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:40.007900 20249 raft_consensus.cc:493] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:40.008592 20249 raft_consensus.cc:515] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:40.009761 19111 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2156dae74ee748cd845b6dea1d3b8ea8 consensus state has no leader
I20260928 01:55:40.012374 20249 leader_election.cc:290] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:40.012792 20416 consensus_queue.cc:1048] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:40.015980 19556 leader_election.cc:343] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: f3741aec215343468b2d7bc952da03c8
I20260928 01:55:40.023842 20629 raft_consensus.cc:515] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.019989 20546 ts_tablet_manager.cc:1916] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:40.027756 19896 raft_consensus.cc:740] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:40.028661 19896 consensus_queue.cc:260] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.031860 19592 tablet_service.cc:1511] Processing CreateTablet for tablet a82d3233e4514813b22121f75d11eebc (DEFAULT_TABLE table=default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.033515 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82d3233e4514813b22121f75d11eebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.035578 19444 tablet_service.cc:1511] Processing CreateTablet for tablet a82d3233e4514813b22121f75d11eebc (DEFAULT_TABLE table=default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.037688 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a753f894ae94b1eaf9b445df3545ded" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:40.038568 19619 raft_consensus.cc:2468] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:40.021171 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3741aec215343468b2d7bc952da03c8" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:40.050467 19766 raft_consensus.cc:2393] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:40.050288 19595 tablet_service.cc:1511] Processing CreateTablet for tablet 58c61408724e4a70b39e5dbdab9a3e8a (DEFAULT_TABLE table=default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.050202 19442 tablet_service.cc:1511] Processing CreateTablet for tablet 58c61408724e4a70b39e5dbdab9a3e8a (DEFAULT_TABLE table=default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.048579 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555e557370a4e92915a9c55107b573b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:40.051553 19595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c61408724e4a70b39e5dbdab9a3e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.050490 19734 tablet_service.cc:1511] Processing CreateTablet for tablet a82d3233e4514813b22121f75d11eebc (DEFAULT_TABLE table=default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.053146 19113 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]). Expected version 1 got 0
I20260928 01:55:40.053817 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82d3233e4514813b22121f75d11eebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.053968 19113 catalog_manager.cc:5838] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:55:40.051469 19476 raft_consensus.cc:3060] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:40.051697 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 58c61408724e4a70b39e5dbdab9a3e8a (DEFAULT_TABLE table=default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.056617 19553 leader_election.cc:304] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:40.057286 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c61408724e4a70b39e5dbdab9a3e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.058142 19704 leader_election.cc:304] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:40.061934 20419 raft_consensus.cc:2804] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 01:55:40.062183 19704 consensus_peers.cc:597] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78a71904514a488083426f5fe07d12cd. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:40.062482 20419 raft_consensus.cc:493] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:40.063117 20419 raft_consensus.cc:3060] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:40.064078 20416 raft_consensus.cc:3060] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:40.069345 19115 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_f21cff877b0c4aa6a48ec21efd04117d"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:40.070904 19115 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f21cff877b0c4aa6a48ec21efd04117d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:40.072178 19739 tablet_service.cc:1511] Processing CreateTablet for tablet fa3b9ec9f88342c0aa77c0fc92d26205 (DEFAULT_TABLE table=default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.056151 19113 catalog_manager.cc:5838] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:40.073325 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3b9ec9f88342c0aa77c0fc92d26205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.077122 20397 consensus_queue.cc:1048] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:40.078307 19445 tablet_service.cc:1511] Processing CreateTablet for tablet fa3b9ec9f88342c0aa77c0fc92d26205 (DEFAULT_TABLE table=default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.081575 19591 tablet_service.cc:1511] Processing CreateTablet for tablet fa3b9ec9f88342c0aa77c0fc92d26205 (DEFAULT_TABLE table=default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.083213 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3b9ec9f88342c0aa77c0fc92d26205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.085611 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 22e095aba1cb4fb7be461d625a922751 (DEFAULT_TABLE table=default.Table_a79e352afb4447d2a5ecb0abeac39b50 [id=f4d5240f021d40ceabce7bc7f3ff64f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.086706 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e095aba1cb4fb7be461d625a922751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.083886 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 22e095aba1cb4fb7be461d625a922751 (DEFAULT_TABLE table=default.Table_a79e352afb4447d2a5ecb0abeac39b50 [id=f4d5240f021d40ceabce7bc7f3ff64f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.097267 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e095aba1cb4fb7be461d625a922751. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:40.115307 20603 log.cc:927] Time spent T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260928 01:55:40.121243 19111 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_3a049c9dbf754d8994b690962634821c"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:40.123150 19111 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a049c9dbf754d8994b690962634821c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:40.124994 19114 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_25f5d9bf8f154b87b16032e2ce9ec169" } new_table_name: "default.Table_9499fd7d814b4e8c9bdadad20f2c6e24" modify_external_catalogs: true
I20260928 01:55:39.966691 20511 raft_consensus.cc:515] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.137739 19110 master_service.cc:960] ReplaceTablet: received request to replace tablet 7a753f894ae94b1eaf9b445df3545ded from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:40.141531 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:40.141849 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:39.969056 20502 tablet_replica.cc:333] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:39.982976 20543 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:40.143966 20543 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:40.146304 19553 leader_election.cc:343] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:40.147076 20543 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:40.142549 19468 raft_consensus.cc:2468] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:40.151649 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82d3233e4514813b22121f75d11eebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.153775 19442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c61408724e4a70b39e5dbdab9a3e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.154831 20502 raft_consensus.cc:2243] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:40.155323 20502 pending_rounds.cc:70] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614: Trying to abort 1 pending ops.
I20260928 01:55:40.155548 20502 pending_rounds.cc:77] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135967632560128 op_type: NO_OP noop_request { }
I20260928 01:55:40.155886 20502 raft_consensus.cc:2889] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:40.156260 20502 raft_consensus.cc:2272] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:40.158903 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:40.161118 19896 ts_tablet_manager.cc:1434] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.201s	user 0.004s	sys 0.002s
I20260928 01:55:40.162230 19112 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 3c6cfc9ff3344a48b09730dfde79d6cf
I20260928 01:55:40.163658 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3b9ec9f88342c0aa77c0fc92d26205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.168154 19118 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 49a73835e2854976b40b31fe752d1b1b
I20260928 01:55:40.168952 19441 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c6cfc9ff3344a48b09730dfde79d6cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:40.170099 19441 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73835e2854976b40b31fe752d1b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:40.173137 19409 leader_election.cc:343] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:40.179395 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c6cfc9ff3344a48b09730dfde79d6cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:40.180474 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73835e2854976b40b31fe752d1b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:40.197983 20642 consensus_queue.cc:1048] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:40.197877 19441 tablet_service.cc:1511] Processing CreateTablet for tablet 22e095aba1cb4fb7be461d625a922751 (DEFAULT_TABLE table=default.Table_a79e352afb4447d2a5ecb0abeac39b50 [id=f4d5240f021d40ceabce7bc7f3ff64f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.199635 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e095aba1cb4fb7be461d625a922751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.202312 19476 raft_consensus.cc:2468] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:40.211061 20502 ts_tablet_manager.cc:1916] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:40.213775 19112 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_a79e352afb4447d2a5ecb0abeac39b50" } new_table_name: "default.Table_3632814358374786adf52342b1b0faa6" modify_external_catalogs: true
I20260928 01:55:40.221588 19599 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c6cfc9ff3344a48b09730dfde79d6cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:40.222756 19599 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73835e2854976b40b31fe752d1b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:40.223518 19556 leader_election.cc:304] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:40.224864 20249 raft_consensus.cc:2804] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:40.225440 20249 raft_consensus.cc:493] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:40.226006 20249 raft_consensus.cc:3060] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:40.229231 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_4b4e44db885449ab825bbb51793b20b8"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:40.230938 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b4e44db885449ab825bbb51793b20b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:40.234109 19556 consensus_peers.cc:597] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:40.235613 20630 leader_election.cc:290] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:40.244375 20603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=5 ignored=0} inserts{seen=5 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260928 01:55:40.214411 20419 raft_consensus.cc:515] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.246403 19734 tablet_service.cc:1511] Processing CreateTablet for tablet fc428ccbf88e4d5cbae197cb67e9a0a5 (DEFAULT_TABLE table=default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.250675 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc428ccbf88e4d5cbae197cb67e9a0a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.253978 19115 master_service.cc:960] ReplaceTablet: received request to replace tablet 90b3c947794c48daaacc299a7d2dd4a9 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:40.270704 20419 leader_election.cc:290] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:40.271385 19110 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 7a753f894ae94b1eaf9b445df3545ded
I20260928 01:55:40.273046 19110 catalog_manager.cc:6934] ReplaceTablet: tablet 7a753f894ae94b1eaf9b445df3545ded deleted and replaced by tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7
I20260928 01:55:40.275377 19450 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a753f894ae94b1eaf9b445df3545ded with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:40.277827 20647 tablet.cc:1751] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:40.279755 19738 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a753f894ae94b1eaf9b445df3545ded with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:40.279883 20629 leader_election.cc:290] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:40.287146 20029 tablet_bootstrap.cc:492] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:40.287707 20029 ts_tablet_manager.cc:1403] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.544s	user 0.009s	sys 0.009s
I20260928 01:55:40.296983 19896 tablet_bootstrap.cc:492] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:40.296944 20603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Bootstrap complete.
I20260928 01:55:40.297403 19450 tablet_service.cc:1511] Processing CreateTablet for tablet fc428ccbf88e4d5cbae197cb67e9a0a5 (DEFAULT_TABLE table=default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.306008 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc428ccbf88e4d5cbae197cb67e9a0a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.319257 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a753f894ae94b1eaf9b445df3545ded" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:40.320243 19615 raft_consensus.cc:3060] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:40.331724 19599 tablet_service.cc:1511] Processing CreateTablet for tablet fc428ccbf88e4d5cbae197cb67e9a0a5 (DEFAULT_TABLE table=default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:40.332916 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc428ccbf88e4d5cbae197cb67e9a0a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:40.334904 19593 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a753f894ae94b1eaf9b445df3545ded with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:40.337862 19111 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_d8b6b2e3f5d241a6a28ca8323b931963"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:40.339432 19111 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8b6b2e3f5d241a6a28ca8323b931963 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:40.368023 19112 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 22e095aba1cb4fb7be461d625a922751 consensus state has no leader
I20260928 01:55:40.382043 19112 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_87c7744e9ee94b63a143377632aaf826" } modify_external_catalogs: true
I20260928 01:55:40.381878 19110 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_afb010e90b6043fa847287a414f51965"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:40.382990 19117 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_882a0296b9ba49ef94e01ab6602cfa6e" } modify_external_catalogs: true
I20260928 01:55:40.383490 19117 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_882a0296b9ba49ef94e01ab6602cfa6e" } modify_external_catalogs: true
I20260928 01:55:40.384183 19112 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_87c7744e9ee94b63a143377632aaf826" } modify_external_catalogs: true
W20260928 01:55:40.383659 19110 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afb010e90b6043fa847287a414f51965 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:40.392871 20648 tablet.cc:1751] T 8dc9a1c5be7c4e519f1415ba70397f01 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:40.394918 19615 raft_consensus.cc:2468] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:40.413146 20416 raft_consensus.cc:2749] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:40.415122 19704 leader_election.cc:304] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:40.416090 20638 raft_consensus.cc:2804] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:40.348973 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:40.416770 20638 raft_consensus.cc:697] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:40.418239 20638 consensus_queue.cc:237] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.417729 20597 consensus_queue.cc:1048] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
W20260928 01:55:40.456075 19412 leader_election.cc:343] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:40.350814 20511 leader_election.cc:290] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:40.456619 19412 leader_election.cc:304] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:40.457873 20543 raft_consensus.cc:2749] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:40.556224 19115 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 90b3c947794c48daaacc299a7d2dd4a9
I20260928 01:55:40.557847 19115 catalog_manager.cc:6934] ReplaceTablet: tablet 90b3c947794c48daaacc299a7d2dd4a9 deleted and replaced by tablet 21906a8380e64d95b9454a57fc01c6f0
I20260928 01:55:40.434837 20629 consensus_queue.cc:1048] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.129s
I20260928 01:55:40.562922 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b3c947794c48daaacc299a7d2dd4a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 21906a8380e64d95b9454a57fc01c6f0) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:40.563268 19442 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b3c947794c48daaacc299a7d2dd4a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 21906a8380e64d95b9454a57fc01c6f0) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:40.520328 20029 raft_consensus.cc:359] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.567443 20029 raft_consensus.cc:385] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:40.567687 20029 raft_consensus.cc:740] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:40.568429 20029 consensus_queue.cc:260] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.434470 19703 leader_election.cc:304] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:40.572738 19109 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]). Expected version 1 got 0
I20260928 01:55:40.580865 19109 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:40.542567 20502 ts_tablet_manager.cc:1929] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:40.585456 20502 log.cc:1199] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/03bbed8181084cb88b7d33976c20fbb8
I20260928 01:55:40.589154 20029 ts_tablet_manager.cc:1434] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.301s	user 0.001s	sys 0.005s
I20260928 01:55:40.590237 20029 tablet_bootstrap.cc:492] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:40.590734 19111 master_service.cc:960] ReplaceTablet: received request to replace tablet eac01fc222dd480cbed7cac37a0e6693 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:40.592988 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699e0d862fa4a54bbd756625f4e692b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:40.593844 19473 raft_consensus.cc:2468] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:40.585848 19109 catalog_manager.cc:5838] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:55:40.594105 20502 ts_tablet_manager.cc:1950] T 03bbed8181084cb88b7d33976c20fbb8 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:40.597249 19115 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_4b4e44db885449ab825bbb51793b20b8" } new_table_name: "default.Table_9e79b25f560e44bca5607e4c4fc8e796" modify_external_catalogs: true
W20260928 01:55:40.606841 19595 consensus_meta.cc:287] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.000s
I20260928 01:55:40.612835 19896 tablet_bootstrap.cc:654] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:40.624491 19739 consensus_meta.cc:287] T fa3b9ec9f88342c0aa77c0fc92d26205 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
I20260928 01:55:40.632551 20397 raft_consensus.cc:2804] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
W20260928 01:55:40.632688 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 198286us
I20260928 01:55:40.633095 20397 raft_consensus.cc:697] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:40.633901 20397 consensus_queue.cc:237] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.639318 19890 tablet_bootstrap.cc:492] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:40.639825 19890 ts_tablet_manager.cc:1403] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.819s	user 0.024s	sys 0.018s
I20260928 01:55:40.639650 19703 leader_election.cc:304] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:40.585318 20603 raft_consensus.cc:359] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 1 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:40.646042 19896 tablet_bootstrap.cc:492] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:40.646548 19896 ts_tablet_manager.cc:1403] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.350s	user 0.016s	sys 0.006s
I20260928 01:55:40.650134 19896 raft_consensus.cc:359] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.606464 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_ddbcac614715444489f6c4c34729a577"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:40.656275 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddbcac614715444489f6c4c34729a577 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:40.652232 20630 raft_consensus.cc:2804] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:40.658882 20630 raft_consensus.cc:493] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:40.659236 20630 raft_consensus.cc:3060] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:40.609294 19112 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 2947bd3e17ae4c1eb9e2c2aa1dc2cb05
I20260928 01:55:40.599711 19109 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:40.664804 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a753f894ae94b1eaf9b445df3545ded" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:40.665445 19473 raft_consensus.cc:3060] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:40.666421 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 193) took 1037 ms. Trace:
I20260928 01:55:40.666960 20502 rpcz_store.cc:276] 0928 01:55:39.629382 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.629569 (+   187us) service_pool.cc:224] Handling call
0928 01:55:39.968839 (+339270us) ts_tablet_manager.cc:1151] Deleting tablet 03bbed8181084cb88b7d33976c20fbb8
0928 01:55:39.968897 (+    58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:40.499631 (+530734us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:40.542259 (+ 42628us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:40.666342 (+124083us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":338438}
I20260928 01:55:40.669502 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 03bbed8181084cb88b7d33976c20fbb8 (table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]) successfully deleted
W20260928 01:55:40.672713 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 3c6cfc9ff3344a48b09730dfde79d6cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c6cfc9ff3344a48b09730dfde79d6cf already in progress: creating tablet
I20260928 01:55:40.674645 19109 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:40.675721 19109 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:55:40.691500 19117 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet b699e0d862fa4a54bbd756625f4e692b
W20260928 01:55:40.695749 19115 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2018f8b52f974554924f9ecfbd5a0f51 has no consensus state
I20260928 01:55:40.696034 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet b699e0d862fa4a54bbd756625f4e692b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:40.698253 19111 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet eac01fc222dd480cbed7cac37a0e6693
I20260928 01:55:40.700697 19111 catalog_manager.cc:6934] ReplaceTablet: tablet eac01fc222dd480cbed7cac37a0e6693 deleted and replaced by tablet 522245da435b40ae84ae6dc5d19a2e95
W20260928 01:55:40.707653 19113 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 23) took 1586 ms (client timeout 1000 ms). Trace:
I20260928 01:55:40.713369 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a753f894ae94b1eaf9b445df3545ded" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:40.729374 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_9e79b25f560e44bca5607e4c4fc8e796 [id=7eb30362c50d4a2ea2e7a2a1990a996b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2018f8b52f974554924f9ecfbd5a0f51 has no consensus state
I20260928 01:55:40.730953 19896 raft_consensus.cc:385] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:40.731366 19896 raft_consensus.cc:740] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:40.733103 19896 consensus_queue.cc:260] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.739869 19896 ts_tablet_manager.cc:1434] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.001s
I20260928 01:55:40.760767 19115 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_bb3b0337b3684b9caf534914d16688bc"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:40.761467 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_1d52c0fdbf6f457199204d44bfe9a304"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:40.762578 19115 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb3b0337b3684b9caf534914d16688bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:40.763048 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d52c0fdbf6f457199204d44bfe9a304 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:40.708184 19113 rpcz_store.cc:269] 0928 01:55:39.120888 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.121035 (+   147us) service_pool.cc:224] Handling call
0928 01:55:39.185438 (+ 64403us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:40.707571 (+1522133us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:40.135918 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:40.136741 (+   823us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:40.136795 (+    54us) write_op.cc:435] Acquired schema lock
0928 01:55:40.136808 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:40.140762 (+  3954us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:40.140827 (+    65us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:40.140886 (+    59us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:40.141376 (+   490us) tablet.cc:701] Row locks acquired
0928 01:55:40.141409 (+    33us) write_op.cc:260] PREPARE: finished
0928 01:55:40.141602 (+   193us) write_op.cc:270] Start()
0928 01:55:40.141759 (+   157us) write_op.cc:276] Timestamp: P: 1790560540141518 usec, L: 0
0928 01:55:40.141808 (+    49us) op_driver.cc:348] REPLICATION: starting
0928 01:55:40.150079 (+  8271us) log.cc:844] Serialized 907 byte log entry
0928 01:55:40.220928 (+ 70849us) op_driver.cc:464] REPLICATION: finished
0928 01:55:40.221915 (+   987us) write_op.cc:301] APPLY: starting
0928 01:55:40.221999 (+    84us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:40.222174 (+   175us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:40.222287 (+   113us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:40.222699 (+   412us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:40.222945 (+   246us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:40.223017 (+    72us) write_op.cc:312] APPLY: finished
0928 01:55:40.223263 (+   246us) log.cc:844] Serialized 29 byte log entry
0928 01:55:40.223470 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:40.223571 (+   101us) write_op.cc:454] Released schema lock
0928 01:55:40.223616 (+    45us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:40.223991 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:40.224030 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"spinlock_wait_cycles":141540736,"child_traces":[["op",{"apply.queue_time_us":768,"apply.run_cpu_time_us":2010,"apply.run_wall_time_us":2009,"mutex_wait_us":26190,"num_ops":2,"prepare.queue_time_us":59839,"prepare.run_cpu_time_us":3733,"prepare.run_wall_time_us":49019,"replication_time_us":78909,"spinlock_wait_cycles":67840}]]}
I20260928 01:55:40.815307 20603 raft_consensus.cc:740] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e48edd841a42d08a480be209f0d294, State: Initialized, Role: FOLLOWER
I20260928 01:55:40.822913 20147 ts_tablet_manager.cc:1929] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:40.823426 20147 log.cc:1199] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/599ef1523fcf43d1a1e2a91f03abaa60
I20260928 01:55:40.824298 20147 ts_tablet_manager.cc:1950] T 599ef1523fcf43d1a1e2a91f03abaa60 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:40.827834 19890 raft_consensus.cc:359] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.840808 19890 raft_consensus.cc:385] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:40.841177 19890 raft_consensus.cc:740] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:40.842032 19890 consensus_queue.cc:260] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.843840 20603 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:40.845126 19896 tablet_bootstrap.cc:492] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:40.778117 20249 consensus_meta.cc:287] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
I20260928 01:55:40.852860 20249 raft_consensus.cc:515] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.856604 20249 leader_election.cc:290] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:40.856973 20663 tablet.cc:1751] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:40.864364 19118 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_deb7dc16f0794afd95d9f29bed3a5621" } modify_external_catalogs: true
I20260928 01:55:40.864926 19118 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_deb7dc16f0794afd95d9f29bed3a5621" } modify_external_catalogs: true
I20260928 01:55:40.686151 20029 tablet_bootstrap.cc:654] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:40.793180 19739 tablet_service.cc:1558] Processing DeleteTablet for tablet b699e0d862fa4a54bbd756625f4e692b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:40.704900 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet eac01fc222dd480cbed7cac37a0e6693 with delete_type TABLET_DATA_DELETED (replaced by tablet 522245da435b40ae84ae6dc5d19a2e95) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:40.784586 19738 tablet_service.cc:1558] Processing DeleteTablet for tablet 599ef1523fcf43d1a1e2a91f03abaa60 with delete_type TABLET_DATA_DELETED (replaced by tablet 502c0f4e07ff4479af8d33c99031b6fc) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:40.877290 19473 raft_consensus.cc:2468] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:40.724287 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet f3741aec215343468b2d7bc952da03c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:40.880385 19116 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:40.881170 19116 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]). Expected version 1 got 0
I20260928 01:55:40.885454 19441 tablet_service.cc:1558] Processing DeleteTablet for tablet eac01fc222dd480cbed7cac37a0e6693 with delete_type TABLET_DATA_DELETED (replaced by tablet 522245da435b40ae84ae6dc5d19a2e95) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:40.892323 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_e1827a496ab34ee084c0c605b5c205da"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:40.894230 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1827a496ab34ee084c0c605b5c205da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:40.897132 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 49a73835e2854976b40b31fe752d1b1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49a73835e2854976b40b31fe752d1b1b already in progress: creating tablet
I20260928 01:55:40.900648 19115 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_542dd0839d9f40ed942c4e1ab3e12098" } modify_external_catalogs: true
I20260928 01:55:40.900475 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_df1a47a6c1694b6aae398d41b675186e"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:40.901121 19115 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_542dd0839d9f40ed942c4e1ab3e12098" } modify_external_catalogs: true
W20260928 01:55:40.902030 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df1a47a6c1694b6aae398d41b675186e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:40.904660 19112 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_001856018a3743328c46c694f06bb065" } new_table_name: "default.Table_b5d200ca309a4ce18e782fb38b238e19" modify_external_catalogs: true
I20260928 01:55:40.908540 20502 tablet_replica.cc:333] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:40.909999 20502 raft_consensus.cc:2243] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:40.910674 20502 raft_consensus.cc:2272] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:40.914983 19118 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 8a5e07078b2a4fe59d9293d9511cbb6b
I20260928 01:55:40.923940 19896 tablet_bootstrap.cc:654] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:40.875257 19890 ts_tablet_manager.cc:1434] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.235s	user 0.008s	sys 0.000s
I20260928 01:55:40.926410 20543 raft_consensus.cc:493] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:40.927084 20543 raft_consensus.cc:515] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:40.932430 20543 leader_election.cc:290] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:40.934147 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 155) took 3450 ms. Trace:
I20260928 01:55:40.934599 20147 rpcz_store.cc:276] 0928 01:55:37.484170 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:37.541315 (+ 57145us) service_pool.cc:224] Handling call
0928 01:55:39.815843 (+2274528us) ts_tablet_manager.cc:1151] Deleting tablet 599ef1523fcf43d1a1e2a91f03abaa60
0928 01:55:39.815882 (+    39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:40.242395 (+426513us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:40.822780 (+580385us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:40.934070 (+111290us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2245717}
I20260928 01:55:40.936223 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 159) took 3035 ms. Trace:
I20260928 01:55:40.936586 20147 rpcz_store.cc:276] 0928 01:55:37.901109 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:37.919265 (+ 18156us) service_pool.cc:224] Handling call
0928 01:55:40.935835 (+3016570us) ts_tablet_manager.cc:1151] Deleting tablet c1f73a301c84482f897990ac5e5dd162
0928 01:55:40.935893 (+    58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:40.936146 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3015388}
I20260928 01:55:40.944417 19441 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5e07078b2a4fe59d9293d9511cbb6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:40.950460 20502 ts_tablet_manager.cc:1916] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:40.968726 19118 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_ddbcac614715444489f6c4c34729a577" } new_table_name: "default.Table_74bbe86cdce246d29f4ea5a04ca9809c" modify_external_catalogs: true
W20260928 01:55:40.990483 19112 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 65fdc8575c7440ffbf5c7c4db5d4b35e consensus state has no leader
I20260928 01:55:40.992079 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_a9b783bb4d0246458d41b4a1a5d99a20"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:40.816802 19813 heartbeater.cc:499] Master 127.18.161.60:39095 was elected leader, sending a full tablet report...
W20260928 01:55:40.994238 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9b783bb4d0246458d41b4a1a5d99a20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:41.002514 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 165) took 2622 ms. Trace:
I20260928 01:55:40.942492 19890 tablet_bootstrap.cc:492] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:40.858523 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:41.017527 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5e07078b2a4fe59d9293d9511cbb6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:44964
W20260928 01:55:41.020709 19118 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 897503329be649e38473561cea1fdaf1 has no consensus state
I20260928 01:55:41.025295 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edf7a5d724c88992fecbadd2cedfa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:40.993696 20630 raft_consensus.cc:515] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.028959 20630 leader_election.cc:290] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:41.031193 20543 raft_consensus.cc:493] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:55:41.025295 20668 log.cc:927] Time spent T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260928 01:55:41.031821 20543 raft_consensus.cc:515] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.040803 20546 ts_tablet_manager.cc:1929] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:41.041348 20546 log.cc:1199] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/7bfcdfe218414396824a8f3af4d673ff
I20260928 01:55:41.042331 20546 ts_tablet_manager.cc:1950] T 7bfcdfe218414396824a8f3af4d673ff P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:41.047678 20603 sys_catalog.cc:565] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 01:55:41.043330 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 180) took 2788 ms. Trace:
I20260928 01:55:41.050172 20546 rpcz_store.cc:276] 0928 01:55:38.254627 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.256077 (+  1450us) service_pool.cc:224] Handling call
0928 01:55:39.778860 (+1522783us) ts_tablet_manager.cc:1151] Deleting tablet 7bfcdfe218414396824a8f3af4d673ff
0928 01:55:39.778938 (+    78us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:40.543819 (+764881us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:41.040619 (+496800us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:41.043248 (+  2629us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99397,"tablet-delete.queue_time_us":1469846}
I20260928 01:55:41.041504 20147 rpcz_store.cc:276] 0928 01:55:38.380011 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.384305 (+  4294us) service_pool.cc:224] Handling call
0928 01:55:41.002218 (+2617913us) ts_tablet_manager.cc:1151] Deleting tablet eaa1e9b7119d46a2ba2652a893877c8c
0928 01:55:41.002264 (+    46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:41.002449 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2617375}
I20260928 01:55:41.054414 20543 leader_election.cc:290] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:41.059270 19553 leader_election.cc:343] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:41.059718 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 599ef1523fcf43d1a1e2a91f03abaa60 (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]) successfully deleted
W20260928 01:55:41.075279 19116 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 34) took 1354 ms (client timeout 1000 ms). Trace:
W20260928 01:55:41.075659 19116 rpcz_store.cc:269] 0928 01:55:39.720514 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.741625 (+ 21111us) service_pool.cc:224] Handling call
0928 01:55:41.075205 (+1333580us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":11}
W20260928 01:55:41.064064 19409 leader_election.cc:343] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:41.083258 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:41.084139 19764 raft_consensus.cc:2468] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:41.092515 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 166) took 2712 ms. Trace:
I20260928 01:55:41.093191 20147 rpcz_store.cc:276] 0928 01:55:38.380411 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.384935 (+  4524us) service_pool.cc:224] Handling call
0928 01:55:41.055698 (+2670763us) ts_tablet_manager.cc:1151] Deleting tablet 05f875e126f04415a108f778a76bb0f5
0928 01:55:41.092156 (+ 36458us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:41.092440 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2670049}
I20260928 01:55:41.094802 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 167) took 2714 ms. Trace:
I20260928 01:55:41.097821 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 7bfcdfe218414396824a8f3af4d673ff (table default.Table_ef217ae2f1514ce99c1f8993333e2ec6 [id=2a9bea4b8e2a4df68e6bc995f08258b1]) successfully deleted
I20260928 01:55:41.098959 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_25d654f0414f40418a69e57185765938"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:41.099406 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 104622us
W20260928 01:55:41.101845 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25d654f0414f40418a69e57185765938 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:41.103523 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699e0d862fa4a54bbd756625f4e692b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:41.104523 20546 tablet_replica.cc:333] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:40.722579 20638 consensus_queue.cc:1048] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.374s
W20260928 01:55:41.120450 20676 log.cc:927] Time spent T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260928 01:55:41.120447 19704 leader_election.cc:343] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:41.128779 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edf7a5d724c88992fecbadd2cedfa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:41.130302 20029 tablet_bootstrap.cc:492] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:41.130842 20029 ts_tablet_manager.cc:1403] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.541s	user 0.015s	sys 0.012s
I20260928 01:55:41.131161 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:41.132081 19619 raft_consensus.cc:2468] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:41.134711 19890 tablet_bootstrap.cc:654] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:41.136104 19117 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_501342eaebce40d1a76ace4b05f022fd" } modify_external_catalogs: true
I20260928 01:55:41.136798 19117 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_501342eaebce40d1a76ace4b05f022fd" } modify_external_catalogs: true
I20260928 01:55:41.142105 20546 raft_consensus.cc:2243] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:41.095268 20147 rpcz_store.cc:276] 0928 01:55:38.380889 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.385718 (+  4829us) service_pool.cc:224] Handling call
0928 01:55:41.094525 (+2708807us) ts_tablet_manager.cc:1151] Deleting tablet 027f99abaacc4c169661e7db08512ebd
0928 01:55:41.094571 (+    46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:41.094740 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2708236}
I20260928 01:55:41.136297 19591 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b3c947794c48daaacc299a7d2dd4a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 21906a8380e64d95b9454a57fc01c6f0) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:41.150221 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet b699e0d862fa4a54bbd756625f4e692b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:41.153144 20147 tablet_replica.cc:333] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:41.154775 20147 raft_consensus.cc:2243] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:41.157527 20546 pending_rounds.cc:70] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: Trying to abort 1 pending ops.
I20260928 01:55:41.161020 20546 pending_rounds.cc:77] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135962305921024 op_type: NO_OP noop_request { }
I20260928 01:55:41.161935 20546 raft_consensus.cc:2889] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:41.162711 20546 raft_consensus.cc:2272] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:41.166184 20546 ts_tablet_manager.cc:1916] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:55:41.168906 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet c1f73a301c84482f897990ac5e5dd162 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1f73a301c84482f897990ac5e5dd162 already in progress: creating tablet
W20260928 01:55:41.170214 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet eaa1e9b7119d46a2ba2652a893877c8c because the tablet was not found. No further retry: Not found: Tablet not found: eaa1e9b7119d46a2ba2652a893877c8c
I20260928 01:55:41.178187 19896 tablet_bootstrap.cc:492] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:41.178685 19896 ts_tablet_manager.cc:1403] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.334s	user 0.006s	sys 0.011s
W20260928 01:55:41.179474 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 96161us
I20260928 01:55:41.181039 19409 leader_election.cc:304] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:41.158547 20029 raft_consensus.cc:359] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.155383 19595 tablet_service.cc:1558] Processing DeleteTablet for tablet eac01fc222dd480cbed7cac37a0e6693 with delete_type TABLET_DATA_DELETED (replaced by tablet 522245da435b40ae84ae6dc5d19a2e95) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:41.191722 20029 raft_consensus.cc:385] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:41.160686 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5e07078b2a4fe59d9293d9511cbb6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:41.192076 20029 raft_consensus.cc:740] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:41.166838 19591 tablet_service.cc:1558] Processing DeleteTablet for tablet 78a71904514a488083426f5fe07d12cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:41.168047 19599 tablet_service.cc:1558] Processing DeleteTablet for tablet f3741aec215343468b2d7bc952da03c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:41.192905 20029 consensus_queue.cc:260] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.174819 20249 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:41.176982 20648 tablet.cc:1751] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 4 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 5
I20260928 01:55:41.194101 20147 raft_consensus.cc:2272] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:41.195356 20675 raft_consensus.cc:2804] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:55:41.195851 20675 raft_consensus.cc:493] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:41.195393 20249 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.196403 20675 raft_consensus.cc:3060] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:41.196835 19118 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_9e19d07c34de4423843f6dd98c821031" } new_table_name: "default.Table_57636f8d4c454189ba0a963e19e86f1f" modify_external_catalogs: true
I20260928 01:55:41.199674 20249 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:41.120640 20543 raft_consensus.cc:493] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:41.200773 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_ddff92897f304d37977d573dfe022549"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:41.200582 20543 raft_consensus.cc:515] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:41.202457 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddff92897f304d37977d573dfe022549 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:41.203173 20029 ts_tablet_manager.cc:1434] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.003s
I20260928 01:55:41.200894 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:41.205443 20543 leader_election.cc:290] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:41.205601 19553 leader_election.cc:343] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:41.214039 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 05f875e126f04415a108f778a76bb0f5 because the tablet was not found. No further retry: Not found: Tablet not found: 05f875e126f04415a108f778a76bb0f5
W20260928 01:55:41.215631 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 027f99abaacc4c169661e7db08512ebd because the tablet was not found. No further retry: Not found: Tablet not found: 027f99abaacc4c169661e7db08512ebd
W20260928 01:55:41.216648 19412 leader_election.cc:343] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:41.217094 19412 leader_election.cc:304] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:41.221865 20543 raft_consensus.cc:2749] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:41.225751 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:41.226565 19470 raft_consensus.cc:3060] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:41.230489 20147 ts_tablet_manager.cc:1916] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:41.230608 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699e0d862fa4a54bbd756625f4e692b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:41.231341 19472 raft_consensus.cc:3060] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:41.234589 19116 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_afb010e90b6043fa847287a414f51965" } new_table_name: "default.Table_662047afe0034f4fb6ba274ef435e974" modify_external_catalogs: true
W20260928 01:55:41.255662 19118 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0287060a8d054b15b2252dcf280ca8c2 consensus state has no leader
I20260928 01:55:41.258347 20029 tablet_bootstrap.cc:492] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:55:41.261794 19703 consensus_peers.cc:597] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:41.261924 20511 consensus_queue.cc:1048] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:41.265878 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86825485bfca479ea63c1a99dddb68d6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:41.267560 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:41.268496 19475 raft_consensus.cc:2468] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
W20260928 01:55:41.270818 19412 leader_election.cc:343] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:41.278954 19890 tablet_bootstrap.cc:492] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:41.279510 19890 ts_tablet_manager.cc:1403] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.337s	user 0.006s	sys 0.010s
I20260928 01:55:41.282508 19890 raft_consensus.cc:359] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.290486 20681 tablet.cc:1751] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 4 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 5
I20260928 01:55:41.292582 20630 raft_consensus.cc:493] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:41.293309 20630 raft_consensus.cc:515] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.314040 20029 tablet_bootstrap.cc:654] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:41.315833 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_84d77c64cf0041c38f3b44f7f3ee8e7a"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:41.317642 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84d77c64cf0041c38f3b44f7f3ee8e7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:41.297446 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71e2109f8cd4dd4a288fbdc8e50b133" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:41.321604 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_4da1fee6daf34cb38d91b8fc6aa55ada"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:41.308908 19556 leader_election.cc:304] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:41.323319 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4da1fee6daf34cb38d91b8fc6aa55ada in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:41.323647 20665 raft_consensus.cc:2804] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:41.324101 20665 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:41.324577 20665 raft_consensus.cc:3060] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:41.326314 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 55526.4us
W20260928 01:55:41.272964 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 92008.7us
I20260928 01:55:41.275461 19896 raft_consensus.cc:359] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.326963 19896 raft_consensus.cc:385] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:41.327256 19896 raft_consensus.cc:740] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:41.327929 19896 consensus_queue.cc:260] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.335131 20665 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.337769 19896 ts_tablet_manager.cc:1434] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.159s	user 0.007s	sys 0.000s
I20260928 01:55:41.336534 19890 raft_consensus.cc:385] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:41.341660 19890 raft_consensus.cc:740] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:41.341883 19896 tablet_bootstrap.cc:492] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:41.320470 20630 leader_election.cc:290] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:41.322420 19704 leader_election.cc:343] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:41.328147 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86825485bfca479ea63c1a99dddb68d6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:41.349171 19116 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11a7c70dba4e4b3b97104b5d65704b9d has no consensus state
I20260928 01:55:41.341881 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:55:41.349980 19409 leader_election.cc:343] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:41.351176 19553 leader_election.cc:343] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:41.350384 19409 leader_election.cc:304] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:41.352794 20543 raft_consensus.cc:2749] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:41.354897 19890 consensus_queue.cc:260] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.365008 20511 raft_consensus.cc:493] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:41.365485 20511 raft_consensus.cc:515] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.371268 20511 leader_election.cc:290] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:41.371083 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699e0d862fa4a54bbd756625f4e692b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:41.317245 19470 raft_consensus.cc:2468] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:41.321269 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71e2109f8cd4dd4a288fbdc8e50b133" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:41.372272 19766 raft_consensus.cc:2393] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:41.372722 19475 raft_consensus.cc:2468] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:41.374210 19703 leader_election.cc:304] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:41.375309 20630 raft_consensus.cc:2804] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:41.375547 20665 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:41.375734 20630 raft_consensus.cc:493] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:41.376165 20630 raft_consensus.cc:3060] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:41.379086 19472 raft_consensus.cc:2468] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:41.382309 19116 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_50e17dbd9fb049d783f55a70bc2d73af"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:41.384009 19116 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50e17dbd9fb049d783f55a70bc2d73af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:41.388293 19112 master_service.cc:960] ReplaceTablet: received request to replace tablet 58c61408724e4a70b39e5dbdab9a3e8a from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:41.389472 19556 leader_election.cc:304] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:41.390069 19890 ts_tablet_manager.cc:1434] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.110s	user 0.001s	sys 0.005s
I20260928 01:55:41.390677 20665 raft_consensus.cc:2804] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:41.392884 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:41.393476 19475 raft_consensus.cc:3060] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:41.397217 20665 raft_consensus.cc:697] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:41.398146 20665 consensus_queue.cc:237] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.410353 20029 tablet_bootstrap.cc:492] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:41.410868 20029 ts_tablet_manager.cc:1403] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.207s	user 0.016s	sys 0.000s
I20260928 01:55:41.410972 20502 ts_tablet_manager.cc:1929] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:41.411355 20502 log.cc:1199] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/7a753f894ae94b1eaf9b445df3545ded
I20260928 01:55:41.414354 20029 raft_consensus.cc:359] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.416797 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699e0d862fa4a54bbd756625f4e692b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:41.420560 19475 raft_consensus.cc:2468] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:41.421907 20675 raft_consensus.cc:515] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.416404 20634 consensus_queue.cc:1048] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:41.417152 19703 leader_election.cc:304] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:41.437644 19470 raft_consensus.cc:2393] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:41.439298 20634 raft_consensus.cc:2804] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:41.440050 20634 raft_consensus.cc:697] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:41.441329 20634 consensus_queue.cc:237] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.445164 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:41.445959 19766 raft_consensus.cc:3060] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:41.454034 20675 leader_election.cc:290] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:41.454972 19556 leader_election.cc:304] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:41.459968 19896 tablet_bootstrap.cc:654] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:41.461715 19556 leader_election.cc:304] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:41.399997 20630 raft_consensus.cc:515] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.464680 19113 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_65da2b5b91484f68b38861e046f9f883" } new_table_name: "default.Table_81323d2c6d8441fe93083d127876a785" modify_external_catalogs: true
I20260928 01:55:41.467586 20630 leader_election.cc:290] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:41.468338 20029 raft_consensus.cc:385] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:41.468653 20029 raft_consensus.cc:740] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:41.469432 20029 consensus_queue.cc:260] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.470690 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71e2109f8cd4dd4a288fbdc8e50b133" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:41.471526 19470 raft_consensus.cc:3060] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:41.473755 20029 ts_tablet_manager.cc:1434] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.063s	user 0.001s	sys 0.004s
I20260928 01:55:41.462428 19890 tablet_bootstrap.cc:492] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:41.412055 20502 ts_tablet_manager.cc:1950] T 7a753f894ae94b1eaf9b445df3545ded P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:41.359905 20553 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:41.489270 20147 ts_tablet_manager.cc:1929] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:41.489681 20147 log.cc:1199] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/7bfcdfe218414396824a8f3af4d673ff
I20260928 01:55:41.495031 20663 tablet.cc:1751] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 4 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 5
I20260928 01:55:41.508049 19116 master_service.cc:960] ReplaceTablet: received request to replace tablet 7602706a3fbc438d8d448c9ac057087c from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:41.516767 20147 ts_tablet_manager.cc:1950] T 7bfcdfe218414396824a8f3af4d673ff P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:41.517277 19813 heartbeater.cc:499] Master 127.18.161.60:39095 was elected leader, sending a full tablet report...
W20260928 01:55:41.520442 19113 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3505a502bff747deaf1e03c03375aafa consensus state has no leader
I20260928 01:55:41.520660 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 168) took 3139 ms. Trace:
I20260928 01:55:41.521003 20147 rpcz_store.cc:276] 0928 01:55:38.381234 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.386483 (+  5249us) service_pool.cc:224] Handling call
0928 01:55:41.152910 (+2766427us) ts_tablet_manager.cc:1151] Deleting tablet 7bfcdfe218414396824a8f3af4d673ff
0928 01:55:41.153008 (+    98us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:41.346523 (+193515us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:41.489124 (+142601us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:41.520600 (+ 31476us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2765199}
I20260928 01:55:41.523650 20634 raft_consensus.cc:493] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:41.523816 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_102a74c97b494487ba45f71e2608c6f6"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:41.524328 20634 raft_consensus.cc:515] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:41.527100 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_102a74c97b494487ba45f71e2608c6f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:41.528157 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:41.528999 19474 raft_consensus.cc:2393] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:41.529151 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 171) took 2869 ms. Trace:
I20260928 01:55:41.529475 20147 rpcz_store.cc:276] 0928 01:55:38.659939 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.660062 (+   123us) service_pool.cc:224] Handling call
0928 01:55:41.528884 (+2868822us) ts_tablet_manager.cc:1151] Deleting tablet ce41f63df46f4d0493ca22a13daadb4f
0928 01:55:41.528929 (+    45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:41.529092 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2861928}
I20260928 01:55:41.530486 20634 leader_election.cc:290] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:41.531329 20029 tablet_bootstrap.cc:492] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:41.537209 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 200) took 1262 ms. Trace:
I20260928 01:55:41.537703 20502 rpcz_store.cc:276] 0928 01:55:40.274948 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.275086 (+   138us) service_pool.cc:224] Handling call
0928 01:55:40.908286 (+633200us) ts_tablet_manager.cc:1151] Deleting tablet 7a753f894ae94b1eaf9b445df3545ded
0928 01:55:40.908351 (+    65us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:41.280703 (+372352us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:41.410832 (+130129us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:41.537141 (+126309us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":632395}
I20260928 01:55:41.549418 20502 tablet_replica.cc:333] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:41.549669 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 7a753f894ae94b1eaf9b445df3545ded (table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]) successfully deleted
I20260928 01:55:41.550467 20502 raft_consensus.cc:2243] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:41.551052 20502 raft_consensus.cc:2272] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:41.476222 19766 raft_consensus.cc:2468] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:55:41.563869 19118 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_4e2fdca3bbd348fa97286ef3e47f76ec" } new_table_name: "default.Table_f34e683b13dc44aaa660c13fb7f58531" modify_external_catalogs: true
I20260928 01:55:41.565116 19409 leader_election.cc:304] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:41.565889 20682 raft_consensus.cc:2804] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:55:41.566406 20682 raft_consensus.cc:697] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [term 2 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:41.567296 20682 consensus_queue.cc:237] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.435614 20546 ts_tablet_manager.cc:1929] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:41.572942 20546 log.cc:1199] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/5d9b93f45ccf44e785b00849e49c8294
I20260928 01:55:41.577364 20546 ts_tablet_manager.cc:1950] T 5d9b93f45ccf44e785b00849e49c8294 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:41.587680 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 183) took 3254 ms. Trace:
W20260928 01:55:41.596293 19118 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f709eccf4ab5413bbbd8b4746f185db4 consensus state has no leader
I20260928 01:55:41.597764 20502 ts_tablet_manager.cc:1916] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:41.601961 19896 tablet_bootstrap.cc:492] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:41.602432 19896 ts_tablet_manager.cc:1403] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.263s	user 0.012s	sys 0.004s
I20260928 01:55:41.603940 20546 rpcz_store.cc:276] 0928 01:55:38.332860 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.333048 (+   188us) service_pool.cc:224] Handling call
0928 01:55:41.095767 (+2762719us) ts_tablet_manager.cc:1151] Deleting tablet 5d9b93f45ccf44e785b00849e49c8294
0928 01:55:41.095833 (+    66us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:41.363004 (+267171us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:41.435432 (+ 72428us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:41.587588 (+152156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49663,"tablet-delete.queue_time_us":2761531}
I20260928 01:55:41.605185 19111 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]). Expected version 5 got 4
I20260928 01:55:41.610637 20630 raft_consensus.cc:493] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:41.611212 20630 raft_consensus.cc:515] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:41.610127 20546 tablet_replica.cc:333] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:41.532080 20147 tablet_replica.cc:333] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:41.617110 20147 raft_consensus.cc:2243] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:41.619738 19896 raft_consensus.cc:359] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.620457 19896 raft_consensus.cc:385] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:41.616066 20511 raft_consensus.cc:2804] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:41.625320 19112 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:55:41.627362 19112 catalog_manager.cc:6934] ReplaceTablet: tablet 58c61408724e4a70b39e5dbdab9a3e8a deleted and replaced by tablet 8df69eb3a37445ed8a2be0ef3bf32cdb
I20260928 01:55:41.630528 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:41.632166 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c61408724e4a70b39e5dbdab9a3e8a with delete_type TABLET_DATA_DELETED (replaced by tablet 8df69eb3a37445ed8a2be0ef3bf32cdb) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:41.635208 20511 raft_consensus.cc:697] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:41.637183 19441 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c61408724e4a70b39e5dbdab9a3e8a with delete_type TABLET_DATA_DELETED (replaced by tablet 8df69eb3a37445ed8a2be0ef3bf32cdb) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:41.640460 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71e2109f8cd4dd4a288fbdc8e50b133" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:41.641839 20511 consensus_queue.cc:237] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.642928 19470 raft_consensus.cc:2468] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:41.644716 19703 leader_election.cc:304] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:55:41.647032 19704 consensus_peers.cc:597] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:41.648561 20419 raft_consensus.cc:2804] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:41.649088 20419 raft_consensus.cc:697] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:41.650287 20419 consensus_queue.cc:237] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.647996 19704 leader_election.cc:304] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:41.659260 20630 leader_election.cc:290] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:41.661604 19896 raft_consensus.cc:740] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
W20260928 01:55:41.662931 19704 leader_election.cc:343] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:41.662601 19896 consensus_queue.cc:260] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.664754 20634 raft_consensus.cc:3060] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:41.665978 20029 tablet_bootstrap.cc:654] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:41.667573 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_f6031fcda0b346ff84e0b68824cb54b0"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:41.669248 20147 raft_consensus.cc:2272] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 01:55:41.670105 19703 leader_election.cc:343] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 90d40050f85a4d6c90a4ce35cf15d134
W20260928 01:55:41.669612 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6031fcda0b346ff84e0b68824cb54b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:41.678673 20147 ts_tablet_manager.cc:1916] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:55:41.683946 19704 leader_election.cc:343] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 90d40050f85a4d6c90a4ce35cf15d134
I20260928 01:55:41.688712 19111 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:41.688815 19441 tablet_service.cc:1511] Processing CreateTablet for tablet 5442dd0aa28545c8bcf3a0b977c71e98 (DEFAULT_TABLE table=default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.690120 19896 ts_tablet_manager.cc:1434] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.002s
I20260928 01:55:41.691581 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5442dd0aa28545c8bcf3a0b977c71e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.697069 19896 tablet_bootstrap.cc:492] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:41.706758 19114 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]). Expected version 1 got 0
I20260928 01:55:41.705967 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 5442dd0aa28545c8bcf3a0b977c71e98 (DEFAULT_TABLE table=default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.707607 19114 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]). Expected version 5 got 4
I20260928 01:55:41.693706 19704 leader_election.cc:304] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:41.712297 19116 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 7602706a3fbc438d8d448c9ac057087c
I20260928 01:55:41.712376 19114 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:41.713675 19114 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:41.714591 19116 catalog_manager.cc:6934] ReplaceTablet: tablet 7602706a3fbc438d8d448c9ac057087c deleted and replaced by tablet 4c6f4708c641414aa59f01703c86aaf1
I20260928 01:55:41.715325 19114 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]). Expected version 2 got 0
I20260928 01:55:41.715884 19114 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:41.719403 19117 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 7ab79c6ad03e481a903a0f95ae0512e6
I20260928 01:55:41.720074 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 7602706a3fbc438d8d448c9ac057087c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c6f4708c641414aa59f01703c86aaf1) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:41.722862 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ab79c6ad03e481a903a0f95ae0512e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:41 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:41.724928 20630 raft_consensus.cc:2749] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:55:41.695251 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 233594us
I20260928 01:55:41.726958 20546 raft_consensus.cc:2243] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:41.733223 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 7bfcdfe218414396824a8f3af4d673ff (table default.Table_ef217ae2f1514ce99c1f8993333e2ec6 [id=2a9bea4b8e2a4df68e6bc995f08258b1]) successfully deleted
W20260928 01:55:41.734025 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet ce41f63df46f4d0493ca22a13daadb4f because the tablet was not found. No further retry: Not found: Tablet not found: ce41f63df46f4d0493ca22a13daadb4f
I20260928 01:55:41.734316 20546 raft_consensus.cc:2272] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:41.735744 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ab79c6ad03e481a903a0f95ae0512e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:41 UTC) from {username='slave'} at 127.0.0.1:44964
W20260928 01:55:41.742586 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8a5e07078b2a4fe59d9293d9511cbb6b (table default.Table_deb7dc16f0794afd95d9f29bed3a5621 [id=0da09ac1dc794d82b6f9323d0196b4cc], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8a5e07078b2a4fe59d9293d9511cbb6b consensus state has no leader
I20260928 01:55:41.742519 19445 tablet_service.cc:1511] Processing CreateTablet for tablet 202f1ead822548a2bbeae4e4d3cf9be8 (DEFAULT_TABLE table=default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.746641 19896 tablet_bootstrap.cc:654] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:41.747653 19114 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:55:41.749044 19118 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_e57125ad4a62414baf5a9466ce680bdc"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:41.750713 19118 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e57125ad4a62414baf5a9466ce680bdc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:41.750842 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 202f1ead822548a2bbeae4e4d3cf9be8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.751535 19115 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet d66eeaf33aa943c09f52b74360e2332d
W20260928 01:55:41.727560 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 43666.7us
I20260928 01:55:41.729472 20397 consensus_queue.cc:1048] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:41.730152 19738 tablet_service.cc:1558] Processing DeleteTablet for tablet 7602706a3fbc438d8d448c9ac057087c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c6f4708c641414aa59f01703c86aaf1) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:41.758457 19450 tablet_service.cc:1558] Processing DeleteTablet for tablet d66eeaf33aa943c09f52b74360e2332d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:41.767026 19450 tablet_service.cc:1558] Processing DeleteTablet for tablet f71e2109f8cd4dd4a288fbdc8e50b133 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:41.773305 20666 raft_consensus.cc:3060] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:41.778219 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_6768d7dba2d94bb7b10a14976016f84b"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:41.779875 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6768d7dba2d94bb7b10a14976016f84b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:41.781929 19115 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_f34e683b13dc44aaa660c13fb7f58531" } new_table_name: "default.Table_dc5c9c73f0b144d3b46128870b65d40f" modify_external_catalogs: true
I20260928 01:55:41.782887 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 202f1ead822548a2bbeae4e4d3cf9be8 (DEFAULT_TABLE table=default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.783749 20029 tablet_bootstrap.cc:492] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:41.784154 20029 ts_tablet_manager.cc:1403] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.253s	user 0.008s	sys 0.007s
I20260928 01:55:41.784566 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet d66eeaf33aa943c09f52b74360e2332d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:41.787420 20029 raft_consensus.cc:359] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.789887 19599 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c61408724e4a70b39e5dbdab9a3e8a with delete_type TABLET_DATA_DELETED (replaced by tablet 8df69eb3a37445ed8a2be0ef3bf32cdb) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:41.791464 19592 tablet_service.cc:1511] Processing CreateTablet for tablet 202f1ead822548a2bbeae4e4d3cf9be8 (DEFAULT_TABLE table=default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.792479 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec3f279423a46c1acb1cbfecf4a608a (DEFAULT_TABLE table=default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.793103 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 202f1ead822548a2bbeae4e4d3cf9be8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.793488 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec3f279423a46c1acb1cbfecf4a608a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.791469 19591 tablet_service.cc:1511] Processing CreateTablet for tablet 5442dd0aa28545c8bcf3a0b977c71e98 (DEFAULT_TABLE table=default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.797482 19110 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:41.799204 19110 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]). Expected version 2 got 0
I20260928 01:55:41.802399 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5442dd0aa28545c8bcf3a0b977c71e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.807127 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec3f279423a46c1acb1cbfecf4a608a (DEFAULT_TABLE table=default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.810416 19442 tablet_service.cc:1511] Processing CreateTablet for tablet 27a232fc915a46c1a833ec5f6721eece (DEFAULT_TABLE table=default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.812389 19442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a232fc915a46c1a833ec5f6721eece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.826131 19444 tablet_service.cc:1511] Processing CreateTablet for tablet 13c395a6a87f4927b10973720aa4d868 (DEFAULT_TABLE table=default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.830016 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13c395a6a87f4927b10973720aa4d868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.833127 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a753f894ae94b1eaf9b445df3545ded with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:41.833858 19446 tablet_service.cc:1558] Processing DeleteTablet for tablet 03bbed8181084cb88b7d33976c20fbb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c007b068b1d414298cce3fe44a91daa) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:41.848385 19446 tablet_service.cc:1511] Processing CreateTablet for tablet 15f48cf74a1b4600b5140bf9cc8446e3 (DEFAULT_TABLE table=default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.849808 19446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f48cf74a1b4600b5140bf9cc8446e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.853590 19443 tablet_service.cc:1511] Processing CreateTablet for tablet 2c007b068b1d414298cce3fe44a91daa (DEFAULT_TABLE table=default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.855944 19443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c007b068b1d414298cce3fe44a91daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.788061 20029 raft_consensus.cc:385] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:41.860420 20029 raft_consensus.cc:740] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:41.861233 20029 consensus_queue.cc:260] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:41.863336 20029 ts_tablet_manager.cc:1434] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.000s
I20260928 01:55:41.869340 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_7f96dae07ddf433daee6ef935a5f2d51"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:41.870139 19599 tablet_service.cc:1558] Processing DeleteTablet for tablet 7602706a3fbc438d8d448c9ac057087c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c6f4708c641414aa59f01703c86aaf1) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:41.870421 19595 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ab79c6ad03e481a903a0f95ae0512e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:41 UTC) from {username='slave'} at 127.0.0.1:47670
W20260928 01:55:41.871035 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f96dae07ddf433daee6ef935a5f2d51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:41.871971 19595 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec3f279423a46c1acb1cbfecf4a608a (DEFAULT_TABLE table=default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.872978 19595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec3f279423a46c1acb1cbfecf4a608a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.879839 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 27a232fc915a46c1a833ec5f6721eece (DEFAULT_TABLE table=default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.880844 19599 tablet_service.cc:1558] Processing DeleteTablet for tablet d66eeaf33aa943c09f52b74360e2332d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:41.882037 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 27a232fc915a46c1a833ec5f6721eece (DEFAULT_TABLE table=default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.882409 19740 tablet_service.cc:1511] Processing CreateTablet for tablet 13c395a6a87f4927b10973720aa4d868 (DEFAULT_TABLE table=default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.882525 19743 tablet_service.cc:1511] Processing CreateTablet for tablet 15f48cf74a1b4600b5140bf9cc8446e3 (DEFAULT_TABLE table=default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.883124 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a232fc915a46c1a833ec5f6721eece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.884927 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 2c007b068b1d414298cce3fe44a91daa (DEFAULT_TABLE table=default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.889698 19447 tablet_service.cc:1511] Processing CreateTablet for tablet c74a4a00552c4a14a871a59465524f1c (DEFAULT_TABLE table=default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.893348 19599 tablet_service.cc:1511] Processing CreateTablet for tablet 13c395a6a87f4927b10973720aa4d868 (DEFAULT_TABLE table=default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.894398 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13c395a6a87f4927b10973720aa4d868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.901295 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5442dd0aa28545c8bcf3a0b977c71e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.903457 19745 tablet_service.cc:1511] Processing CreateTablet for tablet c74a4a00552c4a14a871a59465524f1c (DEFAULT_TABLE table=default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.904767 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 202f1ead822548a2bbeae4e4d3cf9be8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.908810 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec3f279423a46c1acb1cbfecf4a608a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.909328 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet c1f73a301c84482f897990ac5e5dd162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:37 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:41.909516 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c74a4a00552c4a14a871a59465524f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.911612 19454 tablet_service.cc:1558] Processing DeleteTablet for tablet f3741aec215343468b2d7bc952da03c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:41.913000 19109 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 38) took 2417 ms (client timeout 1000 ms). Trace:
I20260928 01:55:41.922657 19112 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_adb5ab9de36441229bdfdfceffe4604e" } new_table_name: "default.Table_2e85383d510044d6821bd153a9a191df" modify_external_catalogs: true
I20260928 01:55:41.927652 19454 tablet_service.cc:1511] Processing CreateTablet for tablet 75303ee92aae436ea6c46747a23b69b6 (DEFAULT_TABLE table=default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.933205 20502 ts_tablet_manager.cc:1929] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:41.934443 19746 tablet_service.cc:1511] Processing CreateTablet for tablet 75303ee92aae436ea6c46747a23b69b6 (DEFAULT_TABLE table=default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.935495 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75303ee92aae436ea6c46747a23b69b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.938979 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7 (DEFAULT_TABLE table=default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:41.946070 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a232fc915a46c1a833ec5f6721eece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.946218 20029 tablet_bootstrap.cc:492] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:41.950290 20546 ts_tablet_manager.cc:1916] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:41.955405 19447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c74a4a00552c4a14a871a59465524f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:41.972805 20666 raft_consensus.cc:2749] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:41.986303 19742 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7 (DEFAULT_TABLE table=default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:42.000942 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75303ee92aae436ea6c46747a23b69b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:42.002358 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13c395a6a87f4927b10973720aa4d868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:42.005374 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:42.008991 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f48cf74a1b4600b5140bf9cc8446e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:42.008903 20682 raft_consensus.cc:493] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:42.009531 20682 raft_consensus.cc:515] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.014264 20682 leader_election.cc:290] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:42.026187 20634 raft_consensus.cc:2749] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:42.043004 19593 tablet_service.cc:1511] Processing CreateTablet for tablet 15f48cf74a1b4600b5140bf9cc8446e3 (DEFAULT_TABLE table=default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:42.044687 19896 tablet_bootstrap.cc:492] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:42.045590 19896 ts_tablet_manager.cc:1403] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.349s	user 0.007s	sys 0.009s
I20260928 01:55:42.048763 19593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f48cf74a1b4600b5140bf9cc8446e3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:41.913405 19109 rpcz_store.cc:269] 0928 01:55:39.495735 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.497461 (+  1726us) service_pool.cc:224] Handling call
0928 01:55:39.511050 (+ 13589us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:41.912920 (+2401870us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:40.788758 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:40.789169 (+   411us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:40.789194 (+    25us) write_op.cc:435] Acquired schema lock
0928 01:55:40.789253 (+    59us) tablet.cc:662] Decoding operations
0928 01:55:40.789507 (+   254us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:40.789544 (+    37us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:40.789567 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:40.790941 (+  1374us) tablet.cc:701] Row locks acquired
0928 01:55:40.790957 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:55:40.791083 (+   126us) write_op.cc:270] Start()
0928 01:55:40.791167 (+    84us) write_op.cc:276] Timestamp: P: 1790560540791034 usec, L: 0
0928 01:55:40.791182 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:40.792261 (+  1079us) log.cc:844] Serialized 530 byte log entry
0928 01:55:40.818665 (+ 26404us) op_driver.cc:464] REPLICATION: finished
0928 01:55:40.821495 (+  2830us) write_op.cc:301] APPLY: starting
0928 01:55:40.821561 (+    66us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:40.821710 (+   149us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:40.821821 (+   111us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:40.822053 (+   232us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:40.822256 (+   203us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:40.822328 (+    72us) write_op.cc:312] APPLY: finished
0928 01:55:40.822572 (+   244us) log.cc:844] Serialized 23 byte log entry
0928 01:55:40.822751 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:40.822844 (+    93us) write_op.cc:454] Released schema lock
0928 01:55:40.822891 (+    47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":24,"spinlock_wait_cycles":4327680,"child_traces":[["op",{"apply.queue_time_us":2631,"apply.run_cpu_time_us":1661,"apply.run_wall_time_us":1662,"num_ops":1,"prepare.queue_time_us":832,"prepare.run_cpu_time_us":2064,"prepare.run_wall_time_us":4634,"replication_time_us":27365}]]}
I20260928 01:55:42.057446 20502 log.cc:1199] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/90b3c947794c48daaacc299a7d2dd4a9
I20260928 01:55:42.058424 20502 ts_tablet_manager.cc:1950] T 90b3c947794c48daaacc299a7d2dd4a9 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:42.059279 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 202) took 1498 ms. Trace:
I20260928 01:55:42.059707 20502 rpcz_store.cc:276] 0928 01:55:40.560780 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.561506 (+   726us) service_pool.cc:224] Handling call
0928 01:55:41.549230 (+987724us) ts_tablet_manager.cc:1151] Deleting tablet 90b3c947794c48daaacc299a7d2dd4a9
0928 01:55:41.549279 (+    49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:41.786829 (+237550us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:41.933057 (+146228us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.059223 (+126166us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":982035}
I20260928 01:55:42.065351 19599 tablet_service.cc:1511] Processing CreateTablet for tablet 2c007b068b1d414298cce3fe44a91daa (DEFAULT_TABLE table=default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:42.066578 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c007b068b1d414298cce3fe44a91daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:42.068300 19890 tablet_bootstrap.cc:654] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:42.087863 19115 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f709eccf4ab5413bbbd8b4746f185db4 consensus state has no leader
I20260928 01:55:42.093258 20682 raft_consensus.cc:493] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:42.093990 20682 raft_consensus.cc:515] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.094871 19590 tablet_service.cc:1511] Processing CreateTablet for tablet c74a4a00552c4a14a871a59465524f1c (DEFAULT_TABLE table=default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:42.096680 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c74a4a00552c4a14a871a59465524f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:42.097313 20682 leader_election.cc:290] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:42.113294 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 75303ee92aae436ea6c46747a23b69b6 (DEFAULT_TABLE table=default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:42.114410 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75303ee92aae436ea6c46747a23b69b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:42.121728 19597 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7 (DEFAULT_TABLE table=default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:42.123016 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:42.132797 19116 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:42.134413 19116 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:42.135040 19116 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]). Expected version 2 got 0
I20260928 01:55:42.138510 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 90b3c947794c48daaacc299a7d2dd4a9 (table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]) successfully deleted
W20260928 01:55:42.142948 19619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.013s
W20260928 01:55:42.143325 19619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.001s	sys 0.013s
I20260928 01:55:42.154089 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:42.154974 19115 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_9ee7221a3e36427e86752547f9beaecf" } modify_external_catalogs: true
I20260928 01:55:42.155040 19620 raft_consensus.cc:3060] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:42.155531 19115 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_9ee7221a3e36427e86752547f9beaecf" } modify_external_catalogs: true
I20260928 01:55:42.165511 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a81b9455a340728fea713318e1e77a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:42.167986 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8d07b367b4fafbd7171f8ea7b2a26" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:42.168951 20502 tablet_replica.cc:333] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:42.169974 20502 raft_consensus.cc:2243] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:42.170678 20502 raft_consensus.cc:2272] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:42.173341 19109 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_84d77c64cf0041c38f3b44f7f3ee8e7a" } modify_external_catalogs: true
I20260928 01:55:42.173977 19109 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_84d77c64cf0041c38f3b44f7f3ee8e7a" } modify_external_catalogs: true
I20260928 01:55:42.183542 19896 raft_consensus.cc:359] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:42.027251 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c007b068b1d414298cce3fe44a91daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:42.189484 19896 raft_consensus.cc:385] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:42.189824 19896 raft_consensus.cc:740] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:42.190412 19896 consensus_queue.cc:260] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:42.031451 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a81b9455a340728fea713318e1e77a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:42.197434 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:42.204146 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_a82317fb7790483884cbb5ebcf554128"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:42.205873 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a82317fb7790483884cbb5ebcf554128 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:42.067744 19704 consensus_peers.cc:597] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:42.099133 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8d07b367b4fafbd7171f8ea7b2a26" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:42.129590 20715 raft_consensus.cc:493] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:42.208173 20715 raft_consensus.cc:515] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.211258 20715 leader_election.cc:290] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:42.212046 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 144432us
I20260928 01:55:42.212723 20502 ts_tablet_manager.cc:1916] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:42.135766 19116 catalog_manager.cc:5838] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 2, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 2 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:55:42.216652 19116 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:42.217706 19116 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:55:42.219574 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:42.236819 19896 ts_tablet_manager.cc:1434] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.191s	user 0.006s	sys 0.000s
I20260928 01:55:42.237941 19896 tablet_bootstrap.cc:492] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:42.244383 19704 leader_election.cc:343] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:42.244324 20546 ts_tablet_manager.cc:1929] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:42.279556 20546 log.cc:1199] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/78a71904514a488083426f5fe07d12cd
I20260928 01:55:42.286841 20546 ts_tablet_manager.cc:1950] T 78a71904514a488083426f5fe07d12cd P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:42.290753 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 184) took 3955 ms. Trace:
I20260928 01:55:42.302225 19620 raft_consensus.cc:2468] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:55:42.305361 20546 rpcz_store.cc:276] 0928 01:55:38.335314 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.335672 (+   358us) service_pool.cc:224] Handling call
0928 01:55:41.609931 (+3274259us) ts_tablet_manager.cc:1151] Deleting tablet 78a71904514a488083426f5fe07d12cd
0928 01:55:41.609977 (+    46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.160185 (+550208us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.244163 (+ 83978us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.290675 (+ 46512us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60662,"tablet-delete.queue_time_us":3273655}
I20260928 01:55:42.310014 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 78a71904514a488083426f5fe07d12cd (table default.Table_d6ec5f8939f84de7994041a54bdbe36b [id=ab54f23a53744160a4b2437b2b513937]) successfully deleted
I20260928 01:55:42.313472 20546 tablet_replica.cc:333] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:42.315937 20511 consensus_queue.cc:1048] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:42.319790 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_8504d275b8c443b4a11c42114c171548"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:42.321498 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8504d275b8c443b4a11c42114c171548 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:42.335278 19115 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 22fc9eff28c4436fb383c3d7169171bb
I20260928 01:55:42.329509 20634 raft_consensus.cc:493] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:55:42.340512 19112 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0b222e5366a64f52bc97acd551c7a067 consensus state has no leader
I20260928 01:55:42.340279 20634 raft_consensus.cc:515] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:42.344722 19109 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet d71e513e24aa4ded867513443f25bb69
I20260928 01:55:42.348781 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet 22fc9eff28c4436fb383c3d7169171bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:42.343962 20634 leader_election.cc:290] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:42.355298 20029 tablet_bootstrap.cc:654] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:42.358875 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 72443.9us
I20260928 01:55:42.372746 19117 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_9e79b25f560e44bca5607e4c4fc8e796" } new_table_name: "default.Table_1e04bf7deec14195825616379bbf14dc" modify_external_catalogs: true
I20260928 01:55:42.381333 20147 ts_tablet_manager.cc:1929] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 01:55:42.381691 20147 log.cc:1199] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/3f08e6838341436f8a85d6dbafc805df
I20260928 01:55:42.394115 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 22fc9eff28c4436fb383c3d7169171bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:42.395268 19890 tablet_bootstrap.cc:492] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:42.415341 19813 heartbeater.cc:499] Master 127.18.161.60:39095 was elected leader, sending a full tablet report...
I20260928 01:55:42.418009 19109 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_b8264f1458f942c8b96c2608b66f6fdb"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:42.419565 19109 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8264f1458f942c8b96c2608b66f6fdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:42.424644 19113 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_4f172191b146442b95eebfe75c50791b"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:42.427186 19113 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f172191b146442b95eebfe75c50791b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:42.430981 19409 leader_election.cc:343] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:42.432794 20546 raft_consensus.cc:2243] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:42.433346 20546 raft_consensus.cc:2272] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:42.435302 20546 ts_tablet_manager.cc:1916] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:42.444567 19890 ts_tablet_manager.cc:1403] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.987s	user 0.011s	sys 0.007s
I20260928 01:55:42.444988 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:42.445996 19470 raft_consensus.cc:2468] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:42.447784 19890 raft_consensus.cc:359] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.452626 19764 raft_consensus.cc:3060] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:42.456652 20727 log.cc:927] Time spent T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260928 01:55:42.461076 19896 tablet_bootstrap.cc:654] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:42.464736 19703 leader_election.cc:304] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:42.466859 20630 raft_consensus.cc:2804] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:42.467208 20630 raft_consensus.cc:493] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:42.467519 20630 raft_consensus.cc:3060] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:42.467486 19409 leader_election.cc:343] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:42.469063 20029 tablet_bootstrap.cc:492] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:42.469496 20029 ts_tablet_manager.cc:1403] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.523s	user 0.010s	sys 0.004s
I20260928 01:55:42.472086 20029 raft_consensus.cc:359] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.472702 20029 raft_consensus.cc:385] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:42.472944 20029 raft_consensus.cc:740] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:42.473577 20029 consensus_queue.cc:260] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.476612 20502 ts_tablet_manager.cc:1929] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:42.477324 20502 log.cc:1199] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/b699e0d862fa4a54bbd756625f4e692b
I20260928 01:55:42.478166 20502 ts_tablet_manager.cc:1950] T b699e0d862fa4a54bbd756625f4e692b P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:42.479099 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 203) took 1784 ms. Trace:
I20260928 01:55:42.416676 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3741aec215343468b2d7bc952da03c8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:42.481449 19620 raft_consensus.cc:2468] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:42.460769 20147 ts_tablet_manager.cc:1950] T 3f08e6838341436f8a85d6dbafc805df P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:42.482568 19890 raft_consensus.cc:385] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:42.482846 19890 raft_consensus.cc:740] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:42.484010 19890 consensus_queue.cc:260] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.486122 19890 ts_tablet_manager.cc:1434] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
W20260928 01:55:42.488373 19703 leader_election.cc:343] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: f3741aec215343468b2d7bc952da03c8
I20260928 01:55:42.479475 20502 rpcz_store.cc:276] 0928 01:55:40.694731 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.695870 (+  1139us) service_pool.cc:224] Handling call
0928 01:55:42.138759 (+1442889us) ts_tablet_manager.cc:1151] Deleting tablet b699e0d862fa4a54bbd756625f4e692b
0928 01:55:42.168797 (+ 30038us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.276031 (+107234us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.473284 (+197253us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.479007 (+  5723us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1442255}
I20260928 01:55:42.492955 19115 master_service.cc:960] ReplaceTablet: received request to replace tablet ed6d3c1d99cc40febd285d0a8f5c3196 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:42.493937 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 204) took 1779 ms. Trace:
I20260928 01:55:42.494267 20502 rpcz_store.cc:276] 0928 01:55:40.714783 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.845919 (+131136us) service_pool.cc:224] Handling call
0928 01:55:42.493476 (+1647557us) ts_tablet_manager.cc:1151] Deleting tablet eac01fc222dd480cbed7cac37a0e6693
0928 01:55:42.493541 (+    65us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.493878 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1598462}
I20260928 01:55:42.495594 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 205) took 1576 ms. Trace:
I20260928 01:55:42.498226 20682 raft_consensus.cc:493] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:42.498749 20682 raft_consensus.cc:515] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.501430 20682 leader_election.cc:290] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:42.505388 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:42.507752 19765 raft_consensus.cc:1275] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:55:42.509603 20682 consensus_queue.cc:1048] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:42.514355 20630 raft_consensus.cc:515] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.517859 19767 raft_consensus.cc:2393] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:42.518654 20630 leader_election.cc:290] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:42.521212 20715 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:42.521658 20715 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.523707 20715 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:42.517338 20511 consensus_queue.cc:1048] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260928 01:55:42.532809 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:42.533519 19475 raft_consensus.cc:3060] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:42.535009 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:42.537868 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:42.538561 19472 raft_consensus.cc:2468] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:42.541422 19704 leader_election.cc:304] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:42.543677 19896 tablet_bootstrap.cc:492] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:42.547091 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:42.548705 20715 raft_consensus.cc:2804] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:55:42.547914 19703 leader_election.cc:304] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:42.549379 20715 raft_consensus.cc:493] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:42.549973 20715 raft_consensus.cc:3060] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:55:42.555935 19117 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2018f8b52f974554924f9ecfbd5a0f51 has no consensus state
W20260928 01:55:42.557183 19704 leader_election.cc:343] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:42.557025 19117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_c9449f6a65b249a6aba571b955c6ab14"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:42.558588 19117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9449f6a65b249a6aba571b955c6ab14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:42.495883 20502 rpcz_store.cc:276] 0928 01:55:40.919658 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.944101 (+ 24443us) service_pool.cc:224] Handling call
0928 01:55:42.495155 (+1551054us) ts_tablet_manager.cc:1151] Deleting tablet 8a5e07078b2a4fe59d9293d9511cbb6b
0928 01:55:42.495211 (+    56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.495536 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1550109}
I20260928 01:55:42.561020 20029 ts_tablet_manager.cc:1434] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.000s
I20260928 01:55:42.561774 19896 ts_tablet_manager.cc:1403] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.324s	user 0.015s	sys 0.000s
I20260928 01:55:42.562233 20029 tablet_bootstrap.cc:492] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:42.566238 19890 tablet_bootstrap.cc:492] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:42.567755 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 172) took 3470 ms. Trace:
I20260928 01:55:42.568250 20147 rpcz_store.cc:276] 0928 01:55:39.097316 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.097466 (+   150us) service_pool.cc:224] Handling call
0928 01:55:41.531919 (+2434453us) ts_tablet_manager.cc:1151] Deleting tablet 3f08e6838341436f8a85d6dbafc805df
0928 01:55:41.531964 (+    45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.011075 (+479111us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.381204 (+370129us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.567697 (+186493us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2433639}
I20260928 01:55:42.569607 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 3f08e6838341436f8a85d6dbafc805df (table default.Table_4a2d24baaa4742b0aa00abd564613b46 [id=e17a4562755a46b6922715042f9d07d3]) successfully deleted
I20260928 01:55:42.570148 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 175) took 3129 ms. Trace:
I20260928 01:55:42.570452 20147 rpcz_store.cc:276] 0928 01:55:39.440779 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.440898 (+   119us) service_pool.cc:224] Handling call
0928 01:55:42.569811 (+3128913us) ts_tablet_manager.cc:1151] Deleting tablet 0ae3663fbe024a4e946e47339a4b9090
0928 01:55:42.569849 (+    38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.570094 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3107778}
W20260928 01:55:42.571529 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 0ae3663fbe024a4e946e47339a4b9090 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ae3663fbe024a4e946e47339a4b9090 already in progress: creating tablet
I20260928 01:55:42.573910 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 176) took 3072 ms. Trace:
I20260928 01:55:42.574239 20147 rpcz_store.cc:276] 0928 01:55:39.501217 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.501319 (+   102us) service_pool.cc:224] Handling call
0928 01:55:42.571619 (+3070300us) ts_tablet_manager.cc:1151] Deleting tablet 57a81b9455a340728fea713318e1e77a
0928 01:55:42.573577 (+  1958us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.573851 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3069770}
W20260928 01:55:42.575307 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 57a81b9455a340728fea713318e1e77a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57a81b9455a340728fea713318e1e77a already in progress: creating tablet
I20260928 01:55:42.584800 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:42.588322 19412 leader_election.cc:343] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:42.570070 20715 raft_consensus.cc:515] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:42.614265 20715 leader_election.cc:290] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:42.617877 19703 leader_election.cc:343] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: f3741aec215343468b2d7bc952da03c8
I20260928 01:55:42.619663 20029 tablet_bootstrap.cc:654] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:42.621145 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3741aec215343468b2d7bc952da03c8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:42.621698 19619 raft_consensus.cc:3060] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:42.621894 19109 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_2171ab69dd564f6897eb22381bb0a5b6" } modify_external_catalogs: true
I20260928 01:55:42.622408 19109 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_2171ab69dd564f6897eb22381bb0a5b6" } modify_external_catalogs: true
I20260928 01:55:42.628317 19619 raft_consensus.cc:2468] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:55:42.630920 19890 tablet_bootstrap.cc:654] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:42.632625 19704 leader_election.cc:304] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:42.634802 20742 tablet.cc:1751] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:42.637253 20715 raft_consensus.cc:2804] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:55:42.637791 20715 raft_consensus.cc:697] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:42.638602 20715 consensus_queue.cc:237] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:42.642441 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet b699e0d862fa4a54bbd756625f4e692b (table default.Table_882a0296b9ba49ef94e01ab6602cfa6e [id=69979c2fb6c84f81a71c4e04deda37bf]) successfully deleted
I20260928 01:55:42.643546 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 177) took 3115 ms. Trace:
W20260928 01:55:42.644964 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet eac01fc222dd480cbed7cac37a0e6693 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eac01fc222dd480cbed7cac37a0e6693 already in progress: creating tablet
I20260928 01:55:42.648838 20716 raft_consensus.cc:2804] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:55:42.595940 20546 ts_tablet_manager.cc:1929] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:42.649521 20147 rpcz_store.cc:276] 0928 01:55:39.528617 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.528737 (+   120us) service_pool.cc:224] Handling call
0928 01:55:42.592471 (+3063734us) ts_tablet_manager.cc:1151] Deleting tablet 5d9b93f45ccf44e785b00849e49c8294
0928 01:55:42.643275 (+ 50804us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.643480 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3063112}
I20260928 01:55:42.649923 20546 log.cc:1199] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/90d40050f85a4d6c90a4ce35cf15d134
I20260928 01:55:42.650236 20716 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:55:42.650625 20716 raft_consensus.cc:3060] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:42.650795 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 178) took 3064 ms. Trace:
I20260928 01:55:42.651077 20147 rpcz_store.cc:276] 0928 01:55:39.586178 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.586401 (+   223us) service_pool.cc:224] Handling call
0928 01:55:42.650447 (+3064046us) ts_tablet_manager.cc:1151] Deleting tablet 12c7284250084d6299cafe8310cfd257
0928 01:55:42.650492 (+    45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.650742 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3063438}
W20260928 01:55:42.652240 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 12c7284250084d6299cafe8310cfd257 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12c7284250084d6299cafe8310cfd257 already in progress: creating tablet
I20260928 01:55:42.652690 20546 ts_tablet_manager.cc:1950] T 90d40050f85a4d6c90a4ce35cf15d134 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:42.657456 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 182) took 4337 ms. Trace:
I20260928 01:55:42.639979 19475 raft_consensus.cc:2468] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:42.660135 20741 tablet.cc:1751] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:42.662356 20546 rpcz_store.cc:276] 0928 01:55:38.320336 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.320697 (+   361us) service_pool.cc:224] Handling call
0928 01:55:42.310971 (+3990274us) ts_tablet_manager.cc:1151] Deleting tablet 90d40050f85a4d6c90a4ce35cf15d134
0928 01:55:42.313245 (+  2274us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.444121 (+130876us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.595811 (+151690us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.657393 (+ 61582us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91977,"tablet-delete.queue_time_us":3970440}
I20260928 01:55:42.652107 20147 tablet_replica.cc:333] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:42.665196 20546 tablet_replica.cc:333] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:42.666061 20147 raft_consensus.cc:2243] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:42.666356 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 90d40050f85a4d6c90a4ce35cf15d134 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]) successfully deleted
I20260928 01:55:42.675065 20147 raft_consensus.cc:2272] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:42.682492 19115 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet ed6d3c1d99cc40febd285d0a8f5c3196
I20260928 01:55:42.686156 20546 raft_consensus.cc:2243] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:42.690042 20147 ts_tablet_manager.cc:1916] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:42.696987 20546 raft_consensus.cc:2272] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:42.677470 20715 consensus_queue.cc:1048] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:42.647785 20733 raft_consensus.cc:493] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:42.697530 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 206) took 1060 ms. Trace:
I20260928 01:55:42.697916 20502 rpcz_store.cc:276] 0928 01:55:41.636838 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.637004 (+   166us) service_pool.cc:224] Handling call
0928 01:55:42.561221 (+924217us) ts_tablet_manager.cc:1151] Deleting tablet 58c61408724e4a70b39e5dbdab9a3e8a
0928 01:55:42.652367 (+ 91146us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.697452 (+ 45085us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":923439}
I20260928 01:55:42.700342 20733 raft_consensus.cc:515] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.702435 20733 leader_election.cc:290] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:42.664187 20716 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.704429 20502 tablet_replica.cc:333] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:42.706375 20716 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:42.665097 19896 raft_consensus.cc:359] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.706995 19896 raft_consensus.cc:385] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:42.707931 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 22fc9eff28c4436fb383c3d7169171bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:42.707301 19896 raft_consensus.cc:740] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:42.709012 19896 consensus_queue.cc:260] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.710635 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:42.711218 19470 raft_consensus.cc:3060] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:42.718943 19703 leader_election.cc:304] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:42.708325 19765 raft_consensus.cc:1240] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:55:42.721347 20716 raft_consensus.cc:2804] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:42.722563 20716 raft_consensus.cc:697] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:42.723965 20716 consensus_queue.cc:237] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.705962 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:42.723500 20666 consensus_queue.cc:1059] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:42.729053 20666 raft_consensus.cc:3055] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:55:42.729360 20666 raft_consensus.cc:740] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:42.730139 20666 consensus_queue.cc:260] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.731186 20666 raft_consensus.cc:3060] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:42.743135 20147 ts_tablet_manager.cc:1929] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:42.743578 20147 log.cc:1199] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/03bbed8181084cb88b7d33976c20fbb8
I20260928 01:55:42.744360 20147 ts_tablet_manager.cc:1950] T 03bbed8181084cb88b7d33976c20fbb8 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:42.746402 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 179) took 3103 ms. Trace:
I20260928 01:55:42.746804 20147 rpcz_store.cc:276] 0928 01:55:39.643049 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.643528 (+   479us) service_pool.cc:224] Handling call
0928 01:55:42.651962 (+3008434us) ts_tablet_manager.cc:1151] Deleting tablet 03bbed8181084cb88b7d33976c20fbb8
0928 01:55:42.652001 (+    39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.736731 (+ 84730us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.743017 (+  6286us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.746345 (+  3328us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3007859}
I20260928 01:55:42.748026 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 03bbed8181084cb88b7d33976c20fbb8 (table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]) successfully deleted
I20260928 01:55:42.748689 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 184) took 2571 ms. Trace:
I20260928 01:55:42.749033 20147 rpcz_store.cc:276] 0928 01:55:40.177188 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.221388 (+ 44200us) service_pool.cc:224] Handling call
0928 01:55:42.748141 (+2526753us) ts_tablet_manager.cc:1151] Deleting tablet 3c6cfc9ff3344a48b09730dfde79d6cf
0928 01:55:42.748184 (+    43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.748627 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2526119}
W20260928 01:55:42.750222 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 3c6cfc9ff3344a48b09730dfde79d6cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c6cfc9ff3344a48b09730dfde79d6cf already in progress: creating tablet
I20260928 01:55:42.750715 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 185) took 2528 ms. Trace:
I20260928 01:55:42.751034 20147 rpcz_store.cc:276] 0928 01:55:40.222478 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.222575 (+    97us) service_pool.cc:224] Handling call
0928 01:55:42.750292 (+2527717us) ts_tablet_manager.cc:1151] Deleting tablet 49a73835e2854976b40b31fe752d1b1b
0928 01:55:42.750334 (+    42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.750666 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2527174}
W20260928 01:55:42.752362 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 49a73835e2854976b40b31fe752d1b1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49a73835e2854976b40b31fe752d1b1b already in progress: creating tablet
I20260928 01:55:42.753930 20147 tablet_replica.cc:333] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:42.754865 20147 raft_consensus.cc:2243] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:42.755427 20147 raft_consensus.cc:2272] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:42.757848 20249 raft_consensus.cc:493] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:42.758042 20147 ts_tablet_manager.cc:1916] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:42.758270 20249 raft_consensus.cc:515] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.761502 20249 leader_election.cc:290] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:42.762295 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71e2109f8cd4dd4a288fbdc8e50b133" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:42.698040 19412 leader_election.cc:304] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:42.770160 19896 ts_tablet_manager.cc:1434] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.208s	user 0.003s	sys 0.008s
W20260928 01:55:42.774618 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3505a502bff747deaf1e03c03375aafa consensus state has no leader
I20260928 01:55:42.779479 19113 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_527b8b35bcda4e179459c8909e6ff924" } new_table_name: "default.Table_50f66235bc464bdbb3fd48bfac98069e" modify_external_catalogs: true
I20260928 01:55:42.782981 19117 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_7b0eeaea0af144bf8165b6228c454e7e" } modify_external_catalogs: true
I20260928 01:55:42.783499 19117 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_7b0eeaea0af144bf8165b6228c454e7e" } modify_external_catalogs: true
W20260928 01:55:42.791989 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 203853us
W20260928 01:55:42.792869 19412 leader_election.cc:343] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:42.793251 19412 leader_election.cc:304] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:42.800105 20502 raft_consensus.cc:2243] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:42.800796 20502 raft_consensus.cc:2272] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:42.802749 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:42.803860 19767 raft_consensus.cc:2468] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:42.806074 19409 leader_election.cc:304] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:42.809988 19890 tablet_bootstrap.cc:492] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:42.810520 19890 ts_tablet_manager.cc:1403] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.244s	user 0.004s	sys 0.006s
I20260928 01:55:42.811092 19896 tablet_bootstrap.cc:492] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:42.811667 20502 ts_tablet_manager.cc:1916] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:42.817793 19619 raft_consensus.cc:3060] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:42.823786 19703 consensus_peers.cc:597] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b699e0d862fa4a54bbd756625f4e692b. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:42.829685 19521 heartbeater.cc:344] Connected to a master server at 127.18.161.60:39095
I20260928 01:55:42.830513 20732 raft_consensus.cc:2804] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:42.830946 20732 raft_consensus.cc:493] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:42.831303 20732 raft_consensus.cc:3060] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:42.814356 19470 raft_consensus.cc:2468] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:55:42.816190 20733 raft_consensus.cc:2749] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:42.832423 20715 consensus_queue.cc:1048] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:42.833599 20749 raft_consensus.cc:2749] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:42.838501 19703 leader_election.cc:304] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:42.840131 20715 raft_consensus.cc:2804] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:55:42.840786 20715 raft_consensus.cc:697] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:42.841689 20715 consensus_queue.cc:237] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.715409 20546 ts_tablet_manager.cc:1916] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:42.855577 20029 tablet_bootstrap.cc:492] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:42.860975 19890 raft_consensus.cc:359] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.861688 19890 raft_consensus.cc:385] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:42.861956 19890 raft_consensus.cc:740] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:42.861567 20029 ts_tablet_manager.cc:1403] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.300s	user 0.013s	sys 0.001s
I20260928 01:55:42.867596 20029 raft_consensus.cc:359] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:42.877820 19113 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 86825485bfca479ea63c1a99dddb68d6 consensus state has no leader
I20260928 01:55:42.878875 19113 master_service.cc:960] ReplaceTablet: received request to replace tablet f709eccf4ab5413bbbd8b4746f185db4 from {username='slave'} at 127.0.0.1:51212
W20260928 01:55:42.875947 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 69967.5us
W20260928 01:55:42.887247 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 94415us
W20260928 01:55:42.888944 19412 leader_election.cc:343] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:42.890861 19412 leader_election.cc:304] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:42.891649 20749 raft_consensus.cc:2749] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:42.705386 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 8a5e07078b2a4fe59d9293d9511cbb6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a5e07078b2a4fe59d9293d9511cbb6b already in progress: creating tablet
W20260928 01:55:42.899282 19104 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 193923us
I20260928 01:55:42.902087 19115 catalog_manager.cc:6934] ReplaceTablet: tablet ed6d3c1d99cc40febd285d0a8f5c3196 deleted and replaced by tablet eb014699060e4a6caf4caaf33c31710a
I20260928 01:55:42.903291 19593 tablet_service.cc:1558] Processing DeleteTablet for tablet ed6d3c1d99cc40febd285d0a8f5c3196 with delete_type TABLET_DATA_DELETED (replaced by tablet eb014699060e4a6caf4caaf33c31710a) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:42.903339 19115 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_b8b37004aead4426bc97d72999385fc4"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:55:42.905596 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 58c61408724e4a70b39e5dbdab9a3e8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58c61408724e4a70b39e5dbdab9a3e8a already in progress: creating tablet
W20260928 01:55:42.906687 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7602706a3fbc438d8d448c9ac057087c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7602706a3fbc438d8d448c9ac057087c already in progress: creating tablet
W20260928 01:55:42.907362 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7ab79c6ad03e481a903a0f95ae0512e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ab79c6ad03e481a903a0f95ae0512e6 already in progress: creating tablet
I20260928 01:55:42.908839 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet ed6d3c1d99cc40febd285d0a8f5c3196 with delete_type TABLET_DATA_DELETED (replaced by tablet eb014699060e4a6caf4caaf33c31710a) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:42.909861 20754 raft_consensus.cc:493] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:42.910382 20754 raft_consensus.cc:515] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.914258 19890 consensus_queue.cc:260] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:42.917008 19556 consensus_peers.cc:597] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90b3c947794c48daaacc299a7d2dd4a9. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:42.918707 20666 consensus_queue.cc:1048] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:42.922583 20147 ts_tablet_manager.cc:1929] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:42.923131 20147 log.cc:1199] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/7a753f894ae94b1eaf9b445df3545ded
I20260928 01:55:42.924679 20147 ts_tablet_manager.cc:1950] T 7a753f894ae94b1eaf9b445df3545ded P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:42.898102 20732 raft_consensus.cc:515] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.913249 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f73a301c84482f897990ac5e5dd162" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:42.913626 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet ed6d3c1d99cc40febd285d0a8f5c3196 with delete_type TABLET_DATA_DELETED (replaced by tablet eb014699060e4a6caf4caaf33c31710a) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:42.919724 20715 consensus_queue.cc:1048] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:42.948453 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:42.949177 19767 raft_consensus.cc:3060] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:42.957451 19767 raft_consensus.cc:2468] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:42.957703 20029 raft_consensus.cc:385] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:42.958213 20029 raft_consensus.cc:740] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:42.958840 19409 leader_election.cc:304] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:42.959048 20029 consensus_queue.cc:260] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:42.960258 19765 raft_consensus.cc:2468] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:42.962423 20733 raft_consensus.cc:493] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:42.962904 20733 raft_consensus.cc:515] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:42.963343 20029 ts_tablet_manager.cc:1434] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.099s	user 0.001s	sys 0.004s
I20260928 01:55:42.938212 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:42.965133 20733 leader_election.cc:290] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:42.935971 19890 ts_tablet_manager.cc:1434] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.125s	user 0.004s	sys 0.002s
I20260928 01:55:42.968000 19409 leader_election.cc:304] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:42.969169 20749 raft_consensus.cc:2804] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:42.977362 20733 raft_consensus.cc:2804] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:42.978595 20733 raft_consensus.cc:493] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:42.979004 20733 raft_consensus.cc:3060] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:42.981323 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 187) took 2647 ms. Trace:
W20260928 01:55:43.004266 19115 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8b37004aead4426bc97d72999385fc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:55:43.030396 19703 consensus_peers.cc:597] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:42.987639 19890 tablet_bootstrap.cc:492] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:43.037946 20733 raft_consensus.cc:515] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.040351 20733 leader_election.cc:290] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:43.046984 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:43.048084 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f73a301c84482f897990ac5e5dd162" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:43.048761 19766 raft_consensus.cc:3060] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:43.041569 20147 rpcz_store.cc:276] 0928 01:55:40.334201 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.334707 (+   506us) service_pool.cc:224] Handling call
0928 01:55:42.753775 (+2419068us) ts_tablet_manager.cc:1151] Deleting tablet 7a753f894ae94b1eaf9b445df3545ded
0928 01:55:42.753819 (+    44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.766927 (+ 13108us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.922441 (+155514us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:42.981228 (+ 58787us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2418258}
I20260928 01:55:43.073487 20688 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 81ebb46a410e43ebaec3ef4dd13a71fc)
I20260928 01:55:43.074267 20688 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:43.076537 19766 raft_consensus.cc:2468] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:43.078501 20695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81ebb46a410e43ebaec3ef4dd13a71fc. Latest consensus state: current_term: 2 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:43.079459 20695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:43.081837 20756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:43.082667 20756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:43.080825 20669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:43.083725 20669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:43.097836 20029 tablet_bootstrap.cc:492] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:43.111387 20029 tablet_bootstrap.cc:654] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:43.016866 20749 raft_consensus.cc:697] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:43.117847 20749 consensus_queue.cc:237] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.046542 20754 leader_election.cc:290] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:43.047207 20732 leader_election.cc:290] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:43.129187 19412 leader_election.cc:343] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:43.133212 20688 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:55:43.134495 19896 tablet_bootstrap.cc:654] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:43.142760 19115 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_39aacd0daa1b4dc2ac37b6aec34468bf" } new_table_name: "default.Table_60d638e6b7344739abf4bc0c6902b529" modify_external_catalogs: true
I20260928 01:55:43.073163 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:43.073792 19619 raft_consensus.cc:1275] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:55:43.127592 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f73a301c84482f897990ac5e5dd162" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:43.129171 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:43.166280 20741 tablet.cc:1751] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:43.168340 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 7a753f894ae94b1eaf9b445df3545ded (table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]) successfully deleted
I20260928 01:55:43.168581 20147 tablet_replica.cc:333] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:43.169497 20147 raft_consensus.cc:2243] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:43.170753 20147 raft_consensus.cc:2272] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:43.146683 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f73a301c84482f897990ac5e5dd162" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:43.162873 19890 tablet_bootstrap.cc:654] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:43.050941 20502 ts_tablet_manager.cc:1929] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260928 01:55:43.051818 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71e2109f8cd4dd4a288fbdc8e50b133" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:43.066519 19409 leader_election.cc:343] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:43.232088 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 165616us
I20260928 01:55:43.232478 20502 log.cc:1199] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/d66eeaf33aa943c09f52b74360e2332d
I20260928 01:55:43.233237 20502 ts_tablet_manager.cc:1950] T d66eeaf33aa943c09f52b74360e2332d P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:43.234051 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 211) took 1476 ms. Trace:
I20260928 01:55:43.234350 20502 rpcz_store.cc:276] 0928 01:55:41.757844 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.758198 (+   354us) service_pool.cc:224] Handling call
0928 01:55:42.704284 (+946086us) ts_tablet_manager.cc:1151] Deleting tablet d66eeaf33aa943c09f52b74360e2332d
0928 01:55:42.704326 (+    42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.878707 (+174381us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.050796 (+172089us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.233993 (+183197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94807,"tablet-delete.queue_time_us":945339}
I20260928 01:55:43.235335 19409 leader_election.cc:304] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:43.235855 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet d66eeaf33aa943c09f52b74360e2332d (table default.Table_542dd0839d9f40ed942c4e1ab3e12098 [id=5a381f54e00c4bcf843ddfd1a97b1a9f]) successfully deleted
I20260928 01:55:43.236857 20732 raft_consensus.cc:2804] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:43.237478 20732 raft_consensus.cc:697] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
W20260928 01:55:43.252010 20709 log.cc:927] Time spent T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Append to log took a long time: real 0.446s	user 0.019s	sys 0.004s
I20260928 01:55:43.256273 19666 heartbeater.cc:344] Connected to a master server at 127.18.161.60:39095
I20260928 01:55:43.256084 19813 heartbeater.cc:499] Master 127.18.161.60:39095 was elected leader, sending a full tablet report...
W20260928 01:55:43.259084 19412 leader_election.cc:343] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:43.264325 20732 consensus_queue.cc:237] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.272522 20147 ts_tablet_manager.cc:1916] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:43.276434 19412 leader_election.cc:304] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:43.277958 20754 raft_consensus.cc:2749] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:43.278249 20546 ts_tablet_manager.cc:1929] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260928 01:55:43.285945 20522 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a3ee288ca1464d20a715673422a214a0" instance_seqno: 1790560516119495) as {username='slave'} at 127.18.161.2:48011; Asking this server to re-register.
W20260928 01:55:43.290910 19115 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 982c3e07bcb94230b93764330914630f consensus state has no leader
I20260928 01:55:43.302685 20502 tablet_replica.cc:333] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:43.303680 20502 raft_consensus.cc:2243] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:43.313192 20779 tablet.cc:1751] T ca443386942e49d9a66143e1fde777c5 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:43.320030 20777 tablet.cc:1751] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:43.321193 19890 tablet_bootstrap.cc:492] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:43.321750 19890 ts_tablet_manager.cc:1403] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.334s	user 0.004s	sys 0.009s
W20260928 01:55:43.322862 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 151298us
I20260928 01:55:43.324051 20749 consensus_queue.cc:1048] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:43.328984 19412 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:43.287256 19704 consensus_peers.cc:597] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a753f894ae94b1eaf9b445df3545ded. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:43.294047 20029 tablet_bootstrap.cc:492] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:43.333632 20546 log.cc:1199] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/3f08e6838341436f8a85d6dbafc805df
I20260928 01:55:43.333995 20029 ts_tablet_manager.cc:1403] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.236s	user 0.026s	sys 0.023s
W20260928 01:55:43.334138 19412 leader_election.cc:343] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:43.334477 20546 ts_tablet_manager.cc:1950] T 3f08e6838341436f8a85d6dbafc805df P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:43.335698 20502 raft_consensus.cc:2272] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:43.337643 20029 raft_consensus.cc:359] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.338349 20502 ts_tablet_manager.cc:1916] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:43.321066 20784 tablet.cc:1751] T ca443386942e49d9a66143e1fde777c5 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:55:43.327289 19666 heartbeater.cc:461] Registering TS with master...
W20260928 01:55:43.333636 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 46512.2us
W20260928 01:55:43.347541 19412 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:43.350327 19896 tablet_bootstrap.cc:492] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:43.350867 19896 ts_tablet_manager.cc:1403] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.540s	user 0.006s	sys 0.011s
I20260928 01:55:43.338372 20029 raft_consensus.cc:385] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:43.354254 19896 raft_consensus.cc:359] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.354918 19896 raft_consensus.cc:385] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:43.355166 19896 raft_consensus.cc:740] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:43.354784 20029 raft_consensus.cc:740] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:43.357458 20029 consensus_queue.cc:260] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.364614 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 187) took 4405 ms. Trace:
I20260928 01:55:43.366787 19556 leader_election.cc:304] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:43.367934 20249 raft_consensus.cc:2749] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:43.365091 20546 rpcz_store.cc:276] 0928 01:55:38.959678 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:38.959787 (+   109us) service_pool.cc:224] Handling call
0928 01:55:42.665042 (+3705255us) ts_tablet_manager.cc:1151] Deleting tablet 3f08e6838341436f8a85d6dbafc805df
0928 01:55:42.665085 (+    43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:42.996319 (+331234us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.278104 (+281785us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.364539 (+ 86435us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3704543}
I20260928 01:55:43.370239 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 190) took 3931 ms. Trace:
I20260928 01:55:43.370370 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 3f08e6838341436f8a85d6dbafc805df (table default.Table_4a2d24baaa4742b0aa00abd564613b46 [id=e17a4562755a46b6922715042f9d07d3]) successfully deleted
I20260928 01:55:43.347915 19890 raft_consensus.cc:359] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.371158 19890 raft_consensus.cc:385] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:43.371631 19890 raft_consensus.cc:740] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:43.372037 20546 rpcz_store.cc:276] 0928 01:55:39.438502 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.438662 (+   160us) service_pool.cc:224] Handling call
0928 01:55:43.369875 (+3931213us) ts_tablet_manager.cc:1151] Deleting tablet 0ae3663fbe024a4e946e47339a4b9090
0928 01:55:43.369924 (+    49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.370183 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3925904}
I20260928 01:55:43.378317 19890 consensus_queue.cc:260] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.379909 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 191) took 3883 ms. Trace:
I20260928 01:55:43.380388 20546 rpcz_store.cc:276] 0928 01:55:39.496628 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.497197 (+   569us) service_pool.cc:224] Handling call
0928 01:55:43.379513 (+3882316us) ts_tablet_manager.cc:1151] Deleting tablet 57a81b9455a340728fea713318e1e77a
0928 01:55:43.379559 (+    46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.379847 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3874849}
I20260928 01:55:43.372764 20029 ts_tablet_manager.cc:1434] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260928 01:55:43.382118 20029 tablet_bootstrap.cc:492] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:55:43.388624 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 0ae3663fbe024a4e946e47339a4b9090 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ae3663fbe024a4e946e47339a4b9090 already in progress: creating tablet
I20260928 01:55:43.410351 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 192) took 3822 ms. Trace:
I20260928 01:55:43.410737 20546 rpcz_store.cc:276] 0928 01:55:39.587747 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.587894 (+   147us) service_pool.cc:224] Handling call
0928 01:55:43.409979 (+3822085us) ts_tablet_manager.cc:1151] Deleting tablet 12c7284250084d6299cafe8310cfd257
0928 01:55:43.410028 (+    49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.410289 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3821391}
I20260928 01:55:43.410492 19890 ts_tablet_manager.cc:1434] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.002s
W20260928 01:55:43.412535 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 57a81b9455a340728fea713318e1e77a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57a81b9455a340728fea713318e1e77a already in progress: creating tablet
W20260928 01:55:43.413259 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 12c7284250084d6299cafe8310cfd257 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12c7284250084d6299cafe8310cfd257 already in progress: creating tablet
I20260928 01:55:43.424656 20546 tablet_replica.cc:333] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:43.426785 20546 raft_consensus.cc:2243] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:43.432089 19896 consensus_queue.cc:260] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.432749 20546 raft_consensus.cc:2272] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:43.433426 20732 raft_consensus.cc:493] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:43.434128 20732 raft_consensus.cc:515] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.437456 20732 leader_election.cc:290] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:43.440688 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca0b52215454a99b6c5d1956088829a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:43.442628 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca0b52215454a99b6c5d1956088829a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:43.445500 20634 raft_consensus.cc:493] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:43.446132 20634 raft_consensus.cc:515] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:43.449257 19409 leader_election.cc:343] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:43.451229 19412 leader_election.cc:343] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:43.452610 19890 tablet_bootstrap.cc:492] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:43.452665 20634 leader_election.cc:290] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:43.460168 20546 ts_tablet_manager.cc:1916] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:43.467633 19203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 3 candidate_status { last_received { term: 2 index: 252 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:43.468340 20769 catalog_manager.cc:1308] Loaded cluster ID: 726a03a5ce124d548da65567db2a283d
I20260928 01:55:43.468726 20769 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: loading cluster ID for follower catalog manager: success
I20260928 01:55:43.477607 20527 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" instance_seqno: 1790560514060521) as {username='slave'} at 127.18.161.1:58377; Asking this server to re-register.
I20260928 01:55:43.479369 20522 ts_manager.cc:194] Registered new tserver with Master: a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:43.454593 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86825485bfca479ea63c1a99dddb68d6" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:43.509435 19614 raft_consensus.cc:2468] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:43.515758 20029 tablet_bootstrap.cc:654] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:43.517184 19704 leader_election.cc:304] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:43.518581 20716 raft_consensus.cc:2804] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:43.518915 20716 raft_consensus.cc:493] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:43.519281 20716 raft_consensus.cc:3060] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:43.521634 19118 catalog_manager.cc:5838] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:43.458603 19621 raft_consensus.cc:1275] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:55:43.528671 20715 consensus_queue.cc:1048] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:43.454437 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86825485bfca479ea63c1a99dddb68d6" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:43.536216 19475 raft_consensus.cc:2468] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:43.544781 19593 tablet_service.cc:1511] Processing CreateTablet for tablet 043ddb5b0b0e4ad0b30d2927d37971fb (DEFAULT_TABLE table=default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:43.545884 19593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043ddb5b0b0e4ad0b30d2927d37971fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:43.546020 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 3 candidate_status { last_received { term: 2 index: 252 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:43.535961 19412 leader_election.cc:304] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:55:43.548976 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 97774.4us
I20260928 01:55:43.550383 20749 raft_consensus.cc:2749] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:43.551218 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:55:43.552901 20688 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:55:43.505015 20526 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" instance_seqno: 1790560518431564) as {username='slave'} at 127.18.161.3:44073; Asking this server to re-register.
I20260928 01:55:43.559067 19813 heartbeater.cc:461] Registering TS with master...
I20260928 01:55:43.564918 19445 tablet_service.cc:1511] Processing CreateTablet for tablet 043ddb5b0b0e4ad0b30d2927d37971fb (DEFAULT_TABLE table=default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:43.566890 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043ddb5b0b0e4ad0b30d2927d37971fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:43.579447 20546 ts_tablet_manager.cc:1929] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:43.580704 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 043ddb5b0b0e4ad0b30d2927d37971fb (DEFAULT_TABLE table=default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:43.581745 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043ddb5b0b0e4ad0b30d2927d37971fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:43.588726 20147 ts_tablet_manager.cc:1929] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:43.589239 20147 log.cc:1199] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/90b3c947794c48daaacc299a7d2dd4a9
I20260928 01:55:43.590031 20147 ts_tablet_manager.cc:1950] T 90b3c947794c48daaacc299a7d2dd4a9 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:43.590116 19117 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 7daa1b799e0d408287edc03988f5b683
I20260928 01:55:43.591706 19117 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 288) took 1042 ms. Trace:
I20260928 01:55:43.592129 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 188) took 2456 ms. Trace:
I20260928 01:55:43.595216 19442 tablet_service.cc:1558] Processing DeleteTablet for tablet 7daa1b799e0d408287edc03988f5b683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:43.602633 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet 7daa1b799e0d408287edc03988f5b683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:43.602852 20716 raft_consensus.cc:515] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.592010 19117 rpcz_store.cc:276] 0928 01:55:42.549460 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:42.782711 (+233251us) service_pool.cc:224] Handling call
0928 01:55:42.783856 (+  1145us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:42.784390 (+   534us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:55:42.784507 (+   117us) catalog_manager.cc:2863] Locking tablets
0928 01:55:43.496899 (+712392us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:55:43.589740 (+ 92841us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:55:43.589939 (+   199us) catalog_manager.cc:2911] Committing in-memory state
0928 01:55:43.590021 (+    82us) catalog_manager.cc:2915] Aborting table tasks
0928 01:55:43.591641 (+  1620us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:43.512429 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:43.512828 (+   399us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:43.512851 (+    23us) write_op.cc:435] Acquired schema lock
0928 01:55:43.512863 (+    12us) tablet.cc:662] Decoding operations
0928 01:55:43.513156 (+   293us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:43.513195 (+    39us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:43.513217 (+    22us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:43.513538 (+   321us) tablet.cc:701] Row locks acquired
0928 01:55:43.513551 (+    13us) write_op.cc:260] PREPARE: finished
0928 01:55:43.513671 (+   120us) write_op.cc:270] Start()
0928 01:55:43.513749 (+    78us) write_op.cc:276] Timestamp: P: 1790560543513618 usec, L: 0
0928 01:55:43.513765 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:55:43.514230 (+   465us) log.cc:844] Serialized 728 byte log entry
0928 01:55:43.581322 (+ 67092us) op_driver.cc:464] REPLICATION: finished
0928 01:55:43.582282 (+   960us) write_op.cc:301] APPLY: starting
0928 01:55:43.582367 (+    85us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:43.582526 (+   159us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:43.582639 (+   113us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:43.583022 (+   383us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:43.583254 (+   232us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:43.583340 (+    86us) write_op.cc:312] APPLY: finished
0928 01:55:43.583614 (+   274us) log.cc:844] Serialized 29 byte log entry
0928 01:55:43.585743 (+  2129us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:43.585845 (+   102us) write_op.cc:454] Released schema lock
0928 01:55:43.588659 (+  2814us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":745,"num_ops":2,"prepare.queue_time_us":13837,"prepare.run_cpu_time_us":2027,"prepare.run_wall_time_us":3171,"replication_time_us":67397}]]}
I20260928 01:55:43.609246 20546 log.cc:1199] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/03bbed8181084cb88b7d33976c20fbb8
I20260928 01:55:43.610236 20546 ts_tablet_manager.cc:1950] T 03bbed8181084cb88b7d33976c20fbb8 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:43.627609 20716 leader_election.cc:290] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:43.628906 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86825485bfca479ea63c1a99dddb68d6" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:43.629546 19475 raft_consensus.cc:3060] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:43.597357 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet 7daa1b799e0d408287edc03988f5b683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:43.619074 19591 tablet_service.cc:1511] Processing CreateTablet for tablet a23b494afa1f45988d447519356d2b03 (DEFAULT_TABLE table=default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:43.626585 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86825485bfca479ea63c1a99dddb68d6" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:43.631800 19620 raft_consensus.cc:3060] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:43.631421 20147 rpcz_store.cc:276] 0928 01:55:41.135907 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.136047 (+   140us) service_pool.cc:224] Handling call
0928 01:55:43.168401 (+2032354us) ts_tablet_manager.cc:1151] Deleting tablet 90b3c947794c48daaacc299a7d2dd4a9
0928 01:55:43.168453 (+    52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.362733 (+194280us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.588575 (+225842us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.592064 (+  3489us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2016259}
I20260928 01:55:43.632421 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a23b494afa1f45988d447519356d2b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:43.633747 20147 tablet_replica.cc:333] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:43.634518 20147 raft_consensus.cc:2243] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:43.634980 20147 raft_consensus.cc:2272] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:43.635629 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 90b3c947794c48daaacc299a7d2dd4a9 (table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]) successfully deleted
I20260928 01:55:43.637130 19890 tablet_bootstrap.cc:654] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:43.641000 20502 ts_tablet_manager.cc:1929] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:43.641433 20502 log.cc:1199] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/f71e2109f8cd4dd4a288fbdc8e50b133
W20260928 01:55:43.642024 19704 consensus_peers.cc:597] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:43.642239 20502 ts_tablet_manager.cc:1950] T f71e2109f8cd4dd4a288fbdc8e50b133 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:43.642717 19620 raft_consensus.cc:2468] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:43.643071 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 212) took 1876 ms. Trace:
I20260928 01:55:43.643389 20502 rpcz_store.cc:276] 0928 01:55:41.766722 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.766873 (+   151us) service_pool.cc:224] Handling call
0928 01:55:43.302504 (+1535631us) ts_tablet_manager.cc:1151] Deleting tablet f71e2109f8cd4dd4a288fbdc8e50b133
0928 01:55:43.302559 (+    55us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.446792 (+144233us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.640848 (+194056us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.643015 (+  2167us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1534914}
I20260928 01:55:43.644461 19704 leader_election.cc:304] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:43.644795 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet f71e2109f8cd4dd4a288fbdc8e50b133 (table default.Table_1e30aacb906b40aaa3a683c1495c78f2 [id=30ade53be61542a7a042a4401001fba9]) successfully deleted
I20260928 01:55:43.645431 20630 raft_consensus.cc:2804] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:43.646070 20630 raft_consensus.cc:697] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:43.647331 20630 consensus_queue.cc:237] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.649608 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 216) took 1816 ms. Trace:
I20260928 01:55:43.649940 20502 rpcz_store.cc:276] 0928 01:55:41.832831 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.832959 (+   128us) service_pool.cc:224] Handling call
0928 01:55:43.649248 (+1816289us) ts_tablet_manager.cc:1151] Deleting tablet 7a753f894ae94b1eaf9b445df3545ded
0928 01:55:43.649307 (+    59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.649542 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1815617}
W20260928 01:55:43.651367 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7a753f894ae94b1eaf9b445df3545ded because the tablet was not found. No further retry: Not found: Tablet not found: 7a753f894ae94b1eaf9b445df3545ded
I20260928 01:55:43.654996 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 217) took 1821 ms. Trace:
I20260928 01:55:43.660390 20502 rpcz_store.cc:276] 0928 01:55:41.833369 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.833700 (+   331us) service_pool.cc:224] Handling call
0928 01:55:43.654565 (+1820865us) ts_tablet_manager.cc:1151] Deleting tablet 03bbed8181084cb88b7d33976c20fbb8
0928 01:55:43.654638 (+    73us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.654932 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1820295}
W20260928 01:55:43.665307 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 03bbed8181084cb88b7d33976c20fbb8 because the tablet was not found. No further retry: Not found: Tablet not found: 03bbed8181084cb88b7d33976c20fbb8
I20260928 01:55:43.665582 19113 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet f709eccf4ab5413bbbd8b4746f185db4
I20260928 01:55:43.666244 20029 tablet_bootstrap.cc:492] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:43.666656 20502 tablet_replica.cc:333] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:43.666720 20522 ts_manager.cc:194] Registered new tserver with Master: 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:43.666992 20029 ts_tablet_manager.cc:1403] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.285s	user 0.004s	sys 0.012s
I20260928 01:55:43.667264 19113 catalog_manager.cc:6934] ReplaceTablet: tablet f709eccf4ab5413bbbd8b4746f185db4 deleted and replaced by tablet e43bec2c4274497ea73872d0db233eac
I20260928 01:55:43.667606 19113 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51212 (request call id 289) took 1117 ms. Trace:
I20260928 01:55:43.668673 19442 tablet_service.cc:1558] Processing DeleteTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 with delete_type TABLET_DATA_DELETED (replaced by tablet e43bec2c4274497ea73872d0db233eac) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:43.669417 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 with delete_type TABLET_DATA_DELETED (replaced by tablet e43bec2c4274497ea73872d0db233eac) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:43.669660 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 193) took 4026 ms. Trace:
I20260928 01:55:43.669948 20502 raft_consensus.cc:2243] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:43.670656 20502 pending_rounds.cc:70] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: Trying to abort 1 pending ops.
I20260928 01:55:43.670336 20546 rpcz_store.cc:276] 0928 01:55:39.643156 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.643472 (+   316us) service_pool.cc:224] Handling call
0928 01:55:43.424486 (+3781014us) ts_tablet_manager.cc:1151] Deleting tablet 03bbed8181084cb88b7d33976c20fbb8
0928 01:55:43.424538 (+    52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.483501 (+ 58963us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.579299 (+ 95798us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.669595 (+ 90296us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3778916}
I20260928 01:55:43.670878 20502 pending_rounds.cc:77] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334135985466613760 op_type: NO_OP noop_request { }
I20260928 01:55:43.671275 20502 raft_consensus.cc:2889] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:55:43.671600 20502 raft_consensus.cc:2272] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:43.667928 19113 rpcz_store.cc:276] 0928 01:55:42.550332 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:42.878631 (+328299us) service_pool.cc:224] Handling call
0928 01:55:43.667547 (+788916us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:43.516024 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:43.526256 (+ 10232us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:43.526304 (+    48us) write_op.cc:435] Acquired schema lock
0928 01:55:43.526318 (+    14us) tablet.cc:662] Decoding operations
0928 01:55:43.526891 (+   573us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:43.526931 (+    40us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:43.526975 (+    44us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:43.527283 (+   308us) tablet.cc:701] Row locks acquired
0928 01:55:43.527297 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:43.527484 (+   187us) write_op.cc:270] Start()
0928 01:55:43.527587 (+   103us) write_op.cc:276] Timestamp: P: 1790560543527404 usec, L: 0
0928 01:55:43.527711 (+   124us) op_driver.cc:348] REPLICATION: starting
0928 01:55:43.528464 (+   753us) log.cc:844] Serialized 625 byte log entry
0928 01:55:43.581674 (+ 53210us) op_driver.cc:464] REPLICATION: finished
0928 01:55:43.605828 (+ 24154us) write_op.cc:301] APPLY: starting
0928 01:55:43.605914 (+    86us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:43.606093 (+   179us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:43.606210 (+   117us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:43.613652 (+  7442us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:43.613870 (+   218us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:43.613917 (+    47us) write_op.cc:312] APPLY: finished
0928 01:55:43.614138 (+   221us) log.cc:844] Serialized 29 byte log entry
0928 01:55:43.651659 (+ 37521us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:43.651776 (+   117us) write_op.cc:454] Released schema lock
0928 01:55:43.651827 (+    51us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":23957,"num_ops":2,"prepare.queue_time_us":14747,"prepare.run_cpu_time_us":2522,"prepare.run_wall_time_us":13921,"replication_time_us":53850,"threads_started":1}]]}
I20260928 01:55:43.676343 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 with delete_type TABLET_DATA_DELETED (replaced by tablet e43bec2c4274497ea73872d0db233eac) from {username='slave'} at 127.0.0.1:44964
W20260928 01:55:43.682612 19703 consensus_peers.cc:597] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3741aec215343468b2d7bc952da03c8. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:43.683996 20502 ts_tablet_manager.cc:1916] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:43.685626 20769 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: acquiring CA information for follower catalog manager: success
I20260928 01:55:43.686021 19743 tablet_service.cc:1511] Processing CreateTablet for tablet a23b494afa1f45988d447519356d2b03 (DEFAULT_TABLE table=default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:43.686594 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 199) took 3507 ms. Trace:
I20260928 01:55:43.686950 20546 rpcz_store.cc:276] 0928 01:55:40.179136 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.179252 (+   116us) service_pool.cc:224] Handling call
0928 01:55:43.686163 (+3506911us) ts_tablet_manager.cc:1151] Deleting tablet 3c6cfc9ff3344a48b09730dfde79d6cf
0928 01:55:43.686220 (+    57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.686486 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3506323}
I20260928 01:55:43.687740 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a23b494afa1f45988d447519356d2b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:43.693305 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 03bbed8181084cb88b7d33976c20fbb8 (table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]) successfully deleted
W20260928 01:55:43.694480 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 3c6cfc9ff3344a48b09730dfde79d6cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c6cfc9ff3344a48b09730dfde79d6cf already in progress: creating tablet
I20260928 01:55:43.525549 19118 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:43.706426 20029 raft_consensus.cc:359] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:43.707892 20029 raft_consensus.cc:385] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:43.708280 20029 raft_consensus.cc:740] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:43.707473 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 200) took 3527 ms. Trace:
I20260928 01:55:43.709121 20546 rpcz_store.cc:276] 0928 01:55:40.180238 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.180340 (+   102us) service_pool.cc:224] Handling call
0928 01:55:43.687958 (+3507618us) ts_tablet_manager.cc:1151] Deleting tablet 49a73835e2854976b40b31fe752d1b1b
0928 01:55:43.688008 (+    50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.707403 (+ 19395us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3507015}
I20260928 01:55:43.453960 19896 ts_tablet_manager.cc:1434] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.000s
I20260928 01:55:43.520730 19521 heartbeater.cc:461] Registering TS with master...
I20260928 01:55:43.711035 20029 consensus_queue.cc:260] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:43.720763 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 49a73835e2854976b40b31fe752d1b1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49a73835e2854976b40b31fe752d1b1b already in progress: creating tablet
I20260928 01:55:43.721063 20546 tablet_replica.cc:333] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:43.726022 19442 tablet_service.cc:1511] Processing CreateTablet for tablet a23b494afa1f45988d447519356d2b03 (DEFAULT_TABLE table=default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:43.727285 19442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a23b494afa1f45988d447519356d2b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:43.729355 20546 raft_consensus.cc:2243] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:43.730423 20546 raft_consensus.cc:2272] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:43.731700 20732 raft_consensus.cc:493] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:43.732529 20546 ts_tablet_manager.cc:1916] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:43.732285 20732 raft_consensus.cc:515] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.733215 20029 ts_tablet_manager.cc:1434] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.003s
I20260928 01:55:43.734432 19896 tablet_bootstrap.cc:492] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:43.735357 20029 tablet_bootstrap.cc:492] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:43.745252 20147 ts_tablet_manager.cc:1916] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:43.747431 19475 raft_consensus.cc:2468] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:43.749406 19590 tablet_service.cc:1511] Processing CreateTablet for tablet 9f80b652a19a41968d1bfbaaf020b721 (DEFAULT_TABLE table=default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:43.750624 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f80b652a19a41968d1bfbaaf020b721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:43.752657 20749 raft_consensus.cc:493] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:43.753451 20749 raft_consensus.cc:515] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.757814 20249 raft_consensus.cc:493] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:43.758519 20249 raft_consensus.cc:515] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.761864 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:43.762990 19767 raft_consensus.cc:2393] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:43.764987 20502 ts_tablet_manager.cc:1929] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:43.765503 20502 log.cc:1199] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/c1f73a301c84482f897990ac5e5dd162
I20260928 01:55:43.766336 20502 ts_tablet_manager.cc:1950] T c1f73a301c84482f897990ac5e5dd162 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:43.766754 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:43.768677 19472 raft_consensus.cc:1275] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:55:43.769498 19890 tablet_bootstrap.cc:492] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:43.769984 19890 ts_tablet_manager.cc:1403] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.318s	user 0.009s	sys 0.006s
I20260928 01:55:43.771029 20716 consensus_queue.cc:1048] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:43.772535 19409 leader_election.cc:343] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:43.781196 19704 consensus_peers.cc:597] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 01:55:43.781963 19103 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2018f8b52f974554924f9ecfbd5a0f51 consensus state has no leader
I20260928 01:55:43.784729 20749 leader_election.cc:290] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:43.786653 20249 leader_election.cc:290] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:43.787791 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:43.788996 20553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 0) took 3983 ms. Trace:
I20260928 01:55:43.789728 19556 leader_election.cc:304] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:43.791663 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:43.800931 20249 raft_consensus.cc:3060] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:43.802150 19703 consensus_peers.cc:597] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f71e2109f8cd4dd4a288fbdc8e50b133. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:43.804345 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 221) took 1895 ms. Trace:
I20260928 01:55:43.804767 20502 rpcz_store.cc:276] 0928 01:55:41.909017 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.909161 (+   144us) service_pool.cc:224] Handling call
0928 01:55:43.666292 (+1757131us) ts_tablet_manager.cc:1151] Deleting tablet c1f73a301c84482f897990ac5e5dd162
0928 01:55:43.666364 (+    72us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.697505 (+ 31141us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.764827 (+ 67322us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.767182 (+  2355us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1756525}
I20260928 01:55:43.806324 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet c1f73a301c84482f897990ac5e5dd162 (table default.Table_9aeb2b485111496ea1fed85fd4c55531 [id=c6da5b1f292748818838b53ed38d64a3]) successfully deleted
I20260928 01:55:43.814296 19620 raft_consensus.cc:1275] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:55:43.815227 20029 tablet_bootstrap.cc:654] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:43.816138 20715 consensus_queue.cc:1048] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:55:43.818988 20732 leader_election.cc:290] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:43.819700 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:43.821251 19409 leader_election.cc:343] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:43.822142 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 222) took 1910 ms. Trace:
I20260928 01:55:43.822686 20502 rpcz_store.cc:276] 0928 01:55:41.911333 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.911469 (+   136us) service_pool.cc:224] Handling call
0928 01:55:43.818060 (+1906591us) ts_tablet_manager.cc:1151] Deleting tablet f3741aec215343468b2d7bc952da03c8
0928 01:55:43.818161 (+   101us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.822087 (+  3926us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1906054}
W20260928 01:55:43.823973 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet f3741aec215343468b2d7bc952da03c8 because the tablet was not found. No further retry: Not found: Tablet not found: f3741aec215343468b2d7bc952da03c8
I20260928 01:55:43.828550 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 225) took 1121 ms. Trace:
I20260928 01:55:43.840791 20502 rpcz_store.cc:276] 0928 01:55:42.707477 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:42.707670 (+   193us) service_pool.cc:224] Handling call
0928 01:55:43.828154 (+1120484us) ts_tablet_manager.cc:1151] Deleting tablet 22fc9eff28c4436fb383c3d7169171bb
0928 01:55:43.828220 (+    66us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.828488 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1119715}
W20260928 01:55:43.842360 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 22fc9eff28c4436fb383c3d7169171bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22fc9eff28c4436fb383c3d7169171bb already in progress: creating tablet
I20260928 01:55:43.843402 20502 tablet_replica.cc:333] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:43.843914 20634 consensus_queue.cc:1048] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:43.847152 20769 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 01:55:43.847303 20147 ts_tablet_manager.cc:1929] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 01:55:43.849784 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 60147.5us
I20260928 01:55:43.850260 20147 log.cc:1199] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/b699e0d862fa4a54bbd756625f4e692b
W20260928 01:55:43.850647 19412 leader_election.cc:343] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:43.851073 19412 leader_election.cc:304] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:43.854051 20749 raft_consensus.cc:2749] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:43.852867 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:43.857390 20147 ts_tablet_manager.cc:1950] T b699e0d862fa4a54bbd756625f4e692b P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:43.857488 19890 raft_consensus.cc:359] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.858166 19890 raft_consensus.cc:385] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:43.858429 19890 raft_consensus.cc:740] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:43.862382 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 189) took 2725 ms. Trace:
I20260928 01:55:43.868335 20147 rpcz_store.cc:276] 0928 01:55:41.137016 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.150008 (+ 12992us) service_pool.cc:224] Handling call
0928 01:55:43.633577 (+2483569us) ts_tablet_manager.cc:1151] Deleting tablet b699e0d862fa4a54bbd756625f4e692b
0928 01:55:43.633626 (+    49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.795042 (+161416us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.847171 (+ 52129us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.862317 (+ 15146us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2481079}
I20260928 01:55:43.869894 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 190) took 2718 ms. Trace:
I20260928 01:55:43.872728 20147 rpcz_store.cc:276] 0928 01:55:41.151078 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.155212 (+  4134us) service_pool.cc:224] Handling call
0928 01:55:43.869529 (+2714317us) ts_tablet_manager.cc:1151] Deleting tablet eac01fc222dd480cbed7cac37a0e6693
0928 01:55:43.869574 (+    45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.869835 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2677363}
I20260928 01:55:43.876978 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 191) took 2716 ms. Trace:
I20260928 01:55:43.877446 20147 rpcz_store.cc:276] 0928 01:55:41.160178 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.160373 (+   195us) service_pool.cc:224] Handling call
0928 01:55:43.876579 (+2716206us) ts_tablet_manager.cc:1151] Deleting tablet 8a5e07078b2a4fe59d9293d9511cbb6b
0928 01:55:43.876631 (+    52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.876912 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2684027}
I20260928 01:55:43.886672 19442 tablet_service.cc:1511] Processing CreateTablet for tablet 9f80b652a19a41968d1bfbaaf020b721 (DEFAULT_TABLE table=default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:43.887916 19442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f80b652a19a41968d1bfbaaf020b721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:43.898255 20522 ts_manager.cc:194] Registered new tserver with Master: 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:43.901520 19412 leader_election.cc:343] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:43.902031 19412 leader_election.cc:304] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:43.903184 20754 raft_consensus.cc:2749] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:43.906594 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet b699e0d862fa4a54bbd756625f4e692b (table default.Table_882a0296b9ba49ef94e01ab6602cfa6e [id=69979c2fb6c84f81a71c4e04deda37bf]) successfully deleted
I20260928 01:55:43.907645 20502 raft_consensus.cc:2243] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:43.908187 20502 raft_consensus.cc:2272] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 01:55:43.909152 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet eac01fc222dd480cbed7cac37a0e6693 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eac01fc222dd480cbed7cac37a0e6693 already in progress: creating tablet
I20260928 01:55:43.910219 20502 ts_tablet_manager.cc:1916] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:43.931525 20546 ts_tablet_manager.cc:1929] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:43.933287 20546 log.cc:1199] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/7a753f894ae94b1eaf9b445df3545ded
I20260928 01:55:43.948328 20546 ts_tablet_manager.cc:1950] T 7a753f894ae94b1eaf9b445df3545ded P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:43.950629 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 192) took 2784 ms. Trace:
I20260928 01:55:43.950971 20147 rpcz_store.cc:276] 0928 01:55:41.166387 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.166520 (+   133us) service_pool.cc:224] Handling call
0928 01:55:43.950366 (+2783846us) ts_tablet_manager.cc:1151] Deleting tablet 78a71904514a488083426f5fe07d12cd
0928 01:55:43.950412 (+    46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.950568 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2757567}
I20260928 01:55:43.951939 20147 tablet_replica.cc:333] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:43.954571 19446 tablet_service.cc:1511] Processing CreateTablet for tablet 10fa56df34ad44d88f1dd700c823d57c (DEFAULT_TABLE table=default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:43.859090 19890 consensus_queue.cc:260] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:43.952713 19742 tablet_service.cc:1511] Processing CreateTablet for tablet 10fa56df34ad44d88f1dd700c823d57c (DEFAULT_TABLE table=default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:43.961081 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10fa56df34ad44d88f1dd700c823d57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:43.892668 20249 raft_consensus.cc:2749] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:43.963230 19113 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:55:43.971017 19113 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:55:43.973093 19113 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:43.974359 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 202) took 3696 ms. Trace:
I20260928 01:55:43.974844 19113 catalog_manager.cc:5838] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:43.979857 19890 ts_tablet_manager.cc:1434] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.210s	user 0.005s	sys 0.003s
I20260928 01:55:43.985399 19113 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]). Expected version 2 got 0
I20260928 01:55:43.988530 20147 raft_consensus.cc:2243] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:43.989151 20147 raft_consensus.cc:2272] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:43.977195 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 9f80b652a19a41968d1bfbaaf020b721 (DEFAULT_TABLE table=default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:43.991951 20546 rpcz_store.cc:276] 0928 01:55:40.277727 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.279565 (+  1838us) service_pool.cc:224] Handling call
0928 01:55:43.710559 (+3430994us) ts_tablet_manager.cc:1151] Deleting tablet 7a753f894ae94b1eaf9b445df3545ded
0928 01:55:43.720937 (+ 10378us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.864899 (+143962us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.931369 (+ 66470us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:43.974280 (+ 42911us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7395,"tablet-delete.queue_time_us":3430288}
I20260928 01:55:43.992740 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f80b652a19a41968d1bfbaaf020b721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:43.993848 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 7a753f894ae94b1eaf9b445df3545ded (table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]) successfully deleted
I20260928 01:55:44.003118 19896 tablet_bootstrap.cc:654] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:44.017529 20147 ts_tablet_manager.cc:1916] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:43.993304 20546 tablet_replica.cc:333] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:44.024652 20546 raft_consensus.cc:2243] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:44.025333 20546 raft_consensus.cc:2272] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:44.027408 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 36076aa674b9401b9b76fbf066348d06 (DEFAULT_TABLE table=default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.028527 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36076aa674b9401b9b76fbf066348d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.029641 20546 ts_tablet_manager.cc:1916] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:44.030169 20029 tablet_bootstrap.cc:492] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:44.030609 20029 ts_tablet_manager.cc:1403] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.295s	user 0.007s	sys 0.004s
I20260928 01:55:44.032907 19592 tablet_service.cc:1511] Processing CreateTablet for tablet 10fa56df34ad44d88f1dd700c823d57c (DEFAULT_TABLE table=default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.034030 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10fa56df34ad44d88f1dd700c823d57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.037606 19890 tablet_bootstrap.cc:492] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:44.043385 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 8a5e07078b2a4fe59d9293d9511cbb6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a5e07078b2a4fe59d9293d9511cbb6b already in progress: creating tablet
I20260928 01:55:44.043805 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 36076aa674b9401b9b76fbf066348d06 (DEFAULT_TABLE table=default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:44.044664 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 78a71904514a488083426f5fe07d12cd because the tablet was not found. No further retry: Not found: Tablet not found: 78a71904514a488083426f5fe07d12cd
I20260928 01:55:44.044927 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36076aa674b9401b9b76fbf066348d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.051522 19446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10fa56df34ad44d88f1dd700c823d57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.036700 20029 raft_consensus.cc:359] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.061158 20029 raft_consensus.cc:385] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:44.061456 20029 raft_consensus.cc:740] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:44.063050 20029 consensus_queue.cc:260] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:44.067517 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 155370us
I20260928 01:55:44.085798 20502 ts_tablet_manager.cc:1929] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:44.085610 19593 tablet_service.cc:1511] Processing CreateTablet for tablet 7979940c4a2e470bbecc40384edf38c9 (DEFAULT_TABLE table=default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.086158 20502 log.cc:1199] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/ed6d3c1d99cc40febd285d0a8f5c3196
I20260928 01:55:44.086859 20502 ts_tablet_manager.cc:1950] T ed6d3c1d99cc40febd285d0a8f5c3196 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:44.087021 19593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7979940c4a2e470bbecc40384edf38c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.110237 19896 tablet_bootstrap.cc:492] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:44.110807 19896 ts_tablet_manager.cc:1403] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.391s	user 0.004s	sys 0.010s
I20260928 01:55:44.112452 20812 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 81ebb46a410e43ebaec3ef4dd13a71fc)
I20260928 01:55:44.113191 20812 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:44.120644 19203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 3 candidate_status { last_received { term: 2 index: 252 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:44.120900 19890 tablet_bootstrap.cc:654] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:44.126695 20546 ts_tablet_manager.cc:1929] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:44.126356 19591 tablet_service.cc:1511] Processing CreateTablet for tablet 11a7c70dba4e4b3b97104b5d65704b9d (DEFAULT_TABLE table=default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.132165 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 3 candidate_status { last_received { term: 2 index: 252 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:44.138986 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:55:44.140772 19112 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:44.142434 19447 tablet_service.cc:1511] Processing CreateTablet for tablet 7979940c4a2e470bbecc40384edf38c9 (DEFAULT_TABLE table=default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.142307 19112 catalog_manager.cc:5838] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:44.143781 19112 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]). Expected version 2 got 0
I20260928 01:55:44.128017 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a7c70dba4e4b3b97104b5d65704b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.149298 19442 tablet_service.cc:1511] Processing CreateTablet for tablet 36076aa674b9401b9b76fbf066348d06 (DEFAULT_TABLE table=default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.159248 19896 raft_consensus.cc:359] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.160260 19896 raft_consensus.cc:385] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:44.160732 19896 raft_consensus.cc:740] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:44.173974 20812 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:55:44.174816 20812 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260928 01:55:44.130960 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 208401us
I20260928 01:55:44.154814 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 7979940c4a2e470bbecc40384edf38c9 (DEFAULT_TABLE table=default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.185123 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7979940c4a2e470bbecc40384edf38c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.186949 19590 tablet_service.cc:1511] Processing CreateTablet for tablet 2018f8b52f974554924f9ecfbd5a0f51 (DEFAULT_TABLE table=default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.188020 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2018f8b52f974554924f9ecfbd5a0f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.189520 20546 log.cc:1199] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/90b3c947794c48daaacc299a7d2dd4a9
I20260928 01:55:44.190418 20546 ts_tablet_manager.cc:1950] T 90b3c947794c48daaacc299a7d2dd4a9 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:44.178395 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 11a7c70dba4e4b3b97104b5d65704b9d (DEFAULT_TABLE table=default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.087620 20502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 226) took 1179 ms. Trace:
I20260928 01:55:44.186492 19443 tablet_service.cc:1511] Processing CreateTablet for tablet 2018f8b52f974554924f9ecfbd5a0f51 (DEFAULT_TABLE table=default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.197757 19447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7979940c4a2e470bbecc40384edf38c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.220928 19443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2018f8b52f974554924f9ecfbd5a0f51. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:44.237114 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 158646us
I20260928 01:55:44.244520 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a7c70dba4e4b3b97104b5d65704b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.231792 20754 consensus_queue.cc:1048] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260928 01:55:44.253587 19445 tablet_service.cc:1511] Processing CreateTablet for tablet 8df69eb3a37445ed8a2be0ef3bf32cdb (DEFAULT_TABLE table=default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.221086 20502 rpcz_store.cc:276] 0928 01:55:42.908542 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:42.908680 (+   138us) service_pool.cc:224] Handling call
0928 01:55:43.843240 (+934560us) ts_tablet_manager.cc:1151] Deleting tablet ed6d3c1d99cc40febd285d0a8f5c3196
0928 01:55:43.843284 (+    44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:43.964738 (+121454us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.085657 (+120919us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.087563 (+  1906us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63305,"tablet-delete.queue_time_us":933953}
I20260928 01:55:44.256122 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet ed6d3c1d99cc40febd285d0a8f5c3196 (table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]) successfully deleted
W20260928 01:55:44.258033 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7daa1b799e0d408287edc03988f5b683 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7daa1b799e0d408287edc03988f5b683 already in progress: creating tablet
I20260928 01:55:44.258096 19592 tablet_service.cc:1511] Processing CreateTablet for tablet 8df69eb3a37445ed8a2be0ef3bf32cdb (DEFAULT_TABLE table=default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:44.259799 19104 catalog_manager.cc:5043] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet f709eccf4ab5413bbbd8b4746f185db4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f709eccf4ab5413bbbd8b4746f185db4 already in progress: creating tablet
I20260928 01:55:44.260643 20819 raft_consensus.cc:493] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:44.261924 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df69eb3a37445ed8a2be0ef3bf32cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.269083 20819 raft_consensus.cc:515] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:44.274735 19442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36076aa674b9401b9b76fbf066348d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.215107 19896 consensus_queue.cc:260] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.278486 19896 ts_tablet_manager.cc:1434] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.167s	user 0.006s	sys 0.001s
I20260928 01:55:44.279556 19896 tablet_bootstrap.cc:492] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:44.286425 20819 leader_election.cc:290] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:44.282021 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 203) took 3719 ms. Trace:
I20260928 01:55:44.287199 20546 rpcz_store.cc:276] 0928 01:55:40.562636 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.562765 (+   129us) service_pool.cc:224] Handling call
0928 01:55:43.993159 (+3430394us) ts_tablet_manager.cc:1151] Deleting tablet 90b3c947794c48daaacc299a7d2dd4a9
0928 01:55:43.993201 (+    42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.088370 (+ 95169us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.126558 (+ 38188us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.281940 (+155382us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3426739}
I20260928 01:55:44.288462 20546 tablet_replica.cc:333] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:44.289290 20546 raft_consensus.cc:2243] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:44.290112 19890 tablet_bootstrap.cc:492] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:44.290251 20546 raft_consensus.cc:2272] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:44.290548 19890 ts_tablet_manager.cc:1403] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.253s	user 0.011s	sys 0.003s
I20260928 01:55:44.292245 20546 ts_tablet_manager.cc:1916] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:44.297091 19117 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]). Expected version 1 got 0
I20260928 01:55:44.297927 19117 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:55:44.299335 19117 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
I20260928 01:55:44.300168 19117 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:55:44.300339 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:44.300891 19117 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]). Expected version 2 got 0
I20260928 01:55:44.301656 19117 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:55:44.311949 19117 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:44.317183 19601 tablet_service.cc:1511] Processing CreateTablet for tablet e927cd8a991f46278c2bb663cee7f753 (DEFAULT_TABLE table=default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.330514 19115 catalog_manager.cc:5838] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:44.332406 19890 raft_consensus.cc:359] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.333344 19890 raft_consensus.cc:385] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:44.333467 19115 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:44.333668 19890 raft_consensus.cc:740] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:44.334563 19890 consensus_queue.cc:260] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.334887 19115 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]). Expected version 1 got 0
W20260928 01:55:44.335177 20456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 196321us
I20260928 01:55:44.335865 19115 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:55:44.336028 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df69eb3a37445ed8a2be0ef3bf32cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.336527 19115 catalog_manager.cc:5838] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 2, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:44.338052 19115 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]). Expected version 2 got 0
I20260928 01:55:44.339039 19109 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 77c1f247486548ee9747403f7f80e3dc
I20260928 01:55:44.340521 20147 ts_tablet_manager.cc:1929] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260928 01:55:44.340765 19109 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 286) took 1796 ms. Trace:
I20260928 01:55:44.340906 20147 log.cc:1199] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/f3741aec215343468b2d7bc952da03c8
I20260928 01:55:44.342403 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e927cd8a991f46278c2bb663cee7f753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.358065 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c1f247486548ee9747403f7f80e3dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:47670
W20260928 01:55:44.328987 19704 leader_election.cc:343] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:44.371269 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 11a7c70dba4e4b3b97104b5d65704b9d (DEFAULT_TABLE table=default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.372541 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a7c70dba4e4b3b97104b5d65704b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.374547 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 897503329be649e38473561cea1fdaf1 (DEFAULT_TABLE table=default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.375555 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897503329be649e38473561cea1fdaf1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:44.330652 19703 consensus_peers.cc:597] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed6d3c1d99cc40febd285d0a8f5c3196. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:44.341660 20147 ts_tablet_manager.cc:1950] T f3741aec215343468b2d7bc952da03c8 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
W20260928 01:55:44.376394 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 45814.6us
I20260928 01:55:44.353358 20029 ts_tablet_manager.cc:1434] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.322s	user 0.009s	sys 0.010s
I20260928 01:55:44.393424 20807 raft_consensus.cc:493] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:44.394021 20807 raft_consensus.cc:515] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.395224 20029 tablet_bootstrap.cc:492] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:44.397305 20807 leader_election.cc:290] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:44.399986 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 90b3c947794c48daaacc299a7d2dd4a9 (table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]) successfully deleted
I20260928 01:55:44.401211 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 193) took 3233 ms. Trace:
I20260928 01:55:44.401678 20147 rpcz_store.cc:276] 0928 01:55:41.167700 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.167822 (+   122us) service_pool.cc:224] Handling call
0928 01:55:43.951789 (+2783967us) ts_tablet_manager.cc:1151] Deleting tablet f3741aec215343468b2d7bc952da03c8
0928 01:55:43.951828 (+    39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.143834 (+192006us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.340368 (+196534us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.401140 (+ 60772us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22478,"tablet-delete.queue_time_us":2758753}
I20260928 01:55:44.403463 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 194) took 2613 ms. Trace:
I20260928 01:55:44.404887 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 2018f8b52f974554924f9ecfbd5a0f51 (DEFAULT_TABLE table=default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.404947 20147 rpcz_store.cc:276] 0928 01:55:41.789640 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.789745 (+   105us) service_pool.cc:224] Handling call
0928 01:55:44.403088 (+2613343us) ts_tablet_manager.cc:1151] Deleting tablet 58c61408724e4a70b39e5dbdab9a3e8a
0928 01:55:44.403138 (+    50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.403399 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2612762}
I20260928 01:55:44.408641 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet f3741aec215343468b2d7bc952da03c8 (table default.Table_1d40de09d743485db2f538534e097074 [id=c314147c39ca4ef695e61de1652cf804]) successfully deleted
I20260928 01:55:44.341043 19109 rpcz_store.cc:276] 0928 01:55:42.544269 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:42.621596 (+ 77327us) service_pool.cc:224] Handling call
0928 01:55:42.622766 (+  1170us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:55:42.623298 (+   532us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:55:42.623426 (+   128us) catalog_manager.cc:2863] Locking tablets
0928 01:55:42.623939 (+   513us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:55:42.781552 (+157613us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:55:42.781720 (+   168us) catalog_manager.cc:2911] Committing in-memory state
0928 01:55:44.338951 (+1557231us) catalog_manager.cc:2915] Aborting table tasks
0928 01:55:44.340704 (+  1753us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:42.692331 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:42.692741 (+   410us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:42.692766 (+    25us) write_op.cc:435] Acquired schema lock
0928 01:55:42.692777 (+    11us) tablet.cc:662] Decoding operations
0928 01:55:42.693063 (+   286us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:42.693107 (+    44us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:42.693129 (+    22us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:42.693409 (+   280us) tablet.cc:701] Row locks acquired
0928 01:55:42.693422 (+    13us) write_op.cc:260] PREPARE: finished
0928 01:55:42.695325 (+  1903us) write_op.cc:270] Start()
0928 01:55:42.695420 (+    95us) write_op.cc:276] Timestamp: P: 1790560542695264 usec, L: 0
0928 01:55:42.695437 (+    17us) op_driver.cc:348] REPLICATION: starting
0928 01:55:42.695908 (+   471us) log.cc:844] Serialized 768 byte log entry
0928 01:55:42.776558 (+ 80650us) op_driver.cc:464] REPLICATION: finished
0928 01:55:42.780349 (+  3791us) write_op.cc:301] APPLY: starting
0928 01:55:42.780402 (+    53us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:42.780501 (+    99us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:42.780593 (+    92us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:42.780834 (+   241us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:42.780966 (+   132us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:42.781006 (+    40us) write_op.cc:312] APPLY: finished
0928 01:55:42.781161 (+   155us) log.cc:844] Serialized 29 byte log entry
0928 01:55:42.781285 (+   124us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:42.781349 (+    64us) write_op.cc:454] Released schema lock
0928 01:55:42.781377 (+    28us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:42.781582 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:42.781606 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3649,"apply.run_cpu_time_us":1201,"apply.run_wall_time_us":1201,"num_ops":2,"prepare.queue_time_us":66581,"prepare.run_cpu_time_us":2151,"prepare.run_wall_time_us":46448,"replication_time_us":81030}]]}
I20260928 01:55:44.430619 19113 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e] alter complete (version 1)
I20260928 01:55:44.430810 19118 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9] alter complete (version 5)
I20260928 01:55:44.430645 19111 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca] alter complete (version 1)
W20260928 01:55:44.445335 19112 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 36) took 1943 ms (client timeout 1000 ms). Trace:
I20260928 01:55:44.461331 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 197) took 2591 ms. Trace:
W20260928 01:55:44.461361 19110 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 35) took 3071 ms (client timeout 1000 ms). Trace:
W20260928 01:55:44.461671 19110 rpcz_store.cc:269] 0928 01:55:41.389466 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.389617 (+   151us) service_pool.cc:224] Handling call
0928 01:55:44.461282 (+3071665us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25123,"reported_tablets":11}
I20260928 01:55:44.461684 20147 rpcz_store.cc:276] 0928 01:55:41.869887 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.870008 (+   121us) service_pool.cc:224] Handling call
0928 01:55:44.460987 (+2590979us) ts_tablet_manager.cc:1151] Deleting tablet 7602706a3fbc438d8d448c9ac057087c
0928 01:55:44.461034 (+    47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.461275 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2590434}
I20260928 01:55:44.404659 19890 ts_tablet_manager.cc:1434] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.114s	user 0.005s	sys 0.004s
I20260928 01:55:44.463847 19890 tablet_bootstrap.cc:492] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:44.440917 19597 tablet_service.cc:1558] Processing DeleteTablet for tablet 03bbed8181084cb88b7d33976c20fbb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c007b068b1d414298cce3fe44a91daa) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:44.440917 19593 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bfcdfe218414396824a8f3af4d673ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:47670
W20260928 01:55:44.467430 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 58c61408724e4a70b39e5dbdab9a3e8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58c61408724e4a70b39e5dbdab9a3e8a already in progress: creating tablet
W20260928 01:55:44.468283 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 7602706a3fbc438d8d448c9ac057087c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7602706a3fbc438d8d448c9ac057087c already in progress: creating tablet
I20260928 01:55:44.477029 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 198) took 2606 ms. Trace:
I20260928 01:55:44.477422 20147 rpcz_store.cc:276] 0928 01:55:41.870194 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.870298 (+   104us) service_pool.cc:224] Handling call
0928 01:55:44.476453 (+2606155us) ts_tablet_manager.cc:1151] Deleting tablet 7ab79c6ad03e481a903a0f95ae0512e6
0928 01:55:44.476498 (+    45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.476969 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2605679}
I20260928 01:55:44.447376 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b3c947794c48daaacc299a7d2dd4a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 21906a8380e64d95b9454a57fc01c6f0) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:44.453454 19595 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a753f894ae94b1eaf9b445df3545ded with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:44.453953 19599 tablet_service.cc:1558] Processing DeleteTablet for tablet b699e0d862fa4a54bbd756625f4e692b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:44.454922 19598 tablet_service.cc:1558] Processing DeleteTablet for tablet f3741aec215343468b2d7bc952da03c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:44.456074 19594 tablet_service.cc:1511] Processing CreateTablet for tablet 522245da435b40ae84ae6dc5d19a2e95 (DEFAULT_TABLE table=default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.482105 19594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522245da435b40ae84ae6dc5d19a2e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.457428 19596 tablet_service.cc:1511] Processing CreateTablet for tablet 7441c2d1a7fa4dc8a89c6717a80d3efb (DEFAULT_TABLE table=default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.484915 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7441c2d1a7fa4dc8a89c6717a80d3efb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:44.486027 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 7ab79c6ad03e481a903a0f95ae0512e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ab79c6ad03e481a903a0f95ae0512e6 already in progress: creating tablet
W20260928 01:55:44.476125 19111 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 24) took 3768 ms (client timeout 1000 ms). Trace:
W20260928 01:55:44.498142 19118 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 25) took 2395 ms (client timeout 1000 ms). Trace:
I20260928 01:55:44.500140 19590 tablet_service.cc:1511] Processing CreateTablet for tablet fb159b3aad31479f80683b0d80549cc3 (DEFAULT_TABLE table=default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.501353 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb159b3aad31479f80683b0d80549cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.405211 19742 tablet_service.cc:1511] Processing CreateTablet for tablet 8df69eb3a37445ed8a2be0ef3bf32cdb (DEFAULT_TABLE table=default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.502609 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df69eb3a37445ed8a2be0ef3bf32cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.406742 19746 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c1f247486548ee9747403f7f80e3dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:44.487282 20147 tablet_replica.cc:333] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:44.406867 19743 tablet_service.cc:1511] Processing CreateTablet for tablet e927cd8a991f46278c2bb663cee7f753 (DEFAULT_TABLE table=default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.504923 20147 raft_consensus.cc:2243] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:44.505074 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e927cd8a991f46278c2bb663cee7f753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.505411 20147 raft_consensus.cc:2272] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:44.408046 19740 tablet_service.cc:1511] Processing CreateTablet for tablet 897503329be649e38473561cea1fdaf1 (DEFAULT_TABLE table=default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.508947 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897503329be649e38473561cea1fdaf1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:44.445709 19112 rpcz_store.cc:269] 0928 01:55:42.502373 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:42.502503 (+   130us) service_pool.cc:224] Handling call
0928 01:55:44.266372 (+1763869us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:44.266399 (+    27us) write_op.cc:454] Released schema lock
0928 01:55:44.445255 (+178856us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:44.212867 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:44.213293 (+   426us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:44.213319 (+    26us) write_op.cc:435] Acquired schema lock
0928 01:55:44.213331 (+    12us) tablet.cc:662] Decoding operations
0928 01:55:44.213595 (+   264us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:44.213635 (+    40us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:44.213660 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:44.213817 (+   157us) tablet.cc:701] Row locks acquired
0928 01:55:44.213829 (+    12us) write_op.cc:260] PREPARE: finished
0928 01:55:44.213958 (+   129us) write_op.cc:270] Start()
0928 01:55:44.214042 (+    84us) write_op.cc:276] Timestamp: P: 1790560544213913 usec, L: 0
0928 01:55:44.214056 (+    14us) op_driver.cc:348] REPLICATION: starting
0928 01:55:44.214665 (+   609us) log.cc:844] Serialized 530 byte log entry
0928 01:55:44.250388 (+ 35723us) op_driver.cc:464] REPLICATION: finished
0928 01:55:44.250819 (+   431us) write_op.cc:301] APPLY: starting
0928 01:55:44.250888 (+    69us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:44.251036 (+   148us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:44.251209 (+   173us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:44.251457 (+   248us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:44.251650 (+   193us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:44.251720 (+    70us) write_op.cc:312] APPLY: finished
0928 01:55:44.251969 (+   249us) log.cc:844] Serialized 23 byte log entry
0928 01:55:44.252216 (+   247us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:44.252295 (+    79us) write_op.cc:454] Released schema lock
0928 01:55:44.252367 (+    72us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":5,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":233,"apply.run_cpu_time_us":1809,"apply.run_wall_time_us":1808,"mutex_wait_us":65393,"num_ops":1,"prepare.queue_time_us":65567,"prepare.run_cpu_time_us":2112,"prepare.run_wall_time_us":3187,"raft.queue_time_us":222,"raft.run_cpu_time_us":1195,"raft.run_wall_time_us":2200,"replication_time_us":36205}]]}
I20260928 01:55:44.511708 19112 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_c559f34b8864494f82ca062207ebbecf"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:44.476935 20754 consensus_queue.cc:1048] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
W20260928 01:55:44.513288 19112 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c559f34b8864494f82ca062207ebbecf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:44.514117 19446 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c1f247486548ee9747403f7f80e3dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:44.515177 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:44.429461 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:44.516451 19470 raft_consensus.cc:2468] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:44.518019 19454 tablet_service.cc:1511] Processing CreateTablet for tablet e927cd8a991f46278c2bb663cee7f753 (DEFAULT_TABLE table=default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.522505 19890 tablet_bootstrap.cc:654] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:44.524019 19444 tablet_service.cc:1511] Processing CreateTablet for tablet 522245da435b40ae84ae6dc5d19a2e95 (DEFAULT_TABLE table=default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:44.524307 19701 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 115733us
I20260928 01:55:44.525466 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:44.525481 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 7441c2d1a7fa4dc8a89c6717a80d3efb (DEFAULT_TABLE table=default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.528623 19553 leader_election.cc:304] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:44.529997 20807 raft_consensus.cc:2749] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:44.537335 19446 tablet_service.cc:1511] Processing CreateTablet for tablet 897503329be649e38473561cea1fdaf1 (DEFAULT_TABLE table=default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:44.496574 19111 rpcz_store.cc:269] 0928 01:55:40.707399 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.708151 (+   752us) service_pool.cc:224] Handling call
0928 01:55:44.476056 (+3767905us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:41.731258 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:41.731677 (+   419us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:41.731703 (+    26us) write_op.cc:435] Acquired schema lock
0928 01:55:41.731717 (+    14us) tablet.cc:662] Decoding operations
0928 01:55:41.741344 (+  9627us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:41.741389 (+    45us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:41.741416 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:41.741590 (+   174us) tablet.cc:701] Row locks acquired
0928 01:55:41.741605 (+    15us) write_op.cc:260] PREPARE: finished
0928 01:55:41.741731 (+   126us) write_op.cc:270] Start()
0928 01:55:41.741833 (+   102us) write_op.cc:276] Timestamp: P: 1790560541741676 usec, L: 0
0928 01:55:41.741849 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:55:41.755077 (+ 13228us) log.cc:844] Serialized 356 byte log entry
0928 01:55:41.807899 (+ 52822us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b6aa1 00007f19fd7495e8 00007f19fdbd9791 00007f19fdbd8f68 00007f19fdbddc01 00007f19fdbddbb9 00007f19fdbddb49 00007f19fdbddb11 00007f19fdbdcd3d 00000000005bd4e4 00000000005bd319
0928 01:55:42.079133 (+271234us) op_driver.cc:464] REPLICATION: finished
0928 01:55:42.080444 (+  1311us) write_op.cc:301] APPLY: starting
0928 01:55:42.080531 (+    87us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:42.080676 (+   145us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:42.080710 (+    34us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:42.081246 (+   536us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:42.081456 (+   210us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:42.081532 (+    76us) write_op.cc:312] APPLY: finished
0928 01:55:42.081827 (+   295us) log.cc:844] Serialized 23 byte log entry
0928 01:55:42.082036 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:42.082128 (+    92us) write_op.cc:454] Released schema lock
0928 01:55:42.082174 (+    46us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:42.082516 (+   342us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:42.082557 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28369,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":1114,"apply.run_cpu_time_us":2007,"apply.run_wall_time_us":2007,"num_ops":1,"prepare.queue_time_us":19719,"prepare.run_cpu_time_us":3300,"prepare.run_wall_time_us":76783,"replication_time_us":337166,"spinlock_wait_cycles":28647680}]]}
I20260928 01:55:44.540383 20147 ts_tablet_manager.cc:1916] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:44.543972 19111 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51212:
name: "default.Table_8ed439758c9f4e8caca3ed1a1775855d"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:55:44.547199 20029 tablet_bootstrap.cc:654] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:44.549350 19111 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ed439758c9f4e8caca3ed1a1775855d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:55:44.554180 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e927cd8a991f46278c2bb663cee7f753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.561815 19592 tablet_service.cc:1511] Processing CreateTablet for tablet a01b795606604960bc7cafab4ff6f3d0 (DEFAULT_TABLE table=default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.563061 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01b795606604960bc7cafab4ff6f3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.565240 19441 tablet_service.cc:1511] Processing CreateTablet for tablet a01b795606604960bc7cafab4ff6f3d0 (DEFAULT_TABLE table=default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.567355 20502 tablet_replica.cc:333] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:44.568167 20502 raft_consensus.cc:2243] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:44.568861 20502 raft_consensus.cc:2272] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:44.571959 20029 tablet_bootstrap.cc:492] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:44.571950 20502 ts_tablet_manager.cc:1916] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:44.573012 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7441c2d1a7fa4dc8a89c6717a80d3efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.576967 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522245da435b40ae84ae6dc5d19a2e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.577782 20029 ts_tablet_manager.cc:1403] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.183s	user 0.007s	sys 0.004s
I20260928 01:55:44.583508 19896 tablet_bootstrap.cc:654] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:44.585703 19703 leader_election.cc:304] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:44.586807 20816 raft_consensus.cc:2804] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:44.587273 20816 raft_consensus.cc:493] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:44.588510 20816 raft_consensus.cc:3060] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:44.592955 19456 tablet_service.cc:1511] Processing CreateTablet for tablet fb159b3aad31479f80683b0d80549cc3 (DEFAULT_TABLE table=default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.594131 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb159b3aad31479f80683b0d80549cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.595109 19109 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:55:44.596868 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2018f8b52f974554924f9ecfbd5a0f51. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:55:44.498504 19118 rpcz_store.cc:269] 0928 01:55:42.102242 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:42.126357 (+ 24115us) service_pool.cc:224] Handling call
0928 01:55:42.159723 (+ 33366us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:44.498077 (+2338354us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:43.819740 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:43.820189 (+   449us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:43.820239 (+    50us) write_op.cc:435] Acquired schema lock
0928 01:55:43.820252 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:43.820514 (+   262us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:43.820553 (+    39us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:43.820576 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:43.820742 (+   166us) tablet.cc:701] Row locks acquired
0928 01:55:43.820755 (+    13us) write_op.cc:260] PREPARE: finished
0928 01:55:43.820874 (+   119us) write_op.cc:270] Start()
0928 01:55:43.820961 (+    87us) write_op.cc:276] Timestamp: P: 1790560543820821 usec, L: 0
0928 01:55:43.820976 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:43.833066 (+ 12090us) log.cc:844] Serialized 530 byte log entry
0928 01:55:43.834629 (+  1563us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b6aa1 00007f19fd7495e8 00007f19fdbd9791 00007f19fdbd8f68 00007f19fdbddc01 00007f19fdbddbb9 00007f19fdbddb49 00007f19fdbddb11 00007f19fdbdcd3d 00000000005bd4e4 00000000005bd319
0928 01:55:43.893051 (+ 58422us) op_driver.cc:464] REPLICATION: finished
0928 01:55:43.902547 (+  9496us) write_op.cc:301] APPLY: starting
0928 01:55:43.902617 (+    70us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:43.902720 (+   103us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:43.902738 (+    18us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:43.902928 (+   190us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:43.903066 (+   138us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:43.903110 (+    44us) write_op.cc:312] APPLY: finished
0928 01:55:43.903300 (+   190us) log.cc:844] Serialized 23 byte log entry
0928 01:55:43.904119 (+   819us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:43.904218 (+    99us) write_op.cc:454] Released schema lock
0928 01:55:43.904252 (+    34us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:43.904491 (+   239us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:43.904515 (+    24us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:55:44.348452 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:44.348886 (+   434us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:44.348916 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:55:44.348940 (+    24us) tablet.cc:662] Decoding operations
0928 01:55:44.349224 (+   284us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:44.349266 (+    42us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:44.349287 (+    21us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:44.349464 (+   177us) tablet.cc:701] Row locks acquired
0928 01:55:44.349477 (+    13us) write_op.cc:260] PREPARE: finished
0928 01:55:44.349608 (+   131us) write_op.cc:270] Start()
0928 01:55:44.349700 (+    92us) write_op.cc:276] Timestamp: P: 1790560544349559 usec, L: 0
0928 01:55:44.349717 (+    17us) op_driver.cc:348] REPLICATION: starting
0928 01:55:44.350297 (+   580us) log.cc:844] Serialized 356 byte log entry
0928 01:55:44.402404 (+ 52107us) op_driver.cc:464] REPLICATION: finished
0928 01:55:44.402921 (+   517us) write_op.cc:301] APPLY: starting
0928 01:55:44.402994 (+    73us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:44.403169 (+   175us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:44.403333 (+   164us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:44.403620 (+   287us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:44.403940 (+   320us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:44.404031 (+    91us) write_op.cc:312] APPLY: finished
0928 01:55:44.404355 (+   324us) log.cc:844] Serialized 23 byte log entry
0928 01:55:44.404571 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:44.404681 (+   110us) write_op.cc:454] Released schema lock
0928 01:55:44.404730 (+    49us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:44.405075 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:44.405114 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"spinlock_wait_cycles":55433600,"child_traces":[["op",{"apply.queue_time_us":549,"apply.run_cpu_time_us":1302,"apply.run_wall_time_us":1943,"num_ops":1,"prepare.queue_time_us":113127,"prepare.run_cpu_time_us":2657,"prepare.run_wall_time_us":15082,"raft.queue_time_us":36531,"raft.run_cpu_time_us":809,"raft.run_wall_time_us":896,"replication_time_us":71967,"spinlock_wait_cycles":26602752}],["op",{"apply.queue_time_us":268,"apply.run_cpu_time_us":2104,"apply.run_wall_time_us":2103,"num_ops":1,"prepare.queue_time_us":1891,"prepare.run_cpu_time_us":2162,"prepare.run_wall_time_us":2164,"raft.queue_time_us":5902,"raft.run_cpu_time_us":1094,"raft.run_wall_time_us":1096,"replication_time_us":52574}]]}
I20260928 01:55:44.618808 19746 tablet_service.cc:1511] Processing CreateTablet for tablet 522245da435b40ae84ae6dc5d19a2e95 (DEFAULT_TABLE table=default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.620025 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522245da435b40ae84ae6dc5d19a2e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.611692 20029 raft_consensus.cc:359] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.624387 20029 raft_consensus.cc:385] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:44.624684 20029 raft_consensus.cc:740] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:44.625361 20029 consensus_queue.cc:260] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.599900 20816 raft_consensus.cc:515] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:44.637465 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 7441c2d1a7fa4dc8a89c6717a80d3efb (DEFAULT_TABLE table=default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.638620 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d9b93f45ccf44e785b00849e49c8294 with delete_type TABLET_DATA_DELETED (replaced by tablet 49a73835e2854976b40b31fe752d1b1b) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:44.638659 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7441c2d1a7fa4dc8a89c6717a80d3efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.641207 20147 ts_tablet_manager.cc:1929] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260928 01:55:44.641573 20147 log.cc:1199] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/d66eeaf33aa943c09f52b74360e2332d
I20260928 01:55:44.642313 20147 ts_tablet_manager.cc:1950] T d66eeaf33aa943c09f52b74360e2332d P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:44.651804 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 200) took 2771 ms. Trace:
I20260928 01:55:44.652307 20147 rpcz_store.cc:276] 0928 01:55:41.880575 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.880698 (+   123us) service_pool.cc:224] Handling call
0928 01:55:44.487134 (+2606436us) ts_tablet_manager.cc:1151] Deleting tablet d66eeaf33aa943c09f52b74360e2332d
0928 01:55:44.487176 (+    42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.610746 (+123570us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.641066 (+ 30320us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.644195 (+  3129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2605860}
I20260928 01:55:44.662050 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 209) took 2303 ms. Trace:
I20260928 01:55:44.662385 20147 rpcz_store.cc:276] 0928 01:55:42.358620 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:42.393957 (+ 35337us) service_pool.cc:224] Handling call
0928 01:55:44.661604 (+2267647us) ts_tablet_manager.cc:1151] Deleting tablet 22fc9eff28c4436fb383c3d7169171bb
0928 01:55:44.661651 (+    47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.661976 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2266997}
I20260928 01:55:44.667744 19890 tablet_bootstrap.cc:492] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:44.668190 19890 ts_tablet_manager.cc:1403] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.205s	user 0.016s	sys 0.013s
I20260928 01:55:44.671718 19890 raft_consensus.cc:359] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.672514 19890 raft_consensus.cc:385] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:44.672780 19890 raft_consensus.cc:740] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:44.673395 19890 consensus_queue.cc:260] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.681845 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bfcdfe218414396824a8f3af4d673ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:27 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:44.682991 19890 ts_tablet_manager.cc:1434] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260928 01:55:44.683141 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 03bbed8181084cb88b7d33976c20fbb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c007b068b1d414298cce3fe44a91daa) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:44.684717 20029 ts_tablet_manager.cc:1434] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.107s	user 0.008s	sys 0.000s
I20260928 01:55:44.688344 20807 raft_consensus.cc:493] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:44.691162 20807 raft_consensus.cc:515] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.695326 19890 tablet_bootstrap.cc:492] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:44.699496 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b3c947794c48daaacc299a7d2dd4a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 21906a8380e64d95b9454a57fc01c6f0) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:44.700699 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 78a71904514a488083426f5fe07d12cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:44.700870 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:44.701457 19474 raft_consensus.cc:3060] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:44.701834 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet f71e2109f8cd4dd4a288fbdc8e50b133 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:44.702817 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f08e6838341436f8a85d6dbafc805df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:44.704384 19734 tablet_service.cc:1511] Processing CreateTablet for tablet fb159b3aad31479f80683b0d80549cc3 (DEFAULT_TABLE table=default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.706195 19446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897503329be649e38473561cea1fdaf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.706323 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb159b3aad31479f80683b0d80549cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.708596 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01b795606604960bc7cafab4ff6f3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.711467 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:44.712951 19704 leader_election.cc:343] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:44.713522 20816 leader_election.cc:290] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:44.714433 20029 tablet_bootstrap.cc:492] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:44.723589 20804 consensus_queue.cc:1048] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:44.748700 19704 consensus_peers.cc:597] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3741aec215343468b2d7bc952da03c8. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:44.732488 20807 leader_election.cc:290] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:44.736706 19556 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
I20260928 01:55:44.726106 20147 tablet_replica.cc:333] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:44.750703 20147 raft_consensus.cc:2243] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:44.751253 20147 raft_consensus.cc:2272] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:44.753334 20147 ts_tablet_manager.cc:1916] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:44.760593 19748 tablet_service.cc:1511] Processing CreateTablet for tablet a01b795606604960bc7cafab4ff6f3d0 (DEFAULT_TABLE table=default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:44.760824 20811 raft_consensus.cc:493] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:44.761415 20811 raft_consensus.cc:515] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.762619 20546 ts_tablet_manager.cc:1929] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:44.762988 20546 log.cc:1199] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/b699e0d862fa4a54bbd756625f4e692b
I20260928 01:55:44.763741 20546 ts_tablet_manager.cc:1950] T b699e0d862fa4a54bbd756625f4e692b P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:44.764413 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a753f894ae94b1eaf9b445df3545ded with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:44.765460 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edf7a5d724c88992fecbadd2cedfa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:44.767220 19704 leader_election.cc:343] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:44.769819 19620 raft_consensus.cc:3060] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:44.776168 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f73a301c84482f897990ac5e5dd162" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:44.776925 19767 raft_consensus.cc:2393] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:44.778208 20811 leader_election.cc:290] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:44.775295 19890 tablet_bootstrap.cc:654] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:44.788852 20029 tablet_bootstrap.cc:654] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:44.794791 19553 leader_election.cc:304] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:44.796335 20807 raft_consensus.cc:3060] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:44.806689 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 204) took 4102 ms. Trace:
I20260928 01:55:44.807092 20546 rpcz_store.cc:276] 0928 01:55:40.703952 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.723017 (+ 19065us) service_pool.cc:224] Handling call
0928 01:55:44.288311 (+3565294us) ts_tablet_manager.cc:1151] Deleting tablet b699e0d862fa4a54bbd756625f4e692b
0928 01:55:44.288353 (+    42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.409758 (+121405us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.762489 (+352731us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.806614 (+ 44125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3411252}
I20260928 01:55:44.807981 20029 tablet_bootstrap.cc:492] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:44.808744 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01b795606604960bc7cafab4ff6f3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:44.813177 20807 raft_consensus.cc:2749] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:44.817972 19890 tablet_bootstrap.cc:492] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:44.818416 19890 ts_tablet_manager.cc:1403] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.123s	user 0.006s	sys 0.008s
I20260928 01:55:44.818421 20029 ts_tablet_manager.cc:1403] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.004s
I20260928 01:55:44.821074 19890 raft_consensus.cc:359] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.821758 19890 raft_consensus.cc:385] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:44.822021 19890 raft_consensus.cc:740] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:44.822649 19890 consensus_queue.cc:260] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.832518 20029 raft_consensus.cc:359] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:44.844372 20029 raft_consensus.cc:385] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:44.844784 20029 raft_consensus.cc:740] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:44.837495 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 206) took 4132 ms. Trace:
I20260928 01:55:44.845643 20546 rpcz_store.cc:276] 0928 01:55:40.704619 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.704736 (+   117us) service_pool.cc:224] Handling call
0928 01:55:44.837110 (+4132374us) ts_tablet_manager.cc:1151] Deleting tablet eac01fc222dd480cbed7cac37a0e6693
0928 01:55:44.837157 (+    47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.837434 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3959413}
I20260928 01:55:44.848225 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 208) took 4135 ms. Trace:
I20260928 01:55:44.849543 20546 rpcz_store.cc:276] 0928 01:55:40.712573 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.712785 (+   212us) service_pool.cc:224] Handling call
0928 01:55:44.847929 (+4135144us) ts_tablet_manager.cc:1151] Deleting tablet 599ef1523fcf43d1a1e2a91f03abaa60
0928 01:55:44.847972 (+    43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.848150 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5489,"tablet-delete.queue_time_us":3970203}
I20260928 01:55:44.846632 20029 consensus_queue.cc:260] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:44.853468 19890 ts_tablet_manager.cc:1434] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260928 01:55:44.854518 19890 tablet_bootstrap.cc:492] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:44.854846 20502 ts_tablet_manager.cc:1929] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 01:55:44.855216 20502 log.cc:1199] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/77c1f247486548ee9747403f7f80e3dc
I20260928 01:55:44.856088 20502 ts_tablet_manager.cc:1950] T 77c1f247486548ee9747403f7f80e3dc P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:44.856235 20147 ts_tablet_manager.cc:1929] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:44.856612 20147 log.cc:1199] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/ed6d3c1d99cc40febd285d0a8f5c3196
I20260928 01:55:44.857249 20147 ts_tablet_manager.cc:1950] T ed6d3c1d99cc40febd285d0a8f5c3196 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:44.859153 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 210) took 1956 ms. Trace:
I20260928 01:55:44.859756 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edf7a5d724c88992fecbadd2cedfa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:44.860363 19470 raft_consensus.cc:2468] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:44.861757 19703 leader_election.cc:304] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:44.867007 20546 tablet_replica.cc:333] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:44.868821 20546 raft_consensus.cc:2243] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Raft consensus shutting down.
I20260928 01:55:44.867946 20029 ts_tablet_manager.cc:1434] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260928 01:55:44.870687 20029 tablet_bootstrap.cc:492] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:44.859436 20147 rpcz_store.cc:276] 0928 01:55:42.903002 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:42.903149 (+   147us) service_pool.cc:224] Handling call
0928 01:55:44.725879 (+1822730us) ts_tablet_manager.cc:1151] Deleting tablet ed6d3c1d99cc40febd285d0a8f5c3196
0928 01:55:44.725947 (+    68us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.797241 (+ 71294us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.842128 (+ 44887us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.859091 (+ 16963us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1822118}
I20260928 01:55:44.873857 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 212) took 1277 ms. Trace:
I20260928 01:55:44.874318 20546 raft_consensus.cc:2272] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:44.874166 20147 rpcz_store.cc:276] 0928 01:55:43.596723 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:43.597038 (+   315us) service_pool.cc:224] Handling call
0928 01:55:44.873435 (+1276397us) ts_tablet_manager.cc:1151] Deleting tablet 7daa1b799e0d408287edc03988f5b683
0928 01:55:44.873479 (+    44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.873796 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1241967}
I20260928 01:55:44.876825 20811 raft_consensus.cc:2804] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:44.877277 20811 raft_consensus.cc:493] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:44.876286 19890 tablet_bootstrap.cc:654] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:44.883920 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 214) took 1215 ms. Trace:
I20260928 01:55:44.884330 20147 rpcz_store.cc:276] 0928 01:55:43.668997 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:43.669158 (+   161us) service_pool.cc:224] Handling call
0928 01:55:44.883443 (+1214285us) ts_tablet_manager.cc:1151] Deleting tablet f709eccf4ab5413bbbd8b4746f185db4
0928 01:55:44.883493 (+    50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.883854 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1213471}
I20260928 01:55:44.885809 20147 tablet_replica.cc:333] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:55:44.877703 20811 raft_consensus.cc:3060] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:44.886595 20147 raft_consensus.cc:2243] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:44.887117 20147 raft_consensus.cc:2272] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:44.887861 19474 raft_consensus.cc:2468] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:44.889225 20147 ts_tablet_manager.cc:1916] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:44.890749 19703 leader_election.cc:304] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:44.895783 20804 raft_consensus.cc:2804] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:44.896370 20804 raft_consensus.cc:697] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:44.897221 20754 raft_consensus.cc:493] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:44.897300 20804 consensus_queue.cc:237] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:44.897971 20754 raft_consensus.cc:515] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.903565 20546 ts_tablet_manager.cc:1916] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:44.903205 20754 leader_election.cc:290] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:44.907464 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287060a8d054b15b2252dcf280ca8c2" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:44.908958 19409 leader_election.cc:343] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:44.934406 20811 raft_consensus.cc:515] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.936501 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287060a8d054b15b2252dcf280ca8c2" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:44.943120 19614 raft_consensus.cc:3060] T 3f4a1c903a04450684ba38081a75559e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:44.948655 19412 leader_election.cc:343] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:44.949186 19412 leader_election.cc:304] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:44.949972 20754 raft_consensus.cc:2749] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:44.944692 20029 tablet_bootstrap.cc:654] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:44.947597 20815 consensus_queue.cc:1048] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:44.954867 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 160163us
I20260928 01:55:44.956568 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edf7a5d724c88992fecbadd2cedfa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:44.958426 19704 leader_election.cc:343] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:44.961218 20811 leader_election.cc:290] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:44.963635 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edf7a5d724c88992fecbadd2cedfa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:44.964495 19475 raft_consensus.cc:3060] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:44.975440 20546 ts_tablet_manager.cc:1929] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260928 01:55:44.979904 20029 tablet_bootstrap.cc:492] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:44.980458 20546 log.cc:1199] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/f3741aec215343468b2d7bc952da03c8
I20260928 01:55:44.980533 20029 ts_tablet_manager.cc:1403] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.110s	user 0.007s	sys 0.008s
I20260928 01:55:44.981360 20546 ts_tablet_manager.cc:1950] T f3741aec215343468b2d7bc952da03c8 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:44.985036 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 209) took 4261 ms. Trace:
I20260928 01:55:44.989151 20546 rpcz_store.cc:276] 0928 01:55:40.723352 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.724092 (+   740us) service_pool.cc:224] Handling call
0928 01:55:44.853187 (+4129095us) ts_tablet_manager.cc:1151] Deleting tablet f3741aec215343468b2d7bc952da03c8
0928 01:55:44.853232 (+    45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.943317 (+ 90085us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.975299 (+ 31982us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.984977 (+  9678us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3969766}
I20260928 01:55:44.983162 20029 raft_consensus.cc:359] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.990356 20029 raft_consensus.cc:385] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:44.990757 20029 raft_consensus.cc:740] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:44.991164 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 210) took 3974 ms. Trace:
I20260928 01:55:44.993494 20546 rpcz_store.cc:276] 0928 01:55:41.017265 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.017387 (+   122us) service_pool.cc:224] Handling call
0928 01:55:44.990673 (+3973286us) ts_tablet_manager.cc:1151] Deleting tablet 8a5e07078b2a4fe59d9293d9511cbb6b
0928 01:55:44.990773 (+   100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.991110 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3972671}
I20260928 01:55:44.991432 20029 consensus_queue.cc:260] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:44.997682 20029 ts_tablet_manager.cc:1434] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260928 01:55:44.999398 20029 tablet_bootstrap.cc:492] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:55:44.999626 20827 log.cc:927] Time spent T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260928 01:55:45.006033 20811 raft_consensus.cc:493] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:45.006542 20811 raft_consensus.cc:515] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.009977 20811 leader_election.cc:290] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:45.011335 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8d07b367b4fafbd7171f8ea7b2a26" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:45.011968 19621 raft_consensus.cc:2468] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:45.012542 20029 tablet_bootstrap.cc:654] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:45.013233 19704 leader_election.cc:304] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:45.014087 20811 raft_consensus.cc:2804] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:45.014490 20811 raft_consensus.cc:493] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:45.014954 20811 raft_consensus.cc:3060] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:45.027247 20811 raft_consensus.cc:515] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.049732 20839 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 81ebb46a410e43ebaec3ef4dd13a71fc)
I20260928 01:55:45.028244 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 213) took 3365 ms. Trace:
I20260928 01:55:45.029386 20029 tablet_bootstrap.cc:492] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:45.051040 20029 ts_tablet_manager.cc:1403] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.005s
I20260928 01:55:45.050844 20546 rpcz_store.cc:276] 0928 01:55:41.630986 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.632001 (+  1015us) service_pool.cc:224] Handling call
0928 01:55:44.995987 (+3363986us) ts_tablet_manager.cc:1151] Deleting tablet 58c61408724e4a70b39e5dbdab9a3e8a
0928 01:55:44.996030 (+    43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:44.996424 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3363291}
I20260928 01:55:45.052767 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 216) took 3317 ms. Trace:
I20260928 01:55:45.053320 20546 rpcz_store.cc:276] 0928 01:55:41.735386 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.735524 (+   138us) service_pool.cc:224] Handling call
0928 01:55:45.052374 (+3316850us) ts_tablet_manager.cc:1151] Deleting tablet 7ab79c6ad03e481a903a0f95ae0512e6
0928 01:55:45.052428 (+    54us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.052711 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3316208}
I20260928 01:55:45.054490 20029 raft_consensus.cc:359] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.054939 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 215) took 3325 ms. Trace:
I20260928 01:55:45.055220 20029 raft_consensus.cc:385] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.058760 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8d07b367b4fafbd7171f8ea7b2a26" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:45.055377 20546 rpcz_store.cc:276] 0928 01:55:41.729789 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.729926 (+   137us) service_pool.cc:224] Handling call
0928 01:55:45.054617 (+3324691us) ts_tablet_manager.cc:1151] Deleting tablet 7602706a3fbc438d8d448c9ac057087c
0928 01:55:45.054659 (+    42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.054892 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3299776}
I20260928 01:55:45.059492 19621 raft_consensus.cc:3060] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:45.060137 20546 tablet_replica.cc:333] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:45.060945 20546 raft_consensus.cc:2243] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Raft consensus shutting down.
I20260928 01:55:45.061730 20839 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:45.062825 20811 leader_election.cc:290] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:45.063587 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8d07b367b4fafbd7171f8ea7b2a26" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:45.064337 19467 raft_consensus.cc:3060] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:45.063820 20546 raft_consensus.cc:2272] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:45.068971 20546 ts_tablet_manager.cc:1916] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:45.071432 19621 raft_consensus.cc:2468] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:45.084772 20839 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:45.085220 19467 raft_consensus.cc:2468] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:45.055480 20029 raft_consensus.cc:740] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:45.086434 20029 consensus_queue.cc:260] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.089216 20029 ts_tablet_manager.cc:1434] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260928 01:55:45.090194 20029 tablet_bootstrap.cc:492] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:55:45.094913 19704 consensus_peers.cc:597] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed6d3c1d99cc40febd285d0a8f5c3196. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:45.021184 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8d07b367b4fafbd7171f8ea7b2a26" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:45.096164 19474 raft_consensus.cc:2376] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1. Re-sending same reply.
I20260928 01:55:45.097792 19703 leader_election.cc:304] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:45.003810 19896 tablet_bootstrap.cc:492] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:45.098582 19896 ts_tablet_manager.cc:1403] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.819s	user 0.006s	sys 0.010s
I20260928 01:55:45.103617 19896 raft_consensus.cc:359] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.104358 19896 raft_consensus.cc:385] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.104656 19896 raft_consensus.cc:740] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:45.105383 19896 consensus_queue.cc:260] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.107482 19896 ts_tablet_manager.cc:1434] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260928 01:55:45.108397 19896 tablet_bootstrap.cc:492] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:45.108901 19475 raft_consensus.cc:2468] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
W20260928 01:55:45.113591 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2018f8b52f974554924f9ecfbd5a0f51 consensus state has no leader
I20260928 01:55:45.125752 19703 leader_election.cc:304] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:45.133448 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 21906a8380e64d95b9454a57fc01c6f0 (DEFAULT_TABLE table=default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:45.123816 20811 raft_consensus.cc:2804] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:45.138077 20811 raft_consensus.cc:697] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:45.139034 20811 consensus_queue.cc:237] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.141777 19734 tablet_service.cc:1511] Processing CreateTablet for tablet a735102c576640b69323cacb50393a42 (DEFAULT_TABLE table=default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:45.144564 20029 tablet_bootstrap.cc:654] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:45.074044 19890 tablet_bootstrap.cc:492] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:45.124938 19592 tablet_service.cc:1511] Processing CreateTablet for tablet a735102c576640b69323cacb50393a42 (DEFAULT_TABLE table=default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:55:45.148257 19704 consensus_peers.cc:597] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:45.148582 19890 ts_tablet_manager.cc:1403] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.294s	user 0.016s	sys 0.010s
I20260928 01:55:45.148998 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a735102c576640b69323cacb50393a42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:45.149362 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21906a8380e64d95b9454a57fc01c6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:45.150980 19890 raft_consensus.cc:359] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.151633 19890 raft_consensus.cc:385] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.151870 19890 raft_consensus.cc:740] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:45.125984 19596 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6f4708c641414aa59f01703c86aaf1 (DEFAULT_TABLE table=default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:45.152875 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6f4708c641414aa59f01703c86aaf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:45.152629 19890 consensus_queue.cc:260] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.154531 19890 ts_tablet_manager.cc:1434] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260928 01:55:45.154625 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a735102c576640b69323cacb50393a42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:45.155402 19890 tablet_bootstrap.cc:492] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:45.127146 19590 tablet_service.cc:1511] Processing CreateTablet for tablet 12b836e20d6b43cba8eaa08887afb076 (DEFAULT_TABLE table=default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:45.156950 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b836e20d6b43cba8eaa08887afb076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:45.156896 20546 ts_tablet_manager.cc:1929] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260928 01:55:45.157261 20546 log.cc:1199] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/d66eeaf33aa943c09f52b74360e2332d
I20260928 01:55:45.157958 20546 ts_tablet_manager.cc:1950] T d66eeaf33aa943c09f52b74360e2332d P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:45.123883 19594 tablet_service.cc:1511] Processing CreateTablet for tablet 21906a8380e64d95b9454a57fc01c6f0 (DEFAULT_TABLE table=default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:45.160935 19594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21906a8380e64d95b9454a57fc01c6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:45.168943 19890 tablet_bootstrap.cc:654] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:45.161458 20820 raft_consensus.cc:2804] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:45.204926 20820 raft_consensus.cc:697] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:45.205703 20820 consensus_queue.cc:237] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:45.193148 19703 consensus_peers.cc:597] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77c1f247486548ee9747403f7f80e3dc. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:45.160169 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 218) took 3375 ms. Trace:
I20260928 01:55:45.218706 20546 rpcz_store.cc:276] 0928 01:55:41.784265 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.784365 (+   100us) service_pool.cc:224] Handling call
0928 01:55:45.059977 (+3275612us) ts_tablet_manager.cc:1151] Deleting tablet d66eeaf33aa943c09f52b74360e2332d
0928 01:55:45.060019 (+    42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.135477 (+ 75458us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:45.156774 (+ 21297us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:45.159971 (+  3197us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3274995}
I20260928 01:55:45.221899 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 228) took 2884 ms. Trace:
I20260928 01:55:45.227275 20147 ts_tablet_manager.cc:1929] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 01:55:45.229586 20546 rpcz_store.cc:276] 0928 01:55:42.337066 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:42.348067 (+ 11001us) service_pool.cc:224] Handling call
0928 01:55:45.221502 (+2873435us) ts_tablet_manager.cc:1151] Deleting tablet 22fc9eff28c4436fb383c3d7169171bb
0928 01:55:45.221550 (+    48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.221837 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2871249}
I20260928 01:55:45.230762 20546 tablet_replica.cc:333] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:45.231501 20546 raft_consensus.cc:2243] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:45.240376 20546 raft_consensus.cc:2272] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:45.241505 19446 tablet_service.cc:1511] Processing CreateTablet for tablet 21906a8380e64d95b9454a57fc01c6f0 (DEFAULT_TABLE table=default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:45.242456 20546 ts_tablet_manager.cc:1916] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:45.242689 19446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21906a8380e64d95b9454a57fc01c6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:45.243471 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 12b836e20d6b43cba8eaa08887afb076 (DEFAULT_TABLE table=default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:45.244493 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b836e20d6b43cba8eaa08887afb076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:45.244875 19444 tablet_service.cc:1511] Processing CreateTablet for tablet a735102c576640b69323cacb50393a42 (DEFAULT_TABLE table=default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:45.245848 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a735102c576640b69323cacb50393a42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:45.248364 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6f4708c641414aa59f01703c86aaf1 (DEFAULT_TABLE table=default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:45.249310 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6f4708c641414aa59f01703c86aaf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:45.112960 19109 catalog_manager.cc:5838] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:55:45.252106 19109 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:55:45.253351 19109 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]). Expected version 2 got 0
I20260928 01:55:45.253827 19896 tablet_bootstrap.cc:654] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:45.254545 19109 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:55:45.255548 19109 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:45.257057 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet d66eeaf33aa943c09f52b74360e2332d (table default.Table_542dd0839d9f40ed942c4e1ab3e12098 [id=5a381f54e00c4bcf843ddfd1a97b1a9f]) successfully deleted
I20260928 01:55:45.257453 20029 tablet_bootstrap.cc:492] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:45.257858 20029 ts_tablet_manager.cc:1403] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.168s	user 0.011s	sys 0.004s
W20260928 01:55:45.257975 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 22fc9eff28c4436fb383c3d7169171bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22fc9eff28c4436fb383c3d7169171bb already in progress: creating tablet
I20260928 01:55:45.260736 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet ed6d3c1d99cc40febd285d0a8f5c3196 (table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]) successfully deleted
W20260928 01:55:45.261641 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 7daa1b799e0d408287edc03988f5b683 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7daa1b799e0d408287edc03988f5b683 already in progress: creating tablet
W20260928 01:55:45.262427 19105 catalog_manager.cc:5043] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet f709eccf4ab5413bbbd8b4746f185db4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f709eccf4ab5413bbbd8b4746f185db4 already in progress: creating tablet
I20260928 01:55:45.247915 20850 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 81ebb46a410e43ebaec3ef4dd13a71fc)
I20260928 01:55:45.263643 20850 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:45.273859 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6f4708c641414aa59f01703c86aaf1 (DEFAULT_TABLE table=default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:45.274881 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6f4708c641414aa59f01703c86aaf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:45.276957 19743 tablet_service.cc:1511] Processing CreateTablet for tablet 12b836e20d6b43cba8eaa08887afb076 (DEFAULT_TABLE table=default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:55:45.278057 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b836e20d6b43cba8eaa08887afb076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:55:45.281559 20820 raft_consensus.cc:493] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:45.282073 20820 raft_consensus.cc:515] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.288182 20850 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:55:45.289028 20029 raft_consensus.cc:359] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.289664 20029 raft_consensus.cc:385] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.289902 20029 raft_consensus.cc:740] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:45.291522 20029 consensus_queue.cc:260] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.292548 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:45.292944 19201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 3 candidate_status { last_received { term: 2 index: 252 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:55:45.296978 19703 leader_election.cc:343] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:45.297533 20029 ts_tablet_manager.cc:1434] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260928 01:55:45.299223 19896 tablet_bootstrap.cc:492] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:45.299677 19896 ts_tablet_manager.cc:1403] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.191s	user 0.005s	sys 0.005s
I20260928 01:55:45.264010 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 77c1f247486548ee9747403f7f80e3dc (table default.Table_2171ab69dd564f6897eb22381bb0a5b6 [id=328e52a4270e476faf1b10d89af3a56c]) successfully deleted
I20260928 01:55:45.280731 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 338 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:45.285250 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 3 candidate_status { last_received { term: 2 index: 252 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:45.302199 19896 raft_consensus.cc:359] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:45.303028 19896 raft_consensus.cc:385] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.303282 19896 raft_consensus.cc:740] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:45.306694 19896 consensus_queue.cc:260] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:45.284085 20820 leader_election.cc:290] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:45.309176 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:55:45.310664 20850 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:55:45.310757 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet b699e0d862fa4a54bbd756625f4e692b (table default.Table_882a0296b9ba49ef94e01ab6602cfa6e [id=69979c2fb6c84f81a71c4e04deda37bf]) successfully deleted
I20260928 01:55:45.314185 20029 tablet_bootstrap.cc:492] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:45.318375 19896 ts_tablet_manager.cc:1434] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.004s
I20260928 01:55:45.334272 20029 tablet_bootstrap.cc:654] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:45.345193 19896 tablet_bootstrap.cc:492] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:45.350953 19896 tablet_bootstrap.cc:654] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:45.362617 20546 ts_tablet_manager.cc:1929] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:45.363034 20546 log.cc:1199] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/ed6d3c1d99cc40febd285d0a8f5c3196
I20260928 01:55:45.363806 20546 ts_tablet_manager.cc:1950] T ed6d3c1d99cc40febd285d0a8f5c3196 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:45.370968 20552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 338 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:45.371784 20552 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c17b7f9972364c76893311539b569e0f in term 2.
I20260928 01:55:45.373441 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f; no voters: 
I20260928 01:55:45.374292 20839 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:55:45.374609 20839 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 81ebb46a410e43ebaec3ef4dd13a71fc)
I20260928 01:55:45.374939 20839 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:55:45.378410 19896 tablet_bootstrap.cc:492] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:45.378814 19896 ts_tablet_manager.cc:1403] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.008s
I20260928 01:55:45.381191 19896 raft_consensus.cc:359] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.381804 19896 raft_consensus.cc:385] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.383526 20839 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:45.382043 19896 raft_consensus.cc:740] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:45.385402 19896 consensus_queue.cc:260] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:45.391189 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet eac01fc222dd480cbed7cac37a0e6693 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eac01fc222dd480cbed7cac37a0e6693 already in progress: creating tablet
W20260928 01:55:45.392387 19102 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 80194.2us
W20260928 01:55:45.393831 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 599ef1523fcf43d1a1e2a91f03abaa60 because the tablet was not found. No further retry: Not found: Tablet not found: 599ef1523fcf43d1a1e2a91f03abaa60
I20260928 01:55:45.394695 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet f3741aec215343468b2d7bc952da03c8 (table default.Table_1d40de09d743485db2f538534e097074 [id=c314147c39ca4ef695e61de1652cf804]) successfully deleted
I20260928 01:55:45.395206 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 229) took 2482 ms. Trace:
I20260928 01:55:45.395546 20546 rpcz_store.cc:276] 0928 01:55:42.913216 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:42.913480 (+   264us) service_pool.cc:224] Handling call
0928 01:55:45.230603 (+2317123us) ts_tablet_manager.cc:1151] Deleting tablet ed6d3c1d99cc40febd285d0a8f5c3196
0928 01:55:45.230647 (+    44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.268118 (+ 37471us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:45.362483 (+ 94365us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:45.395138 (+ 32655us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2291294}
I20260928 01:55:45.397531 19896 ts_tablet_manager.cc:1434] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260928 01:55:45.399812 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 231) took 1797 ms. Trace:
I20260928 01:55:45.403411 19896 tablet_bootstrap.cc:492] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:45.403990 20552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 339 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294"
I20260928 01:55:45.404587 20552 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:55:45.404084 20546 rpcz_store.cc:276] 0928 01:55:43.602186 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:43.602374 (+   188us) service_pool.cc:224] Handling call
0928 01:55:45.399418 (+1797044us) ts_tablet_manager.cc:1151] Deleting tablet 7daa1b799e0d408287edc03988f5b683
0928 01:55:45.399462 (+    44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.399750 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1796143}
I20260928 01:55:45.412340 20839 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 3 election: Requested vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:45.412949 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 232) took 1737 ms. Trace:
I20260928 01:55:45.413301 20546 rpcz_store.cc:276] 0928 01:55:43.675905 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:43.676081 (+   176us) service_pool.cc:224] Handling call
0928 01:55:45.412536 (+1736455us) ts_tablet_manager.cc:1151] Deleting tablet f709eccf4ab5413bbbd8b4746f185db4
0928 01:55:45.412586 (+    50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.412884 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1728953}
I20260928 01:55:45.417097 20029 tablet_bootstrap.cc:492] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:45.417659 20029 ts_tablet_manager.cc:1403] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.011s
I20260928 01:55:45.422726 20029 raft_consensus.cc:359] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.424383 20029 raft_consensus.cc:385] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.424600 20552 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c17b7f9972364c76893311539b569e0f in term 3.
I20260928 01:55:45.423978 20546 tablet_replica.cc:333] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:45.429751 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f; no voters: 
I20260928 01:55:45.432519 20147 log.cc:1199] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/77c1f247486548ee9747403f7f80e3dc
I20260928 01:55:45.433630 20147 ts_tablet_manager.cc:1950] T 77c1f247486548ee9747403f7f80e3dc P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:45.289969 19890 tablet_bootstrap.cc:492] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:45.435928 19890 ts_tablet_manager.cc:1403] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.281s	user 0.013s	sys 0.007s
I20260928 01:55:45.435926 20546 raft_consensus.cc:2243] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:45.296689 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:45.438148 20839 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:55:45.438511 20546 raft_consensus.cc:2272] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:45.439173 19890 raft_consensus.cc:359] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.439790 19890 raft_consensus.cc:385] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.424968 20029 raft_consensus.cc:740] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:55:45.437433 19704 leader_election.cc:343] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:45.440475 19704 leader_election.cc:304] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:45.440049 19890 raft_consensus.cc:740] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:45.441604 20811 raft_consensus.cc:2749] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:45.442844 20029 consensus_queue.cc:260] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:45.443549 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 8a5e07078b2a4fe59d9293d9511cbb6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a5e07078b2a4fe59d9293d9511cbb6b already in progress: creating tablet
W20260928 01:55:45.444058 19102 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 48574.6us
W20260928 01:55:45.444800 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 58c61408724e4a70b39e5dbdab9a3e8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58c61408724e4a70b39e5dbdab9a3e8a already in progress: creating tablet
W20260928 01:55:45.445485 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 7ab79c6ad03e481a903a0f95ae0512e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ab79c6ad03e481a903a0f95ae0512e6 already in progress: creating tablet
W20260928 01:55:45.446151 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 7602706a3fbc438d8d448c9ac057087c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7602706a3fbc438d8d448c9ac057087c already in progress: creating tablet
I20260928 01:55:45.446743 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet d66eeaf33aa943c09f52b74360e2332d (table default.Table_542dd0839d9f40ed942c4e1ab3e12098 [id=5a381f54e00c4bcf843ddfd1a97b1a9f]) successfully deleted
I20260928 01:55:45.442423 19890 consensus_queue.cc:260] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.451983 19890 ts_tablet_manager.cc:1434] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260928 01:55:45.453792 19890 tablet_bootstrap.cc:492] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:45.435875 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 223) took 1084 ms. Trace:
I20260928 01:55:45.464340 20147 rpcz_store.cc:276] 0928 01:55:44.351433 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.357835 (+  6402us) service_pool.cc:224] Handling call
0928 01:55:44.885652 (+527817us) ts_tablet_manager.cc:1151] Deleting tablet 77c1f247486548ee9747403f7f80e3dc
0928 01:55:44.885695 (+    43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.010519 (+124824us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:45.227118 (+216599us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:45.435815 (+208697us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":527141}
I20260928 01:55:45.469952 20839 raft_consensus.cc:697] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 3 LEADER]: Becoming Leader. State: Replica: c17b7f9972364c76893311539b569e0f, State: Running, Role: LEADER
I20260928 01:55:45.471529 20839 consensus_queue.cc:237] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 338, Committed index: 338, Last appended: 2.339, Last appended by leader: 339, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:45.475260 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 77c1f247486548ee9747403f7f80e3dc (table default.Table_2171ab69dd564f6897eb22381bb0a5b6 [id=328e52a4270e476faf1b10d89af3a56c]) successfully deleted
I20260928 01:55:45.476550 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 227) took 1036 ms. Trace:
W20260928 01:55:45.447338 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 22fc9eff28c4436fb383c3d7169171bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22fc9eff28c4436fb383c3d7169171bb already in progress: creating tablet
I20260928 01:55:45.485863 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet ed6d3c1d99cc40febd285d0a8f5c3196 (table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]) successfully deleted
I20260928 01:55:45.486585 20147 rpcz_store.cc:276] 0928 01:55:44.440633 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.440752 (+   119us) service_pool.cc:224] Handling call
0928 01:55:45.476149 (+1035397us) ts_tablet_manager.cc:1151] Deleting tablet 03bbed8181084cb88b7d33976c20fbb8
0928 01:55:45.476256 (+   107us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.476485 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29056,"tablet-delete.queue_time_us":1008935}
I20260928 01:55:45.495008 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 226) took 1054 ms. Trace:
I20260928 01:55:45.449743 20029 ts_tablet_manager.cc:1434] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260928 01:55:45.500823 20858 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17b7f9972364c76893311539b569e0f. Latest consensus state: current_term: 3 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:45.502061 20858 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: LEADER
W20260928 01:55:45.493729 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 03bbed8181084cb88b7d33976c20fbb8 because the tablet was not found. No further retry: Not found: Tablet not found: 03bbed8181084cb88b7d33976c20fbb8
W20260928 01:55:45.509582 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 7daa1b799e0d408287edc03988f5b683 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7daa1b799e0d408287edc03988f5b683 already in progress: creating tablet
I20260928 01:55:45.495985 19896 tablet_bootstrap.cc:654] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:45.516335 20147 rpcz_store.cc:276] 0928 01:55:44.440290 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.440779 (+   489us) service_pool.cc:224] Handling call
0928 01:55:45.494702 (+1053923us) ts_tablet_manager.cc:1151] Deleting tablet 7bfcdfe218414396824a8f3af4d673ff
0928 01:55:45.494748 (+    46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.494952 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1027312}
I20260928 01:55:45.517130 20029 tablet_bootstrap.cc:492] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:45.523888 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 228) took 1070 ms. Trace:
W20260928 01:55:45.525012 19102 catalog_manager.cc:5043] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet f709eccf4ab5413bbbd8b4746f185db4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f709eccf4ab5413bbbd8b4746f185db4 already in progress: creating tablet
I20260928 01:55:45.524247 20546 ts_tablet_manager.cc:1916] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:45.569928 20029 tablet_bootstrap.cc:654] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:45.582573 19896 tablet_bootstrap.cc:492] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:45.583014 19896 ts_tablet_manager.cc:1403] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.180s	user 0.012s	sys 0.000s
I20260928 01:55:45.585330 20029 tablet_bootstrap.cc:492] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:45.585603 19896 raft_consensus.cc:359] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.586217 19896 raft_consensus.cc:385] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.586308 20029 ts_tablet_manager.cc:1403] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.004s
I20260928 01:55:45.586474 19896 raft_consensus.cc:740] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:45.587145 19896 consensus_queue.cc:260] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.589041 20029 raft_consensus.cc:359] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.592386 20029 raft_consensus.cc:385] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.593982 20029 raft_consensus.cc:740] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:55:45.602409 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 46929.1us
I20260928 01:55:45.603972 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 339 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc"
I20260928 01:55:45.605621 19203 raft_consensus.cc:1240] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 3 LEADER]: Rejecting Update request from peer 81ebb46a410e43ebaec3ef4dd13a71fc for earlier term 2. Current term is 3. Ops: [2.340-2.341]
I20260928 01:55:45.606017 19896 ts_tablet_manager.cc:1434] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
W20260928 01:55:45.610419 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 7bfcdfe218414396824a8f3af4d673ff because the tablet was not found. No further retry: Not found: Tablet not found: 7bfcdfe218414396824a8f3af4d673ff
I20260928 01:55:45.611377 20863 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 }, Status: INVALID_TERM, Last received: 2.339, Next index: 340, Last known committed idx: 338, Time since last communication: 0.001s
I20260928 01:55:45.612663 20863 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [LEADER]: Peer c17b7f9972364c76893311539b569e0f log is divergent from this leader: its last log entry 3.340 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 338
I20260928 01:55:45.621966 19896 tablet_bootstrap.cc:492] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:45.525725 19890 tablet_bootstrap.cc:654] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:45.624800 20147 rpcz_store.cc:276] 0928 01:55:44.453187 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.453308 (+   121us) service_pool.cc:224] Handling call
0928 01:55:45.523609 (+1070301us) ts_tablet_manager.cc:1151] Deleting tablet 7a753f894ae94b1eaf9b445df3545ded
0928 01:55:45.523654 (+    45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.523828 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1042765}
I20260928 01:55:45.630972 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 229) took 1177 ms. Trace:
I20260928 01:55:45.631429 20147 rpcz_store.cc:276] 0928 01:55:44.453615 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.453836 (+   221us) service_pool.cc:224] Handling call
0928 01:55:45.630448 (+1176612us) ts_tablet_manager.cc:1151] Deleting tablet b699e0d862fa4a54bbd756625f4e692b
0928 01:55:45.630571 (+   123us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.630862 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1149277}
W20260928 01:55:45.632817 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 7a753f894ae94b1eaf9b445df3545ded because the tablet was not found. No further retry: Not found: Tablet not found: 7a753f894ae94b1eaf9b445df3545ded
W20260928 01:55:45.637830 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet b699e0d862fa4a54bbd756625f4e692b because the tablet was not found. No further retry: Not found: Tablet not found: b699e0d862fa4a54bbd756625f4e692b
I20260928 01:55:45.599614 20029 consensus_queue.cc:260] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.638407 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 230) took 1184 ms. Trace:
I20260928 01:55:45.638758 20815 raft_consensus.cc:493] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:45.638718 20147 rpcz_store.cc:276] 0928 01:55:44.453965 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.454780 (+   815us) service_pool.cc:224] Handling call
0928 01:55:45.638024 (+1183244us) ts_tablet_manager.cc:1151] Deleting tablet f3741aec215343468b2d7bc952da03c8
0928 01:55:45.638087 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.638340 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1156724}
I20260928 01:55:45.639348 20546 ts_tablet_manager.cc:1929] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 01:55:45.639207 20815 raft_consensus.cc:515] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.639833 20546 log.cc:1199] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/77c1f247486548ee9747403f7f80e3dc
W20260928 01:55:45.640280 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet f3741aec215343468b2d7bc952da03c8 because the tablet was not found. No further retry: Not found: Tablet not found: f3741aec215343468b2d7bc952da03c8
I20260928 01:55:45.640553 20147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47670 (request call id 225) took 1200 ms. Trace:
I20260928 01:55:45.641000 20147 rpcz_store.cc:276] 0928 01:55:44.439848 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.447219 (+  7371us) service_pool.cc:224] Handling call
0928 01:55:45.640154 (+1192935us) ts_tablet_manager.cc:1151] Deleting tablet 90b3c947794c48daaacc299a7d2dd4a9
0928 01:55:45.640235 (+    81us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.640475 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1147617}
W20260928 01:55:45.642284 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 90b3c947794c48daaacc299a7d2dd4a9 because the tablet was not found. No further retry: Not found: Tablet not found: 90b3c947794c48daaacc299a7d2dd4a9
I20260928 01:55:45.645123 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22606f012f1c44bd92c8e0341e9ca2b7" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:45.646376 19619 raft_consensus.cc:2468] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:45.647320 20546 ts_tablet_manager.cc:1950] T 77c1f247486548ee9747403f7f80e3dc P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:45.647517 20820 raft_consensus.cc:493] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:45.647964 20820 raft_consensus.cc:515] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.648677 20840 raft_consensus.cc:493] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:45.649238 20840 raft_consensus.cc:515] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.651517 20840 leader_election.cc:290] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:45.651420 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a81b9455a340728fea713318e1e77a" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:45.652081 19470 raft_consensus.cc:2468] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:45.652688 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c320eb2ca2ac4ac68293ef8f7400b45f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:45.653038 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c320eb2ca2ac4ac68293ef8f7400b45f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:45.653276 19474 raft_consensus.cc:2468] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:45.653622 19767 raft_consensus.cc:2468] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:45.654006 19703 leader_election.cc:304] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:45.654788 20811 raft_consensus.cc:2804] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:45.654681 19556 leader_election.cc:304] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:45.655103 20811 raft_consensus.cc:493] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:45.655418 20811 raft_consensus.cc:3060] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:45.655787 20840 raft_consensus.cc:2804] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:45.656100 20840 raft_consensus.cc:493] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:45.656574 20840 raft_consensus.cc:3060] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:45.661544 19704 leader_election.cc:304] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:45.662570 20816 raft_consensus.cc:2804] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:45.662925 20816 raft_consensus.cc:493] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:45.663226 20816 raft_consensus.cc:3060] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:45.663511 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a81b9455a340728fea713318e1e77a" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:45.665279 19704 leader_election.cc:343] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:45.667673 20815 leader_election.cc:290] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:45.669420 20840 raft_consensus.cc:515] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.669883 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22606f012f1c44bd92c8e0341e9ca2b7" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:45.670480 19474 raft_consensus.cc:2468] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:45.670666 19896 tablet_bootstrap.cc:654] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:45.653020 20820 leader_election.cc:290] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:45.670945 20811 raft_consensus.cc:515] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.673646 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 242) took 1267 ms. Trace:
I20260928 01:55:45.673964 20546 rpcz_store.cc:276] 0928 01:55:44.406483 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.406601 (+   118us) service_pool.cc:224] Handling call
0928 01:55:45.423667 (+1017066us) ts_tablet_manager.cc:1151] Deleting tablet 77c1f247486548ee9747403f7f80e3dc
0928 01:55:45.423852 (+   185us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.569991 (+146139us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:45.639227 (+ 69236us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:45.673585 (+ 34358us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":919249}
I20260928 01:55:45.674050 20816 raft_consensus.cc:515] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.675462 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 77c1f247486548ee9747403f7f80e3dc (table default.Table_2171ab69dd564f6897eb22381bb0a5b6 [id=328e52a4270e476faf1b10d89af3a56c]) successfully deleted
I20260928 01:55:45.675386 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a81b9455a340728fea713318e1e77a" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:45.677446 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22606f012f1c44bd92c8e0341e9ca2b7" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:45.677888 20811 leader_election.cc:290] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:45.678009 19620 raft_consensus.cc:3060] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:45.679176 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c320eb2ca2ac4ac68293ef8f7400b45f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:45.679688 19767 raft_consensus.cc:3060] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:45.680728 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a81b9455a340728fea713318e1e77a" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:45.681300 19474 raft_consensus.cc:3060] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:45.683280 20029 ts_tablet_manager.cc:1434] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.000s
W20260928 01:55:45.688725 19704 leader_election.cc:343] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:45.690289 20820 raft_consensus.cc:493] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:45.690762 20820 raft_consensus.cc:515] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:45.691571 19203 raft_consensus.cc:1217] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 3 LEADER]: Deduplicated request from leader. Original: 2.338->[2.339-2.341]   Dedup: 2.339->[2.340-2.341]
I20260928 01:55:45.692121 19203 raft_consensus.cc:1240] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 3 LEADER]: Rejecting Update request from peer 81ebb46a410e43ebaec3ef4dd13a71fc for earlier term 2. Current term is 3. Ops: [2.339-2.341]
I20260928 01:55:45.693625 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156dae74ee748cd845b6dea1d3b8ea8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:45.694319 19470 raft_consensus.cc:2468] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:45.694878 19474 raft_consensus.cc:2468] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:45.696753 19620 raft_consensus.cc:2468] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:45.699229 20816 leader_election.cc:290] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:45.704418 20863 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 }, Status: INVALID_TERM, Last received: 2.339, Next index: 339, Last known committed idx: 338, Time since last communication: 0.000s
I20260928 01:55:45.705147 20863 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [LEADER]: Peer c17b7f9972364c76893311539b569e0f log is divergent from this leader: its last log entry 3.340 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 338
I20260928 01:55:45.706188 20820 leader_election.cc:290] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:45.707459 19703 leader_election.cc:304] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:45.709080 19703 leader_election.cc:304] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:45.710800 20815 raft_consensus.cc:2804] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:45.711412 20815 raft_consensus.cc:493] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:45.711755 20815 raft_consensus.cc:3060] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:45.716344 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22606f012f1c44bd92c8e0341e9ca2b7" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:45.716773 19767 raft_consensus.cc:2468] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:45.718444 19076 master-stress-test.cc:579] Killing test thread 1/10
I20260928 01:55:45.719383 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 247) took 1081 ms. Trace:
I20260928 01:55:45.719733 20546 rpcz_store.cc:276] 0928 01:55:44.638286 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.638384 (+    98us) service_pool.cc:224] Handling call
0928 01:55:45.719014 (+1080630us) ts_tablet_manager.cc:1151] Deleting tablet 5d9b93f45ccf44e785b00849e49c8294
0928 01:55:45.719064 (+    50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.719319 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1079982}
I20260928 01:55:45.721633 19474 raft_consensus.cc:3060] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:45.722640 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 5d9b93f45ccf44e785b00849e49c8294 because the tablet was not found. No further retry: Not found: Tablet not found: 5d9b93f45ccf44e785b00849e49c8294
I20260928 01:55:45.731470 20029 tablet_bootstrap.cc:492] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:45.731997 20816 raft_consensus.cc:2804] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:45.739457 19704 leader_election.cc:304] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:45.740633 20872 tablet.cc:1751] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:45.742115 20866 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 2 LEADER]: Stepping down as leader of term 2
I20260928 01:55:45.742570 20866 raft_consensus.cc:740] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81ebb46a410e43ebaec3ef4dd13a71fc, State: Running, Role: LEADER
I20260928 01:55:45.751866 20029 tablet_bootstrap.cc:654] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:45.752691 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 248) took 1071 ms. Trace:
I20260928 01:55:45.753041 20546 rpcz_store.cc:276] 0928 01:55:44.681494 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.681605 (+   111us) service_pool.cc:224] Handling call
0928 01:55:45.752280 (+1070675us) ts_tablet_manager.cc:1151] Deleting tablet 7bfcdfe218414396824a8f3af4d673ff
0928 01:55:45.752328 (+    48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.752624 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1050340}
I20260928 01:55:45.753631 20816 raft_consensus.cc:697] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
W20260928 01:55:45.754343 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 7bfcdfe218414396824a8f3af4d673ff because the tablet was not found. No further retry: Not found: Tablet not found: 7bfcdfe218414396824a8f3af4d673ff
I20260928 01:55:45.754657 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 249) took 1071 ms. Trace:
I20260928 01:55:45.754477 20816 consensus_queue.cc:237] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.755088 20811 raft_consensus.cc:2804] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:45.755812 20811 raft_consensus.cc:697] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:45.756688 20811 consensus_queue.cc:237] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.754952 20546 rpcz_store.cc:276] 0928 01:55:44.682805 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.682902 (+    97us) service_pool.cc:224] Handling call
0928 01:55:45.754410 (+1071508us) ts_tablet_manager.cc:1151] Deleting tablet 03bbed8181084cb88b7d33976c20fbb8
0928 01:55:45.754452 (+    42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.754603 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1070895}
W20260928 01:55:45.758445 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 03bbed8181084cb88b7d33976c20fbb8 because the tablet was not found. No further retry: Not found: Tablet not found: 03bbed8181084cb88b7d33976c20fbb8
I20260928 01:55:45.760802 19553 leader_election.cc:304] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:45.761051 20840 leader_election.cc:290] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:45.761619 20840 raft_consensus.cc:2804] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:45.775765 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156dae74ee748cd845b6dea1d3b8ea8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:45.777858 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 251) took 1078 ms. Trace:
I20260928 01:55:45.778224 20546 rpcz_store.cc:276] 0928 01:55:44.699178 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.699271 (+    93us) service_pool.cc:224] Handling call
0928 01:55:45.777540 (+1078269us) ts_tablet_manager.cc:1151] Deleting tablet 90b3c947794c48daaacc299a7d2dd4a9
0928 01:55:45.777587 (+    47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.777792 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1077621}
W20260928 01:55:45.779659 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 90b3c947794c48daaacc299a7d2dd4a9 because the tablet was not found. No further retry: Not found: Tablet not found: 90b3c947794c48daaacc299a7d2dd4a9
I20260928 01:55:45.785004 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 252) took 1084 ms. Trace:
I20260928 01:55:45.785339 20546 rpcz_store.cc:276] 0928 01:55:44.700368 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.700462 (+    94us) service_pool.cc:224] Handling call
0928 01:55:45.784712 (+1084250us) ts_tablet_manager.cc:1151] Deleting tablet 78a71904514a488083426f5fe07d12cd
0928 01:55:45.784760 (+    48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.784944 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1083637}
W20260928 01:55:45.786969 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 78a71904514a488083426f5fe07d12cd because the tablet was not found. No further retry: Not found: Tablet not found: 78a71904514a488083426f5fe07d12cd
I20260928 01:55:45.796675 20546 tablet_replica.cc:333] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:45.797550 20546 raft_consensus.cc:2243] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:55:45.801945 20029 tablet_bootstrap.cc:492] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:45.802407 20029 ts_tablet_manager.cc:1403] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.118s	user 0.009s	sys 0.000s
I20260928 01:55:45.803562 20546 raft_consensus.cc:2272] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:45.806921 20546 ts_tablet_manager.cc:1916] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:45.743494 20866 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 339, Committed index: 339, Last appended: 2.341, Last appended by leader: 341, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:45.808353 20866 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:55:45.813230 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c320eb2ca2ac4ac68293ef8f7400b45f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:45.813855 19470 raft_consensus.cc:3060] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:45.818077 19474 raft_consensus.cc:2468] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:45.821864 19890 tablet_bootstrap.cc:492] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:45.822393 19890 ts_tablet_manager.cc:1403] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.369s	user 0.005s	sys 0.017s
I20260928 01:55:45.823014 19470 raft_consensus.cc:2468] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:45.814699 20029 raft_consensus.cc:359] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.824690 20029 raft_consensus.cc:385] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.824965 20029 raft_consensus.cc:740] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:45.825173 20815 raft_consensus.cc:515] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:45.825958 19896 tablet_bootstrap.cc:492] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:45.826413 19896 ts_tablet_manager.cc:1403] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.205s	user 0.003s	sys 0.015s
I20260928 01:55:45.828861 19896 raft_consensus.cc:359] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.829499 19896 raft_consensus.cc:385] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.829247 20029 consensus_queue.cc:260] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.829759 19896 raft_consensus.cc:740] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:45.830631 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156dae74ee748cd845b6dea1d3b8ea8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:45.831401 20029 ts_tablet_manager.cc:1434] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260928 01:55:45.832818 19111 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 293) took 2834 ms. Trace:
I20260928 01:55:45.833191 19111 rpcz_store.cc:276] 0928 01:55:42.998883 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.543608 (+1544725us) service_pool.cc:224] Handling call
0928 01:55:44.601589 (+ 57981us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:44.603242 (+  1653us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:45.831701 (+1228459us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:55:45.832111 (+   410us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:55:45.832627 (+   516us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:44.604915 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:44.605308 (+   393us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:44.605330 (+    22us) write_op.cc:435] Acquired schema lock
0928 01:55:44.605342 (+    12us) tablet.cc:662] Decoding operations
0928 01:55:44.605595 (+   253us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:44.605634 (+    39us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:44.605656 (+    22us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:44.605846 (+   190us) tablet.cc:701] Row locks acquired
0928 01:55:44.605860 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:44.605980 (+   120us) write_op.cc:270] Start()
0928 01:55:44.606066 (+    86us) write_op.cc:276] Timestamp: P: 1790560544605918 usec, L: 0
0928 01:55:44.606081 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:44.606646 (+   565us) log.cc:844] Serialized 433 byte log entry
0928 01:55:45.595839 (+989193us) op_driver.cc:464] REPLICATION: finished
0928 01:55:45.685733 (+ 89894us) write_op.cc:301] APPLY: starting
0928 01:55:45.685820 (+    87us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:45.686044 (+   224us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:45.686249 (+   205us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:45.687347 (+  1098us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:45.687665 (+   318us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:55:45.687758 (+    93us) write_op.cc:312] APPLY: finished
0928 01:55:45.688125 (+   367us) log.cc:844] Serialized 29 byte log entry
0928 01:55:45.831067 (+142942us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:45.831191 (+   124us) write_op.cc:454] Released schema lock
0928 01:55:45.831237 (+    46us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:45.831642 (+   405us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:45.831675 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":89657,"apply.run_cpu_time_us":3187,"apply.run_wall_time_us":145842,"num_ops":2,"prepare.queue_time_us":120,"prepare.run_cpu_time_us":2017,"prepare.run_wall_time_us":2017,"raft.queue_time_us":1195,"raft.run_cpu_time_us":1116,"raft.run_wall_time_us":1116,"replication_time_us":989597,"thread_start_us":92185,"threads_started":1}]]}
I20260928 01:55:45.837812 19890 raft_consensus.cc:359] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.838603 19890 raft_consensus.cc:385] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:45.840308 19890 raft_consensus.cc:740] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:45.848507 20029 tablet_bootstrap.cc:492] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:45.852468 19470 raft_consensus.cc:3060] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:45.859143 20878 tablet.cc:1751] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
W20260928 01:55:45.863268 19704 leader_election.cc:343] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:45.864907 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156dae74ee748cd845b6dea1d3b8ea8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:45.867426 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 106812us
I20260928 01:55:45.868932 20880 tablet.cc:1751] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:45.871923 20840 raft_consensus.cc:697] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:45.873219 20840 consensus_queue.cc:237] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.875888 20815 leader_election.cc:290] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:45.876508 19896 consensus_queue.cc:260] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.863268 20029 tablet_bootstrap.cc:654] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:45.883639 19704 leader_election.cc:343] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:45.898018 19470 raft_consensus.cc:2468] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:45.841177 19890 consensus_queue.cc:260] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:45.908504 19890 ts_tablet_manager.cc:1434] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.003s
I20260928 01:55:45.909616 19890 tablet_bootstrap.cc:492] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:45.919327 19703 leader_election.cc:304] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:45.907111 19896 ts_tablet_manager.cc:1434] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.002s
I20260928 01:55:45.922739 19896 tablet_bootstrap.cc:492] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:45.926196 20815 raft_consensus.cc:2804] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:45.926956 20815 raft_consensus.cc:697] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:45.927856 20815 consensus_queue.cc:237] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:45.952625 19896 tablet_bootstrap.cc:654] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:45.952857 19126 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 3 FOLLOWER]: Refusing update from remote peer c17b7f9972364c76893311539b569e0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 341. Preceding OpId from leader: term: 3 index: 340. (term mismatch)
I20260928 01:55:45.953253 19126 pending_rounds.cc:85] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Aborting all ops after (but not including) 339
I20260928 01:55:45.953536 19126 pending_rounds.cc:107] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Aborting uncommitted WRITE_OP operation due to leader change: 2.340
I20260928 01:55:45.955044 19126 pending_rounds.cc:107] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Aborting uncommitted WRITE_OP operation due to leader change: 2.341
W20260928 01:55:45.955065 19112 catalog_manager.cc:2241] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20260928 01:55:45.956248 19112 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 292) took 3126 ms. Trace:
I20260928 01:55:45.956564 19112 rpcz_store.cc:276] 0928 01:55:42.855526 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.511349 (+1655823us) service_pool.cc:224] Handling call
0928 01:55:44.513681 (+  2332us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:55:44.515197 (+  1516us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:55:45.956148 (+1440951us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:44.620724 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:44.621104 (+   380us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:44.621126 (+    22us) write_op.cc:435] Acquired schema lock
0928 01:55:44.621138 (+    12us) tablet.cc:662] Decoding operations
0928 01:55:44.621446 (+   308us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:44.621482 (+    36us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:44.621525 (+    43us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:44.621733 (+   208us) tablet.cc:701] Row locks acquired
0928 01:55:44.621745 (+    12us) write_op.cc:260] PREPARE: finished
0928 01:55:44.621866 (+   121us) write_op.cc:270] Start()
0928 01:55:44.621950 (+    84us) write_op.cc:276] Timestamp: P: 1790560544621803 usec, L: 0
0928 01:55:44.621965 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:44.622466 (+   501us) log.cc:844] Serialized 433 byte log entry
0928 01:55:45.954108 (+1331642us) op_driver.cc:464] REPLICATION: finished
0928 01:55:45.954272 (+   164us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0928 01:55:45.954307 (+    35us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:45.954468 (+   161us) write_op.cc:454] Released schema lock
0928 01:55:45.954519 (+    51us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":1980,"prepare.run_wall_time_us":1981,"replication_time_us":1331867}]]}
I20260928 01:55:45.958519 20858 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 340, Last known committed idx: 339, Time since last communication: 0.001s
I20260928 01:55:45.960043 19890 tablet_bootstrap.cc:654] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:45.963394 19825 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.18.161.62:38511)
I20260928 01:55:45.967617 20546 ts_tablet_manager.cc:1929] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:45.968036 20546 log.cc:1199] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/f71e2109f8cd4dd4a288fbdc8e50b133
I20260928 01:55:45.968811 20546 ts_tablet_manager.cc:1950] T f71e2109f8cd4dd4a288fbdc8e50b133 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:55:45.972821 20866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17b7f9972364c76893311539b569e0f. Latest consensus state: current_term: 3 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:45.973716 20866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: FOLLOWER
E20260928 01:55:45.959414 19109 catalog_manager.cc:6001] Error updating tablets from 37089d44fdba4b6488b5b5aea28af614: Aborted: Op aborted by new leader. Tablet report was: is_incremental: true updated_tablets { tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "d7774406b22547d29d9d42c969cf0874" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "57a81b9455a340728fea713318e1e77a" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "45d8d07b367b4fafbd7171f8ea7b2a26" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "158edf7a5d724c88992fecbadd2cedfa" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "b60e7bd679e447d18e340cfaed66d328" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27428 live_row_count: 0 } } updated_tablets { tablet_id: "99e806ba248746d2bde39a2eb76b17df" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "3f4a1c903a04450684ba38081a75559e" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "9ca0b52215454a99b6c5d1956088829a" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "ca443386942e49d9a66143e1fde777c5" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "1555e557370a4e92915a9c55107b573b" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "4e6b59144fe14daab98b0965c7f8af02" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "4ee6d48172044c74aacd4b78683efb66" state: RUNNING consensus_state { current_term: 2 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27462 live_row_count: 0 } } updated_tablets { tablet_id: "86825485bfca479ea63c1a99dddb68d6" state: RUNNING consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "ef752c3b4b22490ab42292f61278da52" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "77c1f247486548ee9747403f7f80e3dc" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 5 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } removed_tablet_ids: "c1f73a301c84482f897990ac5e5dd162" removed_tablet_ids: "f3741aec215343468b2d7bc952da03c8" removed_tablet_ids: "f71e2109f8cd4dd4a288fbdc8e50b133" removed_tablet_ids: "7a753f894ae94b1eaf9b445df3545ded" removed_tablet_ids: "03bbed8181084cb88b7d33976c20fbb8" removed_tablet_ids: "b699e0d862fa4a54bbd756625f4e692b" removed_tablet_ids: "599ef1523fcf43d1a1e2a91f03abaa60" removed_tablet_ids: "78a71904514a488083426f5fe07d12cd" removed_tablet_ids: "7bfcdfe218414396824a8f3af4d673ff" removed_tablet_ids: "457837143b0f4763a4b91bb25b580477" removed_tablet_ids: "ed6d3c1d99cc40febd285d0a8f5c3196" removed_tablet_ids: "90d40050f85a4d6c90a4ce35cf15d134" removed_tablet_ids: "05f875e126f04415a108f778a76bb0f5" removed_tablet_ids: "90b3c947794c48daaacc299a7d2dd4a9" removed_tablet_ids: "33e1cc46939b4932a344b81c3bc8ca82" removed_tablet_ids: "eaa1e9b7119d46a2ba2652a893877c8c" removed_tablet_ids: "d66eeaf33aa943c09f52b74360e2332d" removed_tablet_ids: "63a3540d1441404092db723b7e5cb61a" removed_tablet_ids: "5d9b93f45ccf44e785b00849e49c8294" removed_tablet_ids: "ce41f63df46f4d0493ca22a13daadb4f" sequence_number: 41
I20260928 01:55:45.975893 20029 tablet_bootstrap.cc:492] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:45.976368 20029 ts_tablet_manager.cc:1403] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.144s	user 0.012s	sys 0.000s
W20260928 01:55:45.996167 19704 consensus_peers.cc:597] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:46.003746 20029 raft_consensus.cc:359] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.004473 20029 raft_consensus.cc:385] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:46.004760 20029 raft_consensus.cc:740] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:46.005213 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 253) took 1303 ms. Trace:
I20260928 01:55:46.005380 20029 consensus_queue.cc:260] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.007396 20029 ts_tablet_manager.cc:1434] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.000s
I20260928 01:55:46.009843 19118 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:55:46.009765 20811 consensus_queue.cc:1048] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:46.010936 19118 catalog_manager.cc:5838] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:55:46.012128 19118 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:55:46.013142 19118 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:46.014698 19118 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]). Expected version 2 got 0
I20260928 01:55:46.027061 20552 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 3 FOLLOWER]: Refusing update from remote peer c17b7f9972364c76893311539b569e0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 252. Preceding OpId from leader: term: 3 index: 340. (index mismatch)
I20260928 01:55:46.027297 20866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:46.028139 20866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: FOLLOWER
W20260928 01:55:46.032681 19109 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 42) took 1751 ms (client timeout 1000 ms). Trace:
W20260928 01:55:46.033866 19109 rpcz_store.cc:269] 0928 01:55:44.281495 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.418242 (+136747us) service_pool.cc:224] Handling call
0928 01:55:46.032594 (+1614352us) inbound_call.cc:177] Queueing failure response
Related trace 'op':
0928 01:55:45.338526 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:45.339048 (+   522us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:45.339088 (+    40us) write_op.cc:435] Acquired schema lock
0928 01:55:45.339113 (+    25us) tablet.cc:662] Decoding operations
0928 01:55:45.339458 (+   345us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:45.339515 (+    57us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:45.339544 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:45.339803 (+   259us) tablet.cc:701] Row locks acquired
0928 01:55:45.339827 (+    24us) write_op.cc:260] PREPARE: finished
0928 01:55:45.339973 (+   146us) write_op.cc:270] Start()
0928 01:55:45.340103 (+   130us) write_op.cc:276] Timestamp: P: 1790560545339863 usec, L: 0
0928 01:55:45.340128 (+    25us) op_driver.cc:348] REPLICATION: starting
0928 01:55:45.431717 (+ 91589us) log.cc:844] Serialized 530 byte log entry
0928 01:55:45.955903 (+524186us) op_driver.cc:464] REPLICATION: finished
0928 01:55:45.955945 (+    42us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0928 01:55:45.955976 (+    31us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:45.956103 (+   127us) write_op.cc:454] Released schema lock
0928 01:55:45.956138 (+    35us) write_op.cc:335] FINISH: Op aborted
Metrics: {"reported_tablets":24,"child_traces":[["op",{"num_ops":1,"prepare.queue_time_us":71252,"prepare.run_cpu_time_us":3233,"prepare.run_wall_time_us":93641,"replication_time_us":615613,"thread_start_us":73245,"threads_started":1}]]}
I20260928 01:55:46.040823 20029 tablet_bootstrap.cc:492] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:46.005549 20546 rpcz_store.cc:276] 0928 01:55:44.701539 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.701634 (+    95us) service_pool.cc:224] Handling call
0928 01:55:45.796489 (+1094855us) ts_tablet_manager.cc:1151] Deleting tablet f71e2109f8cd4dd4a288fbdc8e50b133
0928 01:55:45.796539 (+    50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:45.847646 (+ 51107us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:45.967468 (+119822us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:46.005156 (+ 37688us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1094275}
I20260928 01:55:46.045521 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 254) took 1343 ms. Trace:
I20260928 01:55:46.045874 20546 rpcz_store.cc:276] 0928 01:55:44.702525 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.702611 (+    86us) service_pool.cc:224] Handling call
0928 01:55:46.044383 (+1341772us) ts_tablet_manager.cc:1151] Deleting tablet 3f08e6838341436f8a85d6dbafc805df
0928 01:55:46.044429 (+    46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:46.045446 (+  1017us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1341215}
I20260928 01:55:46.048022 20546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 250) took 1349 ms. Trace:
I20260928 01:55:46.048372 20546 rpcz_store.cc:276] 0928 01:55:44.698856 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.764280 (+ 65424us) service_pool.cc:224] Handling call
0928 01:55:46.047757 (+1283477us) ts_tablet_manager.cc:1151] Deleting tablet 7a753f894ae94b1eaf9b445df3545ded
0928 01:55:46.047802 (+    45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:46.047965 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1282957}
I20260928 01:55:46.044806 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet f71e2109f8cd4dd4a288fbdc8e50b133 (table default.Table_1e30aacb906b40aaa3a683c1495c78f2 [id=30ade53be61542a7a042a4401001fba9]) successfully deleted
W20260928 01:55:46.050398 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 3f08e6838341436f8a85d6dbafc805df because the tablet was not found. No further retry: Not found: Tablet not found: 3f08e6838341436f8a85d6dbafc805df
W20260928 01:55:46.051033 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 7a753f894ae94b1eaf9b445df3545ded because the tablet was not found. No further retry: Not found: Tablet not found: 7a753f894ae94b1eaf9b445df3545ded
I20260928 01:55:46.053640 19111 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 294) took 3054 ms. Trace:
I20260928 01:55:46.070989 19896 tablet_bootstrap.cc:492] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:46.072155 19896 ts_tablet_manager.cc:1403] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.150s	user 0.012s	sys 0.000s
I20260928 01:55:46.075686 20029 tablet_bootstrap.cc:654] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:46.078593 20815 consensus_queue.cc:1048] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:46.080353 19111 rpcz_store.cc:276] 0928 01:55:42.999342 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.043032 (+3043690us) service_pool.cc:224] Handling call
0928 01:55:46.053564 (+ 10532us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:46.083495 19111 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51212 (request call id 295) took 2998 ms. Trace:
I20260928 01:55:46.087519 19112 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51212 (request call id 296) took 2740 ms. Trace:
I20260928 01:55:46.087984 19112 rpcz_store.cc:276] 0928 01:55:43.346934 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.086228 (+2739294us) service_pool.cc:224] Handling call
0928 01:55:46.087423 (+  1195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:46.090063 19112 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51212 (request call id 297) took 2585 ms. Trace:
I20260928 01:55:46.094040 19112 rpcz_store.cc:276] 0928 01:55:43.504566 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.089170 (+2584604us) service_pool.cc:224] Handling call
0928 01:55:46.090003 (+   833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:46.095366 19890 tablet_bootstrap.cc:492] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:46.098536 19890 ts_tablet_manager.cc:1403] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.189s	user 0.013s	sys 0.008s
I20260928 01:55:46.102892 19896 raft_consensus.cc:359] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.103587 19896 raft_consensus.cc:385] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:46.083946 19111 rpcz_store.cc:276] 0928 01:55:43.084939 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.082456 (+2997517us) service_pool.cc:224] Handling call
0928 01:55:46.083401 (+   945us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:46.103843 19896 raft_consensus.cc:740] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:46.104892 19111 master_service.cc:960] ReplaceTablet: received request to replace tablet 58c61408724e4a70b39e5dbdab9a3e8a from {username='slave'} at 127.0.0.1:51212
W20260928 01:55:46.105822 19825 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.18.161.62:38511)
I20260928 01:55:46.106020 19111 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51212 (request call id 299) took 2078 ms. Trace:
I20260928 01:55:46.103297 19109 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 298) took 2288 ms. Trace:
I20260928 01:55:46.107796 19109 rpcz_store.cc:276] 0928 01:55:43.814456 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.102348 (+2287892us) service_pool.cc:224] Handling call
0928 01:55:46.103199 (+   851us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:46.108323 19890 raft_consensus.cc:359] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:46.113103 19825 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.18.161.62:38511)
I20260928 01:55:46.106448 19111 rpcz_store.cc:276] 0928 01:55:44.028107 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.104760 (+2076653us) service_pool.cc:224] Handling call
0928 01:55:46.105945 (+  1185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:46.115676 20858 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 340, Last known committed idx: 251, Time since last communication: 0.000s
W20260928 01:55:46.117584 19825 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.18.161.62:38511)
I20260928 01:55:46.117976 19890 raft_consensus.cc:385] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:46.118275 19890 raft_consensus.cc:740] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:46.109368 19112 master_service.cc:960] ReplaceTablet: received request to replace tablet e8f6ce7612d4463ebe95e07557bca4e7 from {username='slave'} at 127.0.0.1:51212
I20260928 01:55:46.119451 19620 raft_consensus.cc:3060] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:46.119946 19112 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:51212 (request call id 300) took 1718 ms. Trace:
I20260928 01:55:46.124826 19890 consensus_queue.cc:260] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.125800 19112 rpcz_store.cc:276] 0928 01:55:44.401362 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.109227 (+1707865us) service_pool.cc:224] Handling call
0928 01:55:46.119871 (+ 10644us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:46.131897 20820 raft_consensus.cc:493] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:46.132470 20820 raft_consensus.cc:515] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.134608 20820 leader_election.cc:290] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
E20260928 01:55:46.017196 19118 catalog_manager.cc:6001] Error updating tablets from a3ee288ca1464d20a715673422a214a0: Illegal state: replica 81ebb46a410e43ebaec3ef4dd13a71fc is not leader of this config: current role FOLLOWER. Tablet report was: is_incremental: true updated_tablets { tablet_id: "c1f73a301c84482f897990ac5e5dd162" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "4ee6d48172044c74aacd4b78683efb66" state: RUNNING consensus_state { current_term: 2 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 5 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "b60e7bd679e447d18e340cfaed66d328" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "f71e2109f8cd4dd4a288fbdc8e50b133" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "99e806ba248746d2bde39a2eb76b17df" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27506 live_row_count: 0 } } updated_tablets { tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "ca443386942e49d9a66143e1fde777c5" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "86825485bfca479ea63c1a99dddb68d6" state: RUNNING consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "4e6b59144fe14daab98b0965c7f8af02" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "3f4a1c903a04450684ba38081a75559e" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } removed_tablet_ids: "7a753f894ae94b1eaf9b445df3545ded" removed_tablet_ids: "f3741aec215343468b2d7bc952da03c8" removed_tablet_ids: "599ef1523fcf43d1a1e2a91f03abaa60" removed_tablet_ids: "78a71904514a488083426f5fe07d12cd" removed_tablet_ids: "7bfcdfe218414396824a8f3af4d673ff" removed_tablet_ids: "b699e0d862fa4a54bbd756625f4e692b" removed_tablet_ids: "90b3c947794c48daaacc299a7d2dd4a9" removed_tablet_ids: "03bbed8181084cb88b7d33976c20fbb8" sequence_number: 37
I20260928 01:55:46.136356 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287060a8d054b15b2252dcf280ca8c2" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:46.137303 20820 raft_consensus.cc:493] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:46.137578 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287060a8d054b15b2252dcf280ca8c2" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:46.137758 20820 raft_consensus.cc:515] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.138226 19474 raft_consensus.cc:2468] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
W20260928 01:55:46.139474 19704 leader_election.cc:343] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:46.141160 19703 leader_election.cc:304] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:46.143463 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:46.144959 19704 leader_election.cc:343] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:46.145898 20820 leader_election.cc:290] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:46.146387 20820 raft_consensus.cc:2804] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:46.146708 20820 raft_consensus.cc:493] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:46.146996 20820 raft_consensus.cc:3060] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:46.148823 19118 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 38) took 1588 ms (client timeout 1000 ms). Trace:
I20260928 01:55:46.149487 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:46.149171 19118 rpcz_store.cc:269] 0928 01:55:44.560747 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.630442 (+ 69695us) service_pool.cc:224] Handling call
0928 01:55:46.016994 (+1386552us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:46.017013 (+    19us) write_op.cc:454] Released schema lock
0928 01:55:46.148750 (+131737us) inbound_call.cc:177] Queueing failure response
Related trace 'op':
0928 01:55:46.016803 (+     0us) op_driver.cc:389] HandleFailure(Illegal state: replica 81ebb46a410e43ebaec3ef4dd13a71fc is not leader of this config: current role FOLLOWER)
0928 01:55:46.016835 (+    32us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:46.016854 (+    19us) write_op.cc:454] Released schema lock
0928 01:55:46.016885 (+    31us) write_op.cc:335] FINISH: Op aborted
Metrics: {"reported_tablets":14,"child_traces":[["op",{}]]}
I20260928 01:55:46.150092 19474 raft_consensus.cc:2468] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:46.151214 19703 leader_election.cc:304] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:46.153823 20811 raft_consensus.cc:2804] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:46.154156 20811 raft_consensus.cc:493] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:46.154558 20811 raft_consensus.cc:3060] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:46.159897 19890 ts_tablet_manager.cc:1434] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.001s
I20260928 01:55:46.160771 20815 consensus_queue.cc:1048] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:46.161145 19890 tablet_bootstrap.cc:492] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:46.165323 19111 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:54824 (request call id 0) took 2647 ms. Trace:
I20260928 01:55:46.165781 19111 rpcz_store.cc:276] 0928 01:55:43.517962 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.164098 (+2646136us) service_pool.cc:224] Handling call
0928 01:55:46.165241 (+  1143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:46.167872 19896 consensus_queue.cc:260] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.170110 19896 ts_tablet_manager.cc:1434] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.000s
W20260928 01:55:46.199013 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:46.211853 20859 raft_consensus.cc:493] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:46.213032 20859 raft_consensus.cc:515] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.216492 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:46.216732 20859 leader_election.cc:290] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:46.217271 19767 raft_consensus.cc:2468] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:46.217314 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:46.218677 19412 leader_election.cc:343] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:46.219170 19409 leader_election.cc:304] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:46.220402 20859 raft_consensus.cc:2804] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:46.220791 20859 raft_consensus.cc:493] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:46.221166 20859 raft_consensus.cc:3060] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:46.220798 19896 tablet_bootstrap.cc:492] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:46.220149 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 69022.4us
I20260928 01:55:46.230979 19890 tablet_bootstrap.cc:654] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:46.243491 19896 tablet_bootstrap.cc:654] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:46.260666 20839 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:46.261529 20839 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: LEADER
I20260928 01:55:46.279608 20029 tablet_bootstrap.cc:492] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:46.280107 20029 ts_tablet_manager.cc:1403] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.272s	user 0.015s	sys 0.012s
I20260928 01:55:46.280140 19890 tablet_bootstrap.cc:492] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:46.280589 19890 ts_tablet_manager.cc:1403] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.120s	user 0.005s	sys 0.006s
I20260928 01:55:46.282783 20029 raft_consensus.cc:359] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.283521 20029 raft_consensus.cc:385] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:46.283823 20029 raft_consensus.cc:740] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:46.284533 20029 consensus_queue.cc:260] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.285113 20860 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 01:55:46.287029 20029 ts_tablet_manager.cc:1434] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260928 01:55:46.296640 20029 tablet_bootstrap.cc:492] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:46.303105 20820 raft_consensus.cc:515] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.305598 19896 tablet_bootstrap.cc:492] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:46.310451 19890 raft_consensus.cc:359] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.306062 19896 ts_tablet_manager.cc:1403] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.085s	user 0.001s	sys 0.009s
I20260928 01:55:46.271778 20859 raft_consensus.cc:515] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.315901 19890 raft_consensus.cc:385] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:46.316847 19890 raft_consensus.cc:740] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:46.320255 19890 consensus_queue.cc:260] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.326658 19890 ts_tablet_manager.cc:1434] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260928 01:55:46.340862 19890 tablet_bootstrap.cc:492] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:46.351439 19890 tablet_bootstrap.cc:654] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:46.366708 20816 raft_consensus.cc:493] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:46.367213 20816 raft_consensus.cc:515] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.369213 20816 leader_election.cc:290] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:46.374766 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca0b52215454a99b6c5d1956088829a" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:46.375378 19620 raft_consensus.cc:2468] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:46.376727 19704 leader_election.cc:304] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:46.378386 20816 raft_consensus.cc:2804] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:46.378749 20816 raft_consensus.cc:493] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:46.379086 20816 raft_consensus.cc:3060] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:46.391175 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f709eccf4ab5413bbbd8b4746f185db4 (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f709eccf4ab5413bbbd8b4746f185db4 consensus state has no leader
I20260928 01:55:46.393150 20815 consensus_queue.cc:1048] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:46.314788 19896 raft_consensus.cc:359] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.426051 19896 raft_consensus.cc:385] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:46.426384 19896 raft_consensus.cc:740] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:46.426811 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba]
I20260928 01:55:46.427083 19896 consensus_queue.cc:260] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.377442 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca0b52215454a99b6c5d1956088829a" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:46.428653 19475 raft_consensus.cc:2468] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:46.428757 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:46.429261 19767 raft_consensus.cc:3060] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:46.387380 20897 raft_consensus.cc:493] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:46.432945 20897 raft_consensus.cc:515] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.436280 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376b5a87b07b4f87a2a502b5fa1b23f8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:46.437925 19409 leader_election.cc:343] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:46.440110 20897 leader_election.cc:290] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:46.441954 19896 ts_tablet_manager.cc:1434] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.130s	user 0.010s	sys 0.002s
I20260928 01:55:46.443192 19896 tablet_bootstrap.cc:492] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:46.445495 19767 raft_consensus.cc:2468] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:46.447362 19409 leader_election.cc:304] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:46.448745 20906 raft_consensus.cc:2804] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:46.449028 19890 tablet_bootstrap.cc:492] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:46.450182 20906 raft_consensus.cc:697] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:46.452754 19890 ts_tablet_manager.cc:1403] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.114s	user 0.008s	sys 0.012s
I20260928 01:55:46.461689 19110 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]). Expected version 2 got 0
I20260928 01:55:46.461810 19890 raft_consensus.cc:359] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.462188 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619]
I20260928 01:55:46.462487 19890 raft_consensus.cc:385] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:46.462880 19890 raft_consensus.cc:740] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:46.463115 19110 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]). Expected version 2 got 0
I20260928 01:55:46.463547 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287060a8d054b15b2252dcf280ca8c2" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:46.463871 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e]
I20260928 01:55:46.464442 19110 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
W20260928 01:55:46.465034 19704 leader_election.cc:343] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:46.465148 19110 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:55:46.466126 20820 leader_election.cc:290] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:46.466782 19896 tablet_bootstrap.cc:654] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
E20260928 01:55:46.467602 19377 catalog_manager.cc:839] Error processing pending assignments: Illegal state: error persisting updated tablet metadata: replica 81ebb46a410e43ebaec3ef4dd13a71fc is not leader of this config: current role FOLLOWER
I20260928 01:55:46.468276 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287060a8d054b15b2252dcf280ca8c2" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:46.468954 19475 raft_consensus.cc:3060] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:46.463553 19890 consensus_queue.cc:260] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.469564 20906 consensus_queue.cc:237] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.305186 20811 raft_consensus.cc:515] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.477048 19475 raft_consensus.cc:2468] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:46.481003 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:46.481693 19620 raft_consensus.cc:3060] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:46.466522 19110 catalog_manager.cc:5838] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:55:46.482761 19110 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:55:46.483160 20866 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:55:46.484616 19113 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d] alter complete (version 1)
I20260928 01:55:46.488799 19594 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b3c947794c48daaacc299a7d2dd4a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 21906a8380e64d95b9454a57fc01c6f0) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:46.493808 19703 leader_election.cc:304] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:46.496168 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c1f247486548ee9747403f7f80e3dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:46.496543 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet ed6d3c1d99cc40febd285d0a8f5c3196 with delete_type TABLET_DATA_DELETED (replaced by tablet eb014699060e4a6caf4caaf33c31710a) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:46.454771 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376b5a87b07b4f87a2a502b5fa1b23f8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:46.499956 19412 leader_election.cc:343] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:46.500447 19412 leader_election.cc:304] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:46.501649 20897 raft_consensus.cc:2749] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:46.504989 19890 ts_tablet_manager.cc:1434] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260928 01:55:46.483728 20866 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:46.515522 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet 03bbed8181084cb88b7d33976c20fbb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c007b068b1d414298cce3fe44a91daa) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:46.515859 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet b699e0d862fa4a54bbd756625f4e692b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:46.516448 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet f3741aec215343468b2d7bc952da03c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:44964
W20260928 01:55:46.517381 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 77c1f247486548ee9747403f7f80e3dc because the tablet was not found. No further retry: Not found: Tablet not found: 77c1f247486548ee9747403f7f80e3dc
W20260928 01:55:46.518420 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet ed6d3c1d99cc40febd285d0a8f5c3196 because the tablet was not found. No further retry: Not found: Tablet not found: ed6d3c1d99cc40febd285d0a8f5c3196
I20260928 01:55:46.515077 20859 leader_election.cc:290] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:46.521145 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet b699e0d862fa4a54bbd756625f4e692b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:46.491864 19620 raft_consensus.cc:2468] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:46.527724 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet f71e2109f8cd4dd4a288fbdc8e50b133 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:46.529500 20866 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:46.529919 19704 leader_election.cc:304] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:46.531956 20551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:46.535650 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet f3741aec215343468b2d7bc952da03c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:55:46.311754 20029 tablet_bootstrap.cc:654] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:46.538062 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:46.539831 19412 leader_election.cc:343] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:46.537448 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 03bbed8181084cb88b7d33976c20fbb8 because the tablet was not found. No further retry: Not found: Tablet not found: 03bbed8181084cb88b7d33976c20fbb8
I20260928 01:55:46.541252 19890 tablet_bootstrap.cc:492] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:46.541345 20811 leader_election.cc:290] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:46.542258 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet b699e0d862fa4a54bbd756625f4e692b because the tablet was not found. No further retry: Not found: Tablet not found: b699e0d862fa4a54bbd756625f4e692b
W20260928 01:55:46.545859 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet f3741aec215343468b2d7bc952da03c8 because the tablet was not found. No further retry: Not found: Tablet not found: f3741aec215343468b2d7bc952da03c8
I20260928 01:55:46.460031 20815 consensus_queue.cc:1048] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.086s
I20260928 01:55:46.551421 19456 tablet_service.cc:1558] Processing DeleteTablet for tablet d66eeaf33aa943c09f52b74360e2332d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:46.563849 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet d66eeaf33aa943c09f52b74360e2332d because the tablet was not found. No further retry: Not found: Tablet not found: d66eeaf33aa943c09f52b74360e2332d
I20260928 01:55:46.572373 19446 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ca0b52215454a99b6c5d1956088829a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:46.519389 20816 raft_consensus.cc:515] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.575404 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a753f894ae94b1eaf9b445df3545ded with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:46.576591 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet f71e2109f8cd4dd4a288fbdc8e50b133 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:46.577690 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet c1f73a301c84482f897990ac5e5dd162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:37 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:46.577705 19456 tablet_service.cc:1558] Processing DeleteTablet for tablet b699e0d862fa4a54bbd756625f4e692b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:46.578707 20914 tablet_replica.cc:333] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:46.579731 20546 tablet_replica.cc:333] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:55:46.580514 20546 raft_consensus.cc:2243] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:46.580953 20546 raft_consensus.cc:2272] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:46.582634 20546 ts_tablet_manager.cc:1916] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:46.580648 19896 tablet_bootstrap.cc:492] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:46.583679 19896 ts_tablet_manager.cc:1403] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.001s
I20260928 01:55:46.585173 19456 tablet_service.cc:1558] Processing DeleteTablet for tablet f71e2109f8cd4dd4a288fbdc8e50b133 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:33 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:46.581524 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:46.585711 19475 raft_consensus.cc:3060] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:46.585788 19115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 26) took 3356 ms (client timeout 1000 ms). Trace:
I20260928 01:55:46.588645 19896 raft_consensus.cc:359] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:46.589661 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f08e6838341436f8a85d6dbafc805df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:44964
E20260928 01:55:46.485822 19110 catalog_manager.cc:6001] Error updating tablets from 8373bfae1f384c36b5e4c5ca26b208da: Illegal state: replica 81ebb46a410e43ebaec3ef4dd13a71fc is not leader of this config: current role FOLLOWER. Tablet report was: is_incremental: true updated_tablets { tablet_id: "d66eeaf33aa943c09f52b74360e2332d" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "45d8d07b367b4fafbd7171f8ea7b2a26" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "c1f73a301c84482f897990ac5e5dd162" state: RUNNING consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "4ee6d48172044c74aacd4b78683efb66" state: RUNNING consensus_state { current_term: 2 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" state: RUNNING consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "b60e7bd679e447d18e340cfaed66d328" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27550 live_row_count: 0 } } updated_tablets { tablet_id: "ca443386942e49d9a66143e1fde777c5" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "99e806ba248746d2bde39a2eb76b17df" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "f71e2109f8cd4dd4a288fbdc8e50b133" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "f3741aec215343468b2d7bc952da03c8" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27506 live_row_count: 0 } } updated_tablets { tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "b699e0d862fa4a54bbd756625f4e692b" state: STOPPED consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_DELETED } updated_tablets { tablet_id: "1555e557370a4e92915a9c55107b573b" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "4e6b59144fe14daab98b0965c7f8af02" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "3f4a1c903a04450684ba38081a75559e" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27506 live_row_count: 0 } } updated_tablets { tablet_id: "86825485bfca479ea63c1a99dddb68d6" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27506 live_row_count: 0 } } updated_tablets { tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27759 live_row_count: 0 } } updated_tablets { tablet_id: "ed6d3c1d99cc40febd285d0a8f5c3196" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } } } schema_version: 5 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27981 live_row_count: 0 } } updated_tablets { tablet_id: "77c1f247486548ee9747403f7f80e3dc" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27759 live_row_count: 0 } } removed_tablet_ids: "3f08e6838341436f8a85d6dbafc805df" removed_tablet_ids: "90b3c947794c48daaacc299a7d2dd4a9" removed_tablet_ids: "7a753f894ae94b1eaf9b445df3545ded" removed_tablet_ids: "03bbed8181084cb88b7d33976c20fbb8" removed_tablet_ids: "78a71904514a488083426f5fe07d12cd" removed_tablet_ids: "599ef1523fcf43d1a1e2a91f03abaa60" removed_tablet_ids: "7bfcdfe218414396824a8f3af4d673ff" removed_tablet_ids: "5d9b93f45ccf44e785b00849e49c8294" sequence_number: 26
W20260928 01:55:46.591476 19110 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 27) took 2147 ms (client timeout 1000 ms). Trace:
I20260928 01:55:46.591730 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b3c947794c48daaacc299a7d2dd4a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 21906a8380e64d95b9454a57fc01c6f0) from {username='slave'} at 127.0.0.1:44964
I20260928 01:55:46.595587 20913 raft_consensus.cc:2804] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:46.596247 20913 raft_consensus.cc:697] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:46.598587 20913 consensus_queue.cc:237] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:46.602257 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 72421.7us
I20260928 01:55:46.588984 19456 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c1f247486548ee9747403f7f80e3dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:46.577384 20820 raft_consensus.cc:2804] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:46.603509 19896 raft_consensus.cc:385] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:46.604023 19896 raft_consensus.cc:740] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:46.605060 19896 consensus_queue.cc:260] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:46.586536 19115 rpcz_store.cc:269] 0928 01:55:43.204025 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:43.292449 (+ 88424us) service_pool.cc:224] Handling call
0928 01:55:44.520290 (+1227841us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:44.520316 (+    26us) write_op.cc:454] Released schema lock
0928 01:55:46.560074 (+2039758us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:44.480364 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:44.480748 (+   384us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:44.480770 (+    22us) write_op.cc:435] Acquired schema lock
0928 01:55:44.480786 (+    16us) tablet.cc:662] Decoding operations
0928 01:55:44.481078 (+   292us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:44.481114 (+    36us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:44.481135 (+    21us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:55:44.481400 (+   265us) tablet.cc:701] Row locks acquired
0928 01:55:44.481414 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:55:44.481530 (+   116us) write_op.cc:270] Start()
0928 01:55:44.481623 (+    93us) write_op.cc:276] Timestamp: P: 1790560544481475 usec, L: 0
0928 01:55:44.481637 (+    14us) op_driver.cc:348] REPLICATION: starting
0928 01:55:44.482138 (+   501us) log.cc:844] Serialized 907 byte log entry
0928 01:55:44.493439 (+ 11301us) op_driver.cc:464] REPLICATION: finished
0928 01:55:44.493870 (+   431us) write_op.cc:301] APPLY: starting
0928 01:55:44.493925 (+    55us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:44.494074 (+   149us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:44.494208 (+   134us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:44.494483 (+   275us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:44.494621 (+   138us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:55:44.494669 (+    48us) write_op.cc:312] APPLY: finished
0928 01:55:44.494850 (+   181us) log.cc:844] Serialized 29 byte log entry
0928 01:55:44.494996 (+   146us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:44.495068 (+    72us) write_op.cc:454] Released schema lock
0928 01:55:44.495100 (+    32us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":44422,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":250,"apply.run_cpu_time_us":1420,"apply.run_wall_time_us":1420,"num_ops":2,"prepare.queue_time_us":656,"prepare.run_cpu_time_us":2017,"prepare.run_wall_time_us":4887,"replication_time_us":11703}]]}
I20260928 01:55:46.608079 19896 ts_tablet_manager.cc:1434] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260928 01:55:46.610085 20816 leader_election.cc:290] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:46.591794 19110 rpcz_store.cc:269] 0928 01:55:44.444577 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.463076 (+ 18499us) service_pool.cc:224] Handling call
0928 01:55:46.485587 (+2022511us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:46.485608 (+    21us) write_op.cc:454] Released schema lock
0928 01:55:46.591415 (+105807us) inbound_call.cc:177] Queueing failure response
Related trace 'op':
0928 01:55:46.485357 (+     0us) op_driver.cc:389] HandleFailure(Illegal state: replica 81ebb46a410e43ebaec3ef4dd13a71fc is not leader of this config: current role FOLLOWER)
0928 01:55:46.485398 (+    41us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:46.485416 (+    18us) write_op.cc:454] Released schema lock
0928 01:55:46.485435 (+    19us) write_op.cc:335] FINISH: Op aborted
Metrics: {"mutex_wait_us":18509,"reported_tablets":22,"child_traces":[["op",{}]]}
I20260928 01:55:46.618412 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca0b52215454a99b6c5d1956088829a" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:46.619098 19614 raft_consensus.cc:3060] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:46.619766 19890 tablet_bootstrap.cc:654] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:46.633533 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:46.633925 20909 consensus_queue.cc:1048] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:46.639544 20911 tablet_replica.cc:333] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
W20260928 01:55:46.642664 19113 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 37) took 3099 ms (client timeout 1000 ms). Trace:
I20260928 01:55:46.596664 20914 raft_consensus.cc:2243] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:46.643872 20820 raft_consensus.cc:697] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:46.644853 20914 raft_consensus.cc:2272] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:46.610496 19446 tablet_service.cc:1558] Processing DeleteTablet for tablet d66eeaf33aa943c09f52b74360e2332d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:46.595350 19475 raft_consensus.cc:2468] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:46.614446 19441 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b3c947794c48daaacc299a7d2dd4a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 21906a8380e64d95b9454a57fc01c6f0) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:46.616315 19450 tablet_service.cc:1558] Processing DeleteTablet for tablet c1f73a301c84482f897990ac5e5dd162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:37 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:46.630795 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca0b52215454a99b6c5d1956088829a" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:46.645965 20820 consensus_queue.cc:237] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.641508 19444 tablet_service.cc:1558] Processing DeleteTablet for tablet 158edf7a5d724c88992fecbadd2cedfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:46.608520 19456 tablet_service.cc:1558] Processing DeleteTablet for tablet ed6d3c1d99cc40febd285d0a8f5c3196 with delete_type TABLET_DATA_DELETED (replaced by tablet eb014699060e4a6caf4caaf33c31710a) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:46.552013 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 90b3c947794c48daaacc299a7d2dd4a9 because the tablet was not found. No further retry: Not found: Tablet not found: 90b3c947794c48daaacc299a7d2dd4a9
I20260928 01:55:46.648383 20914 ts_tablet_manager.cc:1916] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:55:46.649082 19105 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 97109.3us
W20260928 01:55:46.649930 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet b699e0d862fa4a54bbd756625f4e692b because the tablet was not found. No further retry: Not found: Tablet not found: b699e0d862fa4a54bbd756625f4e692b
I20260928 01:55:46.655429 19456 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a753f894ae94b1eaf9b445df3545ded with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:46.656857 19456 tablet_service.cc:1558] Processing DeleteTablet for tablet 03bbed8181084cb88b7d33976c20fbb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c007b068b1d414298cce3fe44a91daa) from {username='slave'} at 127.0.0.1:39104
I20260928 01:55:46.656921 20029 tablet_bootstrap.cc:492] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:46.657337 20029 ts_tablet_manager.cc:1403] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.361s	user 0.009s	sys 0.004s
I20260928 01:55:46.657605 19896 tablet_bootstrap.cc:492] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:46.660310 19703 leader_election.cc:343] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:46.661080 20029 raft_consensus.cc:359] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.668634 20029 raft_consensus.cc:385] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:46.668972 20029 raft_consensus.cc:740] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:46.670797 20911 raft_consensus.cc:2243] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:55:46.671733 20911 raft_consensus.cc:2272] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:46.678171 19456 tablet_service.cc:1558] Processing DeleteTablet for tablet 57a81b9455a340728fea713318e1e77a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:39104
W20260928 01:55:46.633414 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 7a753f894ae94b1eaf9b445df3545ded because the tablet was not found. No further retry: Not found: Tablet not found: 7a753f894ae94b1eaf9b445df3545ded
W20260928 01:55:46.679490 19102 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 46318us
W20260928 01:55:46.680325 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet f71e2109f8cd4dd4a288fbdc8e50b133 because the tablet was not found. No further retry: Not found: Tablet not found: f71e2109f8cd4dd4a288fbdc8e50b133
I20260928 01:55:46.681834 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]
W20260928 01:55:46.690377 19116 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 40) took 4841 ms (client timeout 1000 ms). Trace:
I20260928 01:55:46.691691 20029 consensus_queue.cc:260] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:46.696503 19117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 41) took 3437 ms (client timeout 1000 ms). Trace:
I20260928 01:55:46.717347 19896 tablet_bootstrap.cc:654] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:46.724498 20906 raft_consensus.cc:493] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:46.725193 20906 raft_consensus.cc:515] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:46.728634 20906 leader_election.cc:290] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:46.729213 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:46.731163 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:46.733203 19412 leader_election.cc:343] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:46.734402 19409 leader_election.cc:343] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:46.734772 19409 leader_election.cc:304] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:46.735865 20906 raft_consensus.cc:2749] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:46.736941 20859 raft_consensus.cc:493] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:46.738487 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2]
W20260928 01:55:46.746634 19117 rpcz_store.cc:269] 0928 01:55:43.258868 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:43.607304 (+348436us) service_pool.cc:224] Handling call
0928 01:55:43.839940 (+232636us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:46.695877 (+2855937us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39394,"reported_tablets":27,"spinlock_wait_cycles":255082240}
W20260928 01:55:46.704774 19114 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 39) took 5955 ms (client timeout 1000 ms). Trace:
W20260928 01:55:46.748117 19114 rpcz_store.cc:269] 0928 01:55:40.748940 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:40.749115 (+   175us) service_pool.cc:224] Handling call
0928 01:55:46.704117 (+5955002us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51706,"reported_tablets":26}
I20260928 01:55:46.737527 20859 raft_consensus.cc:515] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.757323 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416ccc1323fe41b2a7783dc95bba8d84" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:46.756879 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416ccc1323fe41b2a7783dc95bba8d84" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:46.759202 19412 leader_election.cc:343] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:46.760007 19409 leader_election.cc:343] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:46.760423 19409 leader_election.cc:304] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:46.756012 20859 leader_election.cc:290] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:46.761336 20906 raft_consensus.cc:2749] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:46.766116 20919 raft_consensus.cc:493] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:46.766846 20919 raft_consensus.cc:515] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:46.690989 19116 rpcz_store.cc:269] 0928 01:55:41.848835 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:41.848950 (+   115us) service_pool.cc:224] Handling call
0928 01:55:46.689803 (+4840853us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:42.271874 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:42.272276 (+   402us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:42.272300 (+    24us) write_op.cc:435] Acquired schema lock
0928 01:55:42.272314 (+    14us) tablet.cc:662] Decoding operations
0928 01:55:42.272573 (+   259us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:42.272610 (+    37us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:42.272634 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:42.272776 (+   142us) tablet.cc:701] Row locks acquired
0928 01:55:42.272788 (+    12us) write_op.cc:260] PREPARE: finished
0928 01:55:42.292451 (+ 19663us) write_op.cc:270] Start()
0928 01:55:42.292543 (+    92us) write_op.cc:276] Timestamp: P: 1790560542292383 usec, L: 0
0928 01:55:42.292558 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:42.293090 (+   532us) log.cc:844] Serialized 530 byte log entry
0928 01:55:42.369625 (+ 76535us) op_driver.cc:464] REPLICATION: finished
0928 01:55:42.376669 (+  7044us) write_op.cc:301] APPLY: starting
0928 01:55:42.376725 (+    56us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:42.376830 (+   105us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:42.377491 (+   661us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:42.377664 (+   173us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:42.377802 (+   138us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:42.377841 (+    39us) write_op.cc:312] APPLY: finished
0928 01:55:42.378029 (+   188us) log.cc:844] Serialized 23 byte log entry
0928 01:55:42.403488 (+ 25459us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:42.403552 (+    64us) write_op.cc:454] Released schema lock
0928 01:55:42.403584 (+    32us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:42.405125 (+  1541us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:42.405152 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35629,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":6880,"apply.run_cpu_time_us":1356,"apply.run_wall_time_us":28419,"num_ops":1,"prepare.queue_time_us":3424,"prepare.run_cpu_time_us":2107,"prepare.run_wall_time_us":80796,"raft.queue_time_us":200,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":375,"replication_time_us":76966}]]}
W20260928 01:55:46.643148 19113 rpcz_store.cc:269] 0928 01:55:43.542888 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:43.672576 (+129688us) service_pool.cc:224] Handling call
0928 01:55:43.835769 (+163193us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:55:44.132609 (+296840us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:44.132638 (+    29us) write_op.cc:454] Released schema lock
0928 01:55:44.340300 (+207662us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:44.340327 (+    27us) write_op.cc:454] Released schema lock
0928 01:55:46.642561 (+2302234us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:43.999756 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:44.000187 (+   431us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:44.000255 (+    68us) write_op.cc:435] Acquired schema lock
0928 01:55:44.000268 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:44.000538 (+   270us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:44.000579 (+    41us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:44.000613 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:44.000776 (+   163us) tablet.cc:701] Row locks acquired
0928 01:55:44.000789 (+    13us) write_op.cc:260] PREPARE: finished
0928 01:55:44.000910 (+   121us) write_op.cc:270] Start()
0928 01:55:44.000995 (+    85us) write_op.cc:276] Timestamp: P: 1790560544000850 usec, L: 0
0928 01:55:44.001009 (+    14us) op_driver.cc:348] REPLICATION: starting
0928 01:55:44.001529 (+   520us) log.cc:844] Serialized 530 byte log entry
0928 01:55:44.012179 (+ 10650us) op_driver.cc:464] REPLICATION: finished
0928 01:55:44.012821 (+   642us) write_op.cc:301] APPLY: starting
0928 01:55:44.012893 (+    72us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:44.013047 (+   154us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:44.013168 (+   121us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:44.013389 (+   221us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:44.013602 (+   213us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:44.013678 (+    76us) write_op.cc:312] APPLY: finished
0928 01:55:44.013935 (+   257us) log.cc:844] Serialized 23 byte log entry
0928 01:55:44.014139 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:44.014214 (+    75us) write_op.cc:454] Released schema lock
0928 01:55:44.014265 (+    51us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0928 01:55:44.156704 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:44.157156 (+   452us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:44.157184 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:55:44.157196 (+    12us) tablet.cc:662] Decoding operations
0928 01:55:44.157471 (+   275us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:44.157512 (+    41us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:44.157535 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:44.157685 (+   150us) tablet.cc:701] Row locks acquired
0928 01:55:44.157701 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:55:44.157820 (+   119us) write_op.cc:270] Start()
0928 01:55:44.157907 (+    87us) write_op.cc:276] Timestamp: P: 1790560544157784 usec, L: 0
0928 01:55:44.157922 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:44.158479 (+   557us) log.cc:844] Serialized 356 byte log entry
0928 01:55:44.173256 (+ 14777us) op_driver.cc:464] REPLICATION: finished
0928 01:55:44.173699 (+   443us) write_op.cc:301] APPLY: starting
0928 01:55:44.173776 (+    77us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:44.173931 (+   155us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:44.174092 (+   161us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:44.174339 (+   247us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:44.174551 (+   212us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:44.174623 (+    72us) write_op.cc:312] APPLY: finished
0928 01:55:44.174942 (+   319us) log.cc:844] Serialized 23 byte log entry
0928 01:55:44.175153 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:44.175232 (+    79us) write_op.cc:454] Released schema lock
0928 01:55:44.175293 (+    61us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0928 01:55:44.469226 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:55:44.469640 (+   414us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:55:44.469664 (+    24us) write_op.cc:435] Acquired schema lock
0928 01:55:44.469677 (+    13us) tablet.cc:662] Decoding operations
0928 01:55:44.469940 (+   263us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:55:44.469982 (+    42us) write_op.cc:641] Partition lock acquired for write op
0928 01:55:44.470006 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:55:44.470147 (+   141us) tablet.cc:701] Row locks acquired
0928 01:55:44.470160 (+    13us) write_op.cc:260] PREPARE: finished
0928 01:55:44.470282 (+   122us) write_op.cc:270] Start()
0928 01:55:44.470362 (+    80us) write_op.cc:276] Timestamp: P: 1790560544470230 usec, L: 0
0928 01:55:44.470377 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:55:44.470874 (+   497us) log.cc:844] Serialized 356 byte log entry
0928 01:55:44.483477 (+ 12603us) op_driver.cc:464] REPLICATION: finished
0928 01:55:44.483803 (+   326us) write_op.cc:301] APPLY: starting
0928 01:55:44.483860 (+    57us) tablet.cc:1394] starting BulkCheckPresence
0928 01:55:44.483947 (+    87us) tablet.cc:1397] finished BulkCheckPresence
0928 01:55:44.484045 (+    98us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:55:44.484232 (+   187us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:55:44.484356 (+   124us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:55:44.484394 (+    38us) write_op.cc:312] APPLY: finished
0928 01:55:44.484559 (+   165us) log.cc:844] Serialized 23 byte log entry
0928 01:55:44.484691 (+   132us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:44.484748 (+    57us) write_op.cc:454] Released schema lock
0928 01:55:44.484777 (+    29us) write_op.cc:341] FINISH: Updating metrics
0928 01:55:44.484984 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:44.485005 (+    21us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10866,"reported_tablets":15,"spinlock_wait_cycles":367931648,"child_traces":[["op",{"apply.queue_time_us":419,"apply.run_cpu_time_us":1712,"apply.run_wall_time_us":1712,"num_ops":1,"prepare.queue_time_us":522,"prepare.run_cpu_time_us":2111,"prepare.run_wall_time_us":23890,"raft.queue_time_us":98,"raft.run_cpu_time_us":770,"raft.run_wall_time_us":770,"replication_time_us":11041}],["op",{"apply.queue_time_us":203,"apply.run_cpu_time_us":1852,"apply.run_wall_time_us":1862,"num_ops":1,"prepare.queue_time_us":9693,"prepare.run_cpu_time_us":2165,"prepare.run_wall_time_us":13259,"raft.queue_time_us":97,"raft.run_cpu_time_us":1437,"raft.run_wall_time_us":1439,"replication_time_us":15197}],["op",{"apply.queue_time_us":181,"apply.run_cpu_time_us":1155,"apply.run_wall_time_us":1155,"num_ops":1,"prepare.queue_time_us":16705,"prepare.run_cpu_time_us":1934,"prepare.run_wall_time_us":1935,"raft.queue_time_us":1116,"raft.run_cpu_time_us":734,"raft.run_wall_time_us":734,"replication_time_us":12995}]]}
I20260928 01:55:46.773171 20919 leader_election.cc:290] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:46.774537 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:46.775172 19472 raft_consensus.cc:2468] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:46.775317 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:46.775898 19767 raft_consensus.cc:2468] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:46.776713 19556 leader_election.cc:304] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:46.777794 20919 raft_consensus.cc:2804] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:46.778074 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85]
I20260928 01:55:46.778435 20919 raft_consensus.cc:493] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:46.779062 20919 raft_consensus.cc:3060] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:46.780277 19614 raft_consensus.cc:2468] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:46.781143 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]
I20260928 01:55:46.792968 20029 ts_tablet_manager.cc:1434] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.000s
I20260928 01:55:46.793956 20029 tablet_bootstrap.cc:492] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:46.802924 19704 leader_election.cc:304] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:46.804042 19896 tablet_bootstrap.cc:492] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:46.804126 20915 raft_consensus.cc:2804] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:46.804804 20915 raft_consensus.cc:697] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:46.805971 20915 consensus_queue.cc:237] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.812718 20911 ts_tablet_manager.cc:1916] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:46.818784 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca]
I20260928 01:55:46.819073 20820 consensus_queue.cc:1048] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:46.845920 20915 raft_consensus.cc:493] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:46.846587 20915 raft_consensus.cc:515] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.849489 20915 leader_election.cc:290] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:46.850759 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05925303152462e8ca25cd15f3bedff" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:46.852404 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05925303152462e8ca25cd15f3bedff" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:46.855149 20546 ts_tablet_manager.cc:1929] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:46.855577 20546 log.cc:1199] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/c1f73a301c84482f897990ac5e5dd162
I20260928 01:55:46.856392 20546 ts_tablet_manager.cc:1950] T c1f73a301c84482f897990ac5e5dd162 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
W20260928 01:55:46.856689 19704 leader_election.cc:343] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:46.857455 19472 raft_consensus.cc:2468] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:46.859068 19703 leader_election.cc:304] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:46.852337 19896 ts_tablet_manager.cc:1403] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.196s	user 0.014s	sys 0.006s
I20260928 01:55:46.861941 20915 raft_consensus.cc:2804] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:46.862435 20915 raft_consensus.cc:493] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:46.862912 20915 raft_consensus.cc:3060] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:46.863134 19896 raft_consensus.cc:359] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:46.863847 19896 raft_consensus.cc:385] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:55:46.864281 19704 consensus_peers.cc:597] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:46.864111 19896 raft_consensus.cc:740] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:46.873627 19896 consensus_queue.cc:260] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:46.876091 19890 tablet_bootstrap.cc:492] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:46.877207 19890 ts_tablet_manager.cc:1403] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.348s	user 0.015s	sys 0.017s
I20260928 01:55:46.885121 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet c1f73a301c84482f897990ac5e5dd162 (table default.Table_9aeb2b485111496ea1fed85fd4c55531 [id=c6da5b1f292748818838b53ed38d64a3]) successfully deleted
I20260928 01:55:46.886346 19896 ts_tablet_manager.cc:1434] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260928 01:55:46.887951 20914 ts_tablet_manager.cc:1929] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:55:46.894021 20914 log.cc:1199] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/9ca0b52215454a99b6c5d1956088829a
I20260928 01:55:46.895366 20914 ts_tablet_manager.cc:1950] T 9ca0b52215454a99b6c5d1956088829a P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
W20260928 01:55:46.900586 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 3f08e6838341436f8a85d6dbafc805df because the tablet was not found. No further retry: Not found: Tablet not found: 3f08e6838341436f8a85d6dbafc805df
I20260928 01:55:46.901173 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae]
I20260928 01:55:46.903501 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 9ca0b52215454a99b6c5d1956088829a (table default.Table_d8fa3c5311e74d20aa00d9acb400810f [id=500a88f7dfbc403f9a04f06f9f6f95bf]) successfully deleted
W20260928 01:55:46.904906 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet b699e0d862fa4a54bbd756625f4e692b because the tablet was not found. No further retry: Not found: Tablet not found: b699e0d862fa4a54bbd756625f4e692b
W20260928 01:55:46.905675 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet f71e2109f8cd4dd4a288fbdc8e50b133 because the tablet was not found. No further retry: Not found: Tablet not found: f71e2109f8cd4dd4a288fbdc8e50b133
I20260928 01:55:46.906939 20840 consensus_queue.cc:1048] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:46.910502 19102 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 90b3c947794c48daaacc299a7d2dd4a9 because the tablet was not found. No further retry: Not found: Tablet not found: 90b3c947794c48daaacc299a7d2dd4a9
I20260928 01:55:46.910697 19890 raft_consensus.cc:359] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:46.911438 19890 raft_consensus.cc:385] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:46.911680 19890 raft_consensus.cc:740] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:46.912389 19890 consensus_queue.cc:260] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:46.913842 19896 tablet_bootstrap.cc:492] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:46.917894 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 77c1f247486548ee9747403f7f80e3dc because the tablet was not found. No further retry: Not found: Tablet not found: 77c1f247486548ee9747403f7f80e3dc
I20260928 01:55:46.906378 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]
I20260928 01:55:46.960263 19896 tablet_bootstrap.cc:654] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:46.968221 20811 consensus_queue.cc:1048] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:46.953788 19890 ts_tablet_manager.cc:1434] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.003s
I20260928 01:55:46.961655 20919 raft_consensus.cc:515] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:46.982563 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:46.982725 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:46.983162 19474 raft_consensus.cc:3060] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:46.988281 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9]
I20260928 01:55:46.990216 19474 raft_consensus.cc:2468] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:46.983511 19766 raft_consensus.cc:3060] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:46.981968 20919 leader_election.cc:290] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:46.991528 19556 leader_election.cc:304] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:47.016642 20919 raft_consensus.cc:2804] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:47.017918 20906 raft_consensus.cc:493] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:47.018432 20906 raft_consensus.cc:515] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:47.020598 20906 leader_election.cc:290] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:47.022301 20919 raft_consensus.cc:697] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:47.023108 20919 consensus_queue.cc:237] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.017659 19890 tablet_bootstrap.cc:492] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:47.031046 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:47.033031 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:47.035136 19412 leader_election.cc:343] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:47.035663 19409 leader_election.cc:343] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:47.036077 19409 leader_election.cc:304] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:47.037199 20906 raft_consensus.cc:2749] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:47.038266 19896 tablet_bootstrap.cc:492] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:47.038738 19896 ts_tablet_manager.cc:1403] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.152s	user 0.013s	sys 0.002s
I20260928 01:55:47.040939 19890 tablet_bootstrap.cc:654] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:47.041549 19896 raft_consensus.cc:359] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.042331 19896 raft_consensus.cc:385] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:47.042600 19896 raft_consensus.cc:740] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:47.048444 20840 consensus_queue.cc:1048] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:47.059818 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:47.070971 20029 tablet_bootstrap.cc:654] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:47.068663 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa]
I20260928 01:55:47.083452 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_a82317fb7790483884cbb5ebcf554128 [id=292d90fe578e4470bced0890a4e646ef]
I20260928 01:55:47.091733 19766 raft_consensus.cc:2468] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:47.092582 19896 consensus_queue.cc:260] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.104121 19896 ts_tablet_manager.cc:1434] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260928 01:55:47.117700 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]
I20260928 01:55:47.135614 20811 consensus_queue.cc:1048] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:55:47.137723 19102 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.624s (SENT) [suppressed 3 similar messages]
I20260928 01:55:47.145798 20914 tablet_replica.cc:333] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:47.146849 20914 raft_consensus.cc:2243] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 01:55:47.148725 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet d66eeaf33aa943c09f52b74360e2332d because the tablet was not found. No further retry: Not found: Tablet not found: d66eeaf33aa943c09f52b74360e2332d
W20260928 01:55:47.149452 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 90b3c947794c48daaacc299a7d2dd4a9 because the tablet was not found. No further retry: Not found: Tablet not found: 90b3c947794c48daaacc299a7d2dd4a9
W20260928 01:55:47.150067 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet c1f73a301c84482f897990ac5e5dd162 because the tablet was not found. No further retry: Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
I20260928 01:55:47.151005 20914 raft_consensus.cc:2272] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:47.132123 20915 raft_consensus.cc:515] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.153515 20914 ts_tablet_manager.cc:1916] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:47.163293 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05925303152462e8ca25cd15f3bedff" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:47.163941 19475 raft_consensus.cc:3060] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:47.167440 19896 tablet_bootstrap.cc:492] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:47.178615 20915 leader_election.cc:290] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:47.173417 19475 raft_consensus.cc:2468] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:47.188361 19703 leader_election.cc:304] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:47.191462 20913 raft_consensus.cc:2804] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:47.192005 20913 raft_consensus.cc:697] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
W20260928 01:55:47.192644 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 70752.4us
I20260928 01:55:47.192991 20913 consensus_queue.cc:237] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:47.200943 19704 consensus_peers.cc:597] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:47.206095 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05925303152462e8ca25cd15f3bedff" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:47.207603 19704 leader_election.cc:343] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:47.218647 19890 tablet_bootstrap.cc:492] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:47.219097 19890 ts_tablet_manager.cc:1403] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.241s	user 0.008s	sys 0.007s
I20260928 01:55:47.235044 19890 raft_consensus.cc:359] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.235742 19890 raft_consensus.cc:385] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:47.236006 19890 raft_consensus.cc:740] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:47.246510 19890 consensus_queue.cc:260] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.252807 19890 ts_tablet_manager.cc:1434] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260928 01:55:47.253778 19890 tablet_bootstrap.cc:492] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:47.258426 20911 ts_tablet_manager.cc:1929] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:47.259197 20911 log.cc:1199] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/f71e2109f8cd4dd4a288fbdc8e50b133
I20260928 01:55:47.262301 20911 ts_tablet_manager.cc:1950] T f71e2109f8cd4dd4a288fbdc8e50b133 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:55:47.268187 19890 tablet_bootstrap.cc:654] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:47.280834 19703 consensus_peers.cc:597] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:47.299417 20939 raft_consensus.cc:493] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:47.299954 20939 raft_consensus.cc:515] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.302102 20939 leader_election.cc:290] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:47.311056 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]
I20260928 01:55:47.313015 20029 tablet_bootstrap.cc:492] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:47.313460 20029 ts_tablet_manager.cc:1403] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.520s	user 0.009s	sys 0.007s
I20260928 01:55:47.315330 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a81b9455a340728fea713318e1e77a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:47.321729 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a81b9455a340728fea713318e1e77a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:47.327849 19105 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet f71e2109f8cd4dd4a288fbdc8e50b133 (table default.Table_1e30aacb906b40aaa3a683c1495c78f2 [id=30ade53be61542a7a042a4401001fba9]) successfully deleted
I20260928 01:55:47.328303 19556 leader_election.cc:304] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:47.328950 19105 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet f3741aec215343468b2d7bc952da03c8 because the tablet was not found. No further retry: Not found: Tablet not found: f3741aec215343468b2d7bc952da03c8
I20260928 01:55:47.329227 20939 raft_consensus.cc:2749] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:47.348327 19896 tablet_bootstrap.cc:654] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:47.352275 19890 tablet_bootstrap.cc:492] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:47.352815 19890 ts_tablet_manager.cc:1403] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.000s
I20260928 01:55:47.355484 19890 raft_consensus.cc:359] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.356465 19890 raft_consensus.cc:385] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:47.358232 19890 raft_consensus.cc:740] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:47.366382 19890 consensus_queue.cc:260] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.369176 19890 ts_tablet_manager.cc:1434] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260928 01:55:47.370321 20029 raft_consensus.cc:359] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.371009 20029 raft_consensus.cc:385] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:47.371292 20029 raft_consensus.cc:740] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:47.375924 19890 tablet_bootstrap.cc:492] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:47.381781 19890 tablet_bootstrap.cc:654] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:47.389993 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a]
I20260928 01:55:47.372460 20029 consensus_queue.cc:260] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.417470 20029 ts_tablet_manager.cc:1434] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.104s	user 0.003s	sys 0.004s
I20260928 01:55:47.419843 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305]
I20260928 01:55:47.423173 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75]
I20260928 01:55:47.434803 20914 ts_tablet_manager.cc:1929] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:47.435220 20914 log.cc:1199] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/158edf7a5d724c88992fecbadd2cedfa
I20260928 01:55:47.443619 20029 tablet_bootstrap.cc:492] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:47.457595 20909 consensus_queue.cc:1048] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:47.460945 19896 tablet_bootstrap.cc:492] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:47.461459 19896 ts_tablet_manager.cc:1403] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.294s	user 0.012s	sys 0.003s
I20260928 01:55:47.488726 20029 tablet_bootstrap.cc:654] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:47.506182 19614 raft_consensus.cc:3060] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:47.509618 20939 raft_consensus.cc:493] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:47.510314 20939 raft_consensus.cc:515] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:47.516677 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:47.436002 20914 ts_tablet_manager.cc:1950] T 158edf7a5d724c88992fecbadd2cedfa P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:47.524560 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 158edf7a5d724c88992fecbadd2cedfa (table default.Table_0991384f9b0745a389ad95d24675e413 [id=1ee3d2a1f321486d90ab82e5cef8f3aa]) successfully deleted
I20260928 01:55:47.535274 20939 leader_election.cc:290] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:47.535585 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:47.541497 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:47.543092 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3]
I20260928 01:55:47.543670 19556 leader_election.cc:304] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:47.545197 20939 raft_consensus.cc:2749] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:47.561982 19412 consensus_peers.cc:597] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:47.565508 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]
W20260928 01:55:47.569638 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet ed6d3c1d99cc40febd285d0a8f5c3196 because the tablet was not found. No further retry: Not found: Tablet not found: ed6d3c1d99cc40febd285d0a8f5c3196
I20260928 01:55:47.567227 19896 raft_consensus.cc:359] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.570703 19896 raft_consensus.cc:385] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:47.572286 19890 tablet_bootstrap.cc:492] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:47.572824 19890 ts_tablet_manager.cc:1403] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.197s	user 0.033s	sys 0.022s
I20260928 01:55:47.576351 19890 raft_consensus.cc:359] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.579645 20909 consensus_queue.cc:1048] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:47.589938 20906 consensus_queue.cc:1048] T c9f3e966ab0d46d187fb9daa356b16fc P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:47.592787 19890 raft_consensus.cc:385] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:55:47.596180 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7a753f894ae94b1eaf9b445df3545ded because the tablet was not found. No further retry: Not found: Tablet not found: 7a753f894ae94b1eaf9b445df3545ded
W20260928 01:55:47.597692 19104 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 03bbed8181084cb88b7d33976c20fbb8 because the tablet was not found. No further retry: Not found: Tablet not found: 03bbed8181084cb88b7d33976c20fbb8
I20260928 01:55:47.571396 19896 raft_consensus.cc:740] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:47.596782 20914 tablet_replica.cc:333] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:55:47.601572 20914 raft_consensus.cc:2243] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 01:55:47.604228 19105 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 982c3e07bcb94230b93764330914630f consensus state has no leader
I20260928 01:55:47.619261 20914 raft_consensus.cc:2272] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:55:47.617616 19896 consensus_queue.cc:260] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.629496 19896 ts_tablet_manager.cc:1434] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.168s	user 0.007s	sys 0.003s
W20260928 01:55:47.635459 20527 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:44073 (request call id 28) took 1307 ms (client timeout 1000 ms). Trace:
I20260928 01:55:47.636611 20526 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:35728 (request call id 1) took 1441 ms. Trace:
W20260928 01:55:47.635828 20527 rpcz_store.cc:269] 0928 01:55:46.328507 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.328748 (+   241us) service_pool.cc:224] Handling call
0928 01:55:47.632838 (+1304090us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000203d4. stack: 00007fb7cb3da323 00007fb7cb3da220 00007fb7caf7e574 0000000000516964 00000000005168f9 00007fb7d24d85c0 00007fb7d25776fa 00007fb7d42e8d8c 00007fb7d43e701e 00007fb7d1f8bfb4 00007fb7d1f8bf42 00007fb7d1f8be71 00007fb7d1f8bdec 00007fb7d1f8b0a2 00007fb7d023d09c 00007fb7d023c4d6
0928 01:55:47.635378 (+  2540us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2992920320}
I20260928 01:55:47.568181 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921]
I20260928 01:55:47.639518 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375]
I20260928 01:55:47.636946 20526 rpcz_store.cc:276] 0928 01:55:46.195399 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.195530 (+   131us) service_pool.cc:224] Handling call
0928 01:55:47.635770 (+1440240us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000203d4. stack: 00007fb7cb3da323 00007fb7cb3da220 00007fb7caf7e574 0000000000516964 00000000005168f9 00007fb7d24d85c0 00007fb7d25776fa 00007fb7d42e8d8c 00007fb7d43ea2f9 00007fb7d1f8e534 00007fb7d1f8e4c2 00007fb7d1f8e3f1 00007fb7d1f8e36c 00007fb7d1f8d622 00007fb7d023d09c 00007fb7d023c4d6
0928 01:55:47.636543 (+   773us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3309477760}
I20260928 01:55:47.642094 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]
I20260928 01:55:47.643296 19890 raft_consensus.cc:740] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
W20260928 01:55:47.643957 20522 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:58377 (request call id 28) took 1375 ms (client timeout 1000 ms). Trace:
I20260928 01:55:47.644266 19890 consensus_queue.cc:260] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.643004 20934 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:55:47.648612 20934 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:47.649179 19890 ts_tablet_manager.cc:1434] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.000s
I20260928 01:55:47.650159 19890 tablet_bootstrap.cc:492] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:47.644398 20522 rpcz_store.cc:269] 0928 01:55:46.268687 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.274813 (+  6126us) service_pool.cc:224] Handling call
0928 01:55:47.637907 (+1363094us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54000203d4. stack: 00007fb7cb3da323 00007fb7cb3da220 00007fb7caf7e574 0000000000516964 00000000005168f9 00007fb7d24d85c0 00007fb7d25776fa 00007fb7d42e8d8c 00007fb7d43e701e 00007fb7d1f8bfb4 00007fb7d1f8bf42 00007fb7d1f8be71 00007fb7d1f8bdec 00007fb7d1f8b0a2 00007fb7d023d09c 00007fb7d023c4d6
0928 01:55:47.643879 (+  5972us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3130138880}
I20260928 01:55:47.677268 20029 tablet_bootstrap.cc:492] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:47.677796 20029 ts_tablet_manager.cc:1403] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.234s	user 0.004s	sys 0.027s
I20260928 01:55:47.681700 20029 raft_consensus.cc:359] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.678709 20906 raft_consensus.cc:493] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:47.688844 20906 raft_consensus.cc:515] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.692648 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3505a502bff747deaf1e03c03375aafa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:47.696583 19412 leader_election.cc:343] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:47.697286 20906 leader_election.cc:290] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:47.700320 20956 log.cc:927] Time spent T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
I20260928 01:55:47.705860 19896 tablet_bootstrap.cc:492] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:47.713121 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3505a502bff747deaf1e03c03375aafa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:47.673167 20899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17b7f9972364c76893311539b569e0f. Latest consensus state: current_term: 3 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:47.716889 20899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:47.651889 20519 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:35732 (request call id 0) took 1253 ms. Trace:
W20260928 01:55:47.718510 20709 log.cc:927] Time spent T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260928 01:55:47.718777 19409 leader_election.cc:343] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:47.709074 20909 consensus_queue.cc:1048] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:47.719224 19409 leader_election.cc:304] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:47.719732 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]
I20260928 01:55:47.717486 20519 rpcz_store.cc:276] 0928 01:55:46.397849 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.398044 (+   195us) service_pool.cc:224] Handling call
0928 01:55:47.650641 (+1252597us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000203d4. stack: 00007fb7cb3da323 00007fb7cb3da220 00007fb7caf7e574 0000000000516964 00000000005168f9 00007fb7d24d85c0 00007fb7d25776fa 00007fb7d42e8d8c 00007fb7d43ea0ab 00007fb7d1fc1e37 00007fb7d1fc1dc2 00007fb7d1fc1cf1 00007fb7d1fc1c6c 00007fb7d1fc0f22 00007fb7d023d09c 00007fb7d023c4d6
0928 01:55:47.651551 (+   910us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2838007040}
I20260928 01:55:47.721122 20906 raft_consensus.cc:2749] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:47.721297 20552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35724 (request call id 3) took 1590 ms. Trace:
I20260928 01:55:47.712253 20029 raft_consensus.cc:385] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:47.723508 20029 raft_consensus.cc:740] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:47.724272 20029 consensus_queue.cc:260] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:47.729995 20520 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:48011 (request call id 27) took 1369 ms (client timeout 1000 ms). Trace:
I20260928 01:55:47.732808 20914 ts_tablet_manager.cc:1916] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:55:47.744620 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]
I20260928 01:55:47.746225 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a]
I20260928 01:55:47.753986 19890 tablet_bootstrap.cc:654] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:47.759222 20934 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
W20260928 01:55:47.730472 20520 rpcz_store.cc:269] 0928 01:55:46.359652 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.359887 (+   235us) service_pool.cc:224] Handling call
0928 01:55:47.660684 (+1300797us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000203d4. stack: 00007fb7cb3da323 00007fb7cb3da220 00007fb7caf7e574 0000000000516964 00000000005168f9 00007fb7d24d85c0 00007fb7d25776fa 00007fb7d42e8d8c 00007fb7d43e701e 00007fb7d1f8bfb4 00007fb7d1f8bf42 00007fb7d1f8be71 00007fb7d1f8bdec 00007fb7d1f8b0a2 00007fb7d023d09c 00007fb7d023c4d6
0928 01:55:47.729273 (+ 68589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2940713216}
I20260928 01:55:47.762488 20811 consensus_queue.cc:1048] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:47.764585 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]
I20260928 01:55:47.767406 20909 consensus_queue.cc:1048] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:47.769305 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]
I20260928 01:55:47.767673 20958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:47.769932 20958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:47.782861 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513]
I20260928 01:55:47.785501 20029 ts_tablet_manager.cc:1434] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.107s	user 0.006s	sys 0.001s
I20260928 01:55:47.785925 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]
I20260928 01:55:47.786525 20029 tablet_bootstrap.cc:492] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:47.787480 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd]
I20260928 01:55:47.792068 20909 raft_consensus.cc:493] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:47.792703 20909 raft_consensus.cc:515] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.796535 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:47.798362 20909 leader_election.cc:290] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:47.799309 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]
I20260928 01:55:47.800572 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:47.801867 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]
W20260928 01:55:47.799981 19704 leader_election.cc:343] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:47.804065 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 4 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
W20260928 01:55:47.804394 19703 leader_election.cc:343] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:47.805234 19126 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e48edd841a42d08a480be209f0d294 in term 3.
I20260928 01:55:47.809207 19703 leader_election.cc:304] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:47.811640 20909 raft_consensus.cc:2749] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:47.833382 19102 leader_election.cc:336] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c17b7f9972364c76893311539b569e0f (127.18.161.61:43775): Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.624s (SENT)
I20260928 01:55:47.833814 19102 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:55:47.842175 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a]
W20260928 01:55:47.833077 19703 consensus_peers.cc:597] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ca0b52215454a99b6c5d1956088829a. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:47.851276 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 
I20260928 01:55:47.852298 20958 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 01:55:47.852662 20958 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:55:47.852981 20958 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:55:47.864634 20958 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:47.894076 20939 raft_consensus.cc:493] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:47.894726 20939 raft_consensus.cc:515] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.899574 20939 leader_election.cc:290] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:47.900036 19553 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
W20260928 01:55:47.901867 19556 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
I20260928 01:55:47.902312 19556 leader_election.cc:304] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:47.904352 20939 raft_consensus.cc:2749] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:47.907437 19890 tablet_bootstrap.cc:492] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:47.908022 19890 ts_tablet_manager.cc:1403] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.258s	user 0.026s	sys 0.003s
I20260928 01:55:47.844020 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]
I20260928 01:55:47.912464 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]
I20260928 01:55:47.917150 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]
I20260928 01:55:47.921819 19896 tablet_bootstrap.cc:654] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:47.925737 20964 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:55:47.926525 20939 consensus_queue.cc:1048] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:55:47.939098 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 105743us
I20260928 01:55:47.947187 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b]
W20260928 01:55:47.948369 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:47.951141 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 4 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc"
I20260928 01:55:47.952009 19126 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:55:47.959883 19890 raft_consensus.cc:359] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.962117 19890 raft_consensus.cc:385] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:47.962499 19890 raft_consensus.cc:740] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:47.963416 19614 raft_consensus.cc:3060] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:47.968556 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 46675.8us
I20260928 01:55:47.963246 19890 consensus_queue.cc:260] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:47.976229 19890 ts_tablet_manager.cc:1434] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.068s	user 0.003s	sys 0.003s
I20260928 01:55:47.978037 19890 tablet_bootstrap.cc:492] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:47.984247 20958 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 4 election: Requested vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:55:47.994565 20029 tablet_bootstrap.cc:654] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:48.009677 19126 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e48edd841a42d08a480be209f0d294 in term 4.
I20260928 01:55:48.045274 19125 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Rejecting Update request from peer c17b7f9972364c76893311539b569e0f for earlier term 3. Current term is 4. Ops: []
I20260928 01:55:48.051566 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 
I20260928 01:55:48.054270 20958 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 4 FOLLOWER]: Leader election won for term 4
I20260928 01:55:48.007128 20939 raft_consensus.cc:493] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:48.055497 20958 raft_consensus.cc:697] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 4 LEADER]: Becoming Leader. State: Replica: 04e48edd841a42d08a480be209f0d294, State: Running, Role: LEADER
I20260928 01:55:48.055456 20946 consensus_queue.cc:1059] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 }, Status: INVALID_TERM, Last received: 3.340, Next index: 341, Last known committed idx: 340, Time since last communication: 0.002s
I20260928 01:55:48.056305 20939 raft_consensus.cc:515] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.057086 20958 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 340, Committed index: 340, Last appended: 3.340, Last appended by leader: 340, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:48.062160 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:48.064735 20967 raft_consensus.cc:493] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:48.065482 20967 raft_consensus.cc:515] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.071452 20972 raft_consensus.cc:3055] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 3 LEADER]: Stepping down as leader of term 3
W20260928 01:55:48.078064 19809 debug-util.cc:398] Leaking SignalData structure 0x7b08000dba40 after lost signal to thread 19677
W20260928 01:55:48.079411 19809 debug-util.cc:398] Leaking SignalData structure 0x7b08000f2ea0 after lost signal to thread 19812
I20260928 01:55:48.081267 20972 raft_consensus.cc:740] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c17b7f9972364c76893311539b569e0f, State: Running, Role: LEADER
I20260928 01:55:48.082954 20972 consensus_queue.cc:260] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 340, Committed index: 340, Last appended: 3.340, Last appended by leader: 340, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:48.085256 20972 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:55:48.075325 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]
I20260928 01:55:48.099380 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]
I20260928 01:55:48.106920 20939 leader_election.cc:290] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:48.123167 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3505a502bff747deaf1e03c03375aafa" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:48.123778 19474 raft_consensus.cc:2468] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:48.125267 19556 leader_election.cc:304] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:48.126441 20967 leader_election.cc:290] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:48.135823 20939 raft_consensus.cc:2804] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:48.136543 20939 raft_consensus.cc:493] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:48.137136 20939 raft_consensus.cc:3060] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:48.147137 20934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e48edd841a42d08a480be209f0d294. Latest consensus state: current_term: 4 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:48.148131 20934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: LEADER
I20260928 01:55:48.150843 19890 tablet_bootstrap.cc:654] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:48.152837 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]
I20260928 01:55:48.154505 19896 tablet_bootstrap.cc:492] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:48.155000 19896 ts_tablet_manager.cc:1403] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.454s	user 0.009s	sys 0.010s
I20260928 01:55:48.156916 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233]
I20260928 01:55:48.159039 19896 raft_consensus.cc:359] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.166805 19896 raft_consensus.cc:385] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:48.167124 19896 raft_consensus.cc:740] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:48.167831 19896 consensus_queue.cc:260] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.171344 19896 ts_tablet_manager.cc:1434] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260928 01:55:48.176433 19896 tablet_bootstrap.cc:492] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:48.184325 20971 consensus_queue.cc:1048] T 675e1e1f2630411f8b070d8ca99e8ffb P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:48.194202 20939 raft_consensus.cc:515] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.182310 19896 tablet_bootstrap.cc:654] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:48.203758 19177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:48.224475 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e]
I20260928 01:55:48.242010 20939 leader_election.cc:290] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:48.243964 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3505a502bff747deaf1e03c03375aafa" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:48.244695 19475 raft_consensus.cc:3060] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:47.721664 20552 rpcz_store.cc:276] 0928 01:55:46.130991 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.131147 (+   156us) service_pool.cc:224] Handling call
0928 01:55:46.192403 (+ 61256us) raft_consensus.cc:1471] Updating replica for 88 ops
0928 01:55:46.492933 (+300530us) raft_consensus.cc:1534] Early marking committed up to index 252
0928 01:55:46.493151 (+   218us) raft_consensus.cc:1539] Triggering prepare for 88 ops
0928 01:55:46.493522 (+   371us) write_op.cc:270] Start()
0928 01:55:46.493661 (+   139us) write_op.cc:276] Timestamp: P: 1790560539190916 usec, L: 0
0928 01:55:46.494337 (+   676us) write_op.cc:270] Start()
0928 01:55:46.494423 (+    86us) write_op.cc:276] Timestamp: P: 1790560539358067 usec, L: 0
0928 01:55:46.494948 (+   525us) write_op.cc:270] Start()
0928 01:55:46.495038 (+    90us) write_op.cc:276] Timestamp: P: 1790560539412368 usec, L: 0
0928 01:55:46.495540 (+   502us) write_op.cc:270] Start()
0928 01:55:46.495636 (+    96us) write_op.cc:276] Timestamp: P: 1790560539475617 usec, L: 0
0928 01:55:46.496129 (+   493us) write_op.cc:270] Start()
0928 01:55:46.496256 (+   127us) write_op.cc:276] Timestamp: P: 1790560539540283 usec, L: 0
0928 01:55:46.496752 (+   496us) write_op.cc:270] Start()
0928 01:55:46.496834 (+    82us) write_op.cc:276] Timestamp: P: 1790560539602741 usec, L: 0
0928 01:55:46.497297 (+   463us) write_op.cc:270] Start()
0928 01:55:46.497483 (+   186us) write_op.cc:276] Timestamp: P: 1790560539675540 usec, L: 0
0928 01:55:46.497973 (+   490us) write_op.cc:270] Start()
0928 01:55:46.498054 (+    81us) write_op.cc:276] Timestamp: P: 1790560539770015 usec, L: 0
0928 01:55:46.498536 (+   482us) write_op.cc:270] Start()
0928 01:55:46.498628 (+    92us) write_op.cc:276] Timestamp: P: 1790560539797526 usec, L: 0
0928 01:55:46.499113 (+   485us) write_op.cc:270] Start()
0928 01:55:46.499201 (+    88us) write_op.cc:276] Timestamp: P: 1790560539810031 usec, L: 0
0928 01:55:46.499672 (+   471us) write_op.cc:270] Start()
0928 01:55:46.499746 (+    74us) write_op.cc:276] Timestamp: P: 1790560539837129 usec, L: 0
0928 01:55:46.568776 (+ 69030us) write_op.cc:270] Start()
0928 01:55:46.568963 (+   187us) write_op.cc:276] Timestamp: P: 1790560539847870 usec, L: 0
0928 01:55:46.581406 (+ 12443us) write_op.cc:270] Start()
0928 01:55:46.581547 (+   141us) write_op.cc:276] Timestamp: P: 1790560539862657 usec, L: 0
0928 01:55:46.582456 (+   909us) write_op.cc:270] Start()
0928 01:55:46.582592 (+   136us) write_op.cc:276] Timestamp: P: 1790560539978747 usec, L: 0
0928 01:55:46.600537 (+ 17945us) write_op.cc:270] Start()
0928 01:55:46.600807 (+   270us) write_op.cc:276] Timestamp: P: 1790560540037156 usec, L: 0
0928 01:55:46.601797 (+   990us) write_op.cc:270] Start()
0928 01:55:46.601947 (+   150us) write_op.cc:276] Timestamp: P: 1790560540080651 usec, L: 0
0928 01:55:46.622953 (+ 21006us) write_op.cc:270] Start()
0928 01:55:46.623099 (+   146us) write_op.cc:276] Timestamp: P: 1790560540087266 usec, L: 0
0928 01:55:46.624021 (+   922us) write_op.cc:270] Start()
0928 01:55:46.624162 (+   141us) write_op.cc:276] Timestamp: P: 1790560540141518 usec, L: 0
0928 01:55:46.625074 (+   912us) write_op.cc:270] Start()
0928 01:55:46.625200 (+   126us) write_op.cc:276] Timestamp: P: 1790560540186460 usec, L: 0
0928 01:55:46.626075 (+   875us) write_op.cc:270] Start()
0928 01:55:46.626211 (+   136us) write_op.cc:276] Timestamp: P: 1790560540216271 usec, L: 0
0928 01:55:46.627027 (+   816us) write_op.cc:270] Start()
0928 01:55:46.627156 (+   129us) write_op.cc:276] Timestamp: P: 1790560540239015 usec, L: 0
0928 01:55:46.627961 (+   805us) write_op.cc:270] Start()
0928 01:55:46.628097 (+   136us) write_op.cc:276] Timestamp: P: 1790560540309353 usec, L: 0
0928 01:55:46.676464 (+ 48367us) write_op.cc:270] Start()
0928 01:55:46.676642 (+   178us) write_op.cc:276] Timestamp: P: 1790560540358937 usec, L: 0
0928 01:55:46.677646 (+  1004us) write_op.cc:270] Start()
0928 01:55:46.677783 (+   137us) write_op.cc:276] Timestamp: P: 1790560540379687 usec, L: 0
0928 01:55:46.678759 (+   976us) write_op.cc:270] Start()
0928 01:55:46.678892 (+   133us) write_op.cc:276] Timestamp: P: 1790560540382848 usec, L: 0
0928 01:55:46.679799 (+   907us) write_op.cc:270] Start()
0928 01:55:46.679934 (+   135us) write_op.cc:276] Timestamp: P: 1790560540401378 usec, L: 0
0928 01:55:46.713287 (+ 33353us) write_op.cc:270] Start()
0928 01:55:46.713426 (+   139us) write_op.cc:276] Timestamp: P: 1790560540421921 usec, L: 0
0928 01:55:46.714307 (+   881us) write_op.cc:270] Start()
0928 01:55:46.714439 (+   132us) write_op.cc:276] Timestamp: P: 1790560540432654 usec, L: 0
0928 01:55:46.725521 (+ 11082us) write_op.cc:270] Start()
0928 01:55:46.725665 (+   144us) write_op.cc:276] Timestamp: P: 1790560540611661 usec, L: 0
0928 01:55:46.726516 (+   851us) write_op.cc:270] Start()
0928 01:55:46.726650 (+   134us) write_op.cc:276] Timestamp: P: 1790560540616801 usec, L: 0
0928 01:55:46.738713 (+ 12063us) write_op.cc:270] Start()
0928 01:55:46.738869 (+   156us) write_op.cc:276] Timestamp: P: 1790560540662722 usec, L: 0
0928 01:55:46.739790 (+   921us) write_op.cc:270] Start()
0928 01:55:46.739928 (+   138us) write_op.cc:276] Timestamp: P: 1790560540767994 usec, L: 0
0928 01:55:46.763700 (+ 23772us) write_op.cc:270] Start()
0928 01:55:46.763847 (+   147us) write_op.cc:276] Timestamp: P: 1790560540782729 usec, L: 0
0928 01:55:46.766651 (+  2804us) write_op.cc:270] Start()
0928 01:55:46.766748 (+    97us) write_op.cc:276] Timestamp: P: 1790560540791034 usec, L: 0
0928 01:55:46.767319 (+   571us) write_op.cc:270] Start()
0928 01:55:46.767453 (+   134us) write_op.cc:276] Timestamp: P: 1790560540870385 usec, L: 0
0928 01:55:46.798994 (+ 31541us) write_op.cc:270] Start()
0928 01:55:46.799161 (+   167us) write_op.cc:276] Timestamp: P: 1790560540911880 usec, L: 0
0928 01:55:46.800024 (+   863us) write_op.cc:270] Start()
0928 01:55:46.800170 (+   146us) write_op.cc:276] Timestamp: P: 1790560540916563 usec, L: 0
0928 01:55:46.801076 (+   906us) write_op.cc:270] Start()
0928 01:55:46.801202 (+   126us) write_op.cc:276] Timestamp: P: 1790560540919267 usec, L: 0
0928 01:55:46.864569 (+ 63367us) write_op.cc:270] Start()
0928 01:55:46.864704 (+   135us) write_op.cc:276] Timestamp: P: 1790560540977416 usec, L: 0
0928 01:55:46.865392 (+   688us) write_op.cc:270] Start()
0928 01:55:46.865483 (+    91us) write_op.cc:276] Timestamp: P: 1790560541030434 usec, L: 0
0928 01:55:46.865984 (+   501us) write_op.cc:270] Start()
0928 01:55:46.866067 (+    83us) write_op.cc:276] Timestamp: P: 1790560541057434 usec, L: 0
0928 01:55:46.867737 (+  1670us) write_op.cc:270] Start()
0928 01:55:46.867860 (+   123us) write_op.cc:276] Timestamp: P: 1790560541110328 usec, L: 0
0928 01:55:46.868414 (+   554us) write_op.cc:270] Start()
0928 01:55:46.868494 (+    80us) write_op.cc:276] Timestamp: P: 1790560541204100 usec, L: 0
0928 01:55:46.868990 (+   496us) write_op.cc:270] Start()
0928 01:55:46.869069 (+    79us) write_op.cc:276] Timestamp: P: 1790560541241921 usec, L: 0
0928 01:55:46.881289 (+ 12220us) write_op.cc:270] Start()
0928 01:55:46.881400 (+   111us) write_op.cc:276] Timestamp: P: 1790560541259024 usec, L: 0
0928 01:55:46.881979 (+   579us) write_op.cc:270] Start()
0928 01:55:46.882070 (+    91us) write_op.cc:276] Timestamp: P: 1790560541395406 usec, L: 0
0928 01:55:46.882776 (+   706us) write_op.cc:270] Start()
0928 01:55:46.882942 (+   166us) write_op.cc:276] Timestamp: P: 1790560541414214 usec, L: 0
0928 01:55:46.918629 (+ 35687us) write_op.cc:270] Start()
0928 01:55:46.918790 (+   161us) write_op.cc:276] Timestamp: P: 1790560541442711 usec, L: 0
0928 01:55:46.919721 (+   931us) write_op.cc:270] Start()
0928 01:55:46.919859 (+   138us) write_op.cc:276] Timestamp: P: 1790560541469181 usec, L: 0
0928 01:55:46.920767 (+   908us) write_op.cc:270] Start()
0928 01:55:46.920899 (+   132us) write_op.cc:276] Timestamp: P: 1790560541532080 usec, L: 0
0928 01:55:46.921745 (+   846us) write_op.cc:270] Start()
0928 01:55:46.921869 (+   124us) write_op.cc:276] Timestamp: P: 1790560541546240 usec, L: 0
0928 01:55:46.922827 (+   958us) write_op.cc:270] Start()
0928 01:55:46.922965 (+   138us) write_op.cc:276] Timestamp: P: 1790560541570491 usec, L: 0
0928 01:55:46.937029 (+ 14064us) write_op.cc:270] Start()
0928 01:55:46.937238 (+   209us) write_op.cc:276] Timestamp: P: 1790560541582373 usec, L: 0
0928 01:55:46.938232 (+   994us) write_op.cc:270] Start()
0928 01:55:46.938380 (+   148us) write_op.cc:276] Timestamp: P: 1790560541592833 usec, L: 0
0928 01:55:46.939248 (+   868us) write_op.cc:270] Start()
0928 01:55:46.939398 (+   150us) write_op.cc:276] Timestamp: P: 1790560541599055 usec, L: 0
0928 01:55:46.956289 (+ 16891us) write_op.cc:270] Start()
0928 01:55:46.956396 (+   107us) write_op.cc:276] Timestamp: P: 1790560541681446 usec, L: 0
0928 01:55:46.957245 (+   849us) write_op.cc:270] Start()
0928 01:55:46.957337 (+    92us) write_op.cc:276] Timestamp: P: 1790560541741676 usec, L: 0
0928 01:55:46.963206 (+  5869us) write_op.cc:270] Start()
0928 01:55:46.963331 (+   125us) write_op.cc:276] Timestamp: P: 1790560541877006 usec, L: 0
0928 01:55:46.963971 (+   640us) write_op.cc:270] Start()
0928 01:55:46.964075 (+   104us) write_op.cc:276] Timestamp: P: 1790560541878904 usec, L: 0
0928 01:55:46.966308 (+  2233us) write_op.cc:270] Start()
0928 01:55:46.966500 (+   192us) write_op.cc:276] Timestamp: P: 1790560542075086 usec, L: 0
0928 01:55:46.967100 (+   600us) write_op.cc:270] Start()
0928 01:55:46.973142 (+  6042us) write_op.cc:276] Timestamp: P: 1790560542077147 usec, L: 0
0928 01:55:46.976882 (+  3740us) write_op.cc:270] Start()
0928 01:55:46.976996 (+   114us) write_op.cc:276] Timestamp: P: 1790560542078967 usec, L: 0
0928 01:55:46.977654 (+   658us) write_op.cc:270] Start()
0928 01:55:46.977743 (+    89us) write_op.cc:276] Timestamp: P: 1790560542230206 usec, L: 0
0928 01:55:46.978348 (+   605us) write_op.cc:270] Start()
0928 01:55:46.978432 (+    84us) write_op.cc:276] Timestamp: P: 1790560542260960 usec, L: 0
0928 01:55:46.979012 (+   580us) write_op.cc:270] Start()
0928 01:55:46.979108 (+    96us) write_op.cc:276] Timestamp: P: 1790560542269882 usec, L: 0
0928 01:55:46.979611 (+   503us) write_op.cc:270] Start()
0928 01:55:46.979692 (+    81us) write_op.cc:276] Timestamp: P: 1790560542292383 usec, L: 0
0928 01:55:46.980180 (+   488us) write_op.cc:270] Start()
0928 01:55:47.135365 (+155185us) write_op.cc:276] Timestamp: P: 1790560542354344 usec, L: 0
0928 01:55:47.144104 (+  8739us) write_op.cc:270] Start()
0928 01:55:47.144237 (+   133us) write_op.cc:276] Timestamp: P: 1790560542401342 usec, L: 0
0928 01:55:47.144796 (+   559us) write_op.cc:270] Start()
0928 01:55:47.144881 (+    85us) write_op.cc:276] Timestamp: P: 1790560542597797 usec, L: 0
0928 01:55:47.145475 (+   594us) write_op.cc:270] Start()
0928 01:55:47.145577 (+   102us) write_op.cc:276] Timestamp: P: 1790560542654216 usec, L: 0
0928 01:55:47.146109 (+   532us) write_op.cc:270] Start()
0928 01:55:47.146187 (+    78us) write_op.cc:276] Timestamp: P: 1790560542673594 usec, L: 0
0928 01:55:47.146798 (+   611us) write_op.cc:270] Start()
0928 01:55:47.146878 (+    80us) write_op.cc:276] Timestamp: P: 1790560542688974 usec, L: 0
0928 01:55:47.147371 (+   493us) write_op.cc:270] Start()
0928 01:55:47.147460 (+    89us) write_op.cc:276] Timestamp: P: 1790560542695264 usec, L: 0
0928 01:55:47.148000 (+   540us) write_op.cc:270] Start()
0928 01:55:47.148078 (+    78us) write_op.cc:276] Timestamp: P: 1790560542786952 usec, L: 0
0928 01:55:47.181325 (+ 33247us) write_op.cc:270] Start()
0928 01:55:47.181433 (+   108us) write_op.cc:276] Timestamp: P: 1790560543010178 usec, L: 0
0928 01:55:47.181978 (+   545us) write_op.cc:270] Start()
0928 01:55:47.182061 (+    83us) write_op.cc:276] Timestamp: P: 1790560543181857 usec, L: 0
0928 01:55:47.186385 (+  4324us) write_op.cc:270] Start()
0928 01:55:47.186507 (+   122us) write_op.cc:276] Timestamp: P: 1790560543462938 usec, L: 0
0928 01:55:47.187075 (+   568us) write_op.cc:270] Start()
0928 01:55:47.187153 (+    78us) write_op.cc:276] Timestamp: P: 1790560543513618 usec, L: 0
0928 01:55:47.187619 (+   466us) write_op.cc:270] Start()
0928 01:55:47.187724 (+   105us) write_op.cc:276] Timestamp: P: 1790560543527404 usec, L: 0
0928 01:55:47.220397 (+ 32673us) write_op.cc:270] Start()
0928 01:55:47.220496 (+    99us) write_op.cc:276] Timestamp: P: 1790560543820821 usec, L: 0
0928 01:55:47.220991 (+   495us) write_op.cc:270] Start()
0928 01:55:47.221086 (+    95us) write_op.cc:276] Timestamp: P: 1790560544000850 usec, L: 0
0928 01:55:47.221531 (+   445us) write_op.cc:270] Start()
0928 01:55:47.221598 (+    67us) write_op.cc:276] Timestamp: P: 1790560544157784 usec, L: 0
0928 01:55:47.222037 (+   439us) write_op.cc:270] Start()
0928 01:55:47.222104 (+    67us) write_op.cc:276] Timestamp: P: 1790560544213913 usec, L: 0
0928 01:55:47.222540 (+   436us) write_op.cc:270] Start()
0928 01:55:47.222614 (+    74us) write_op.cc:276] Timestamp: P: 1790560544349559 usec, L: 0
0928 01:55:47.223078 (+   464us) write_op.cc:270] Start()
0928 01:55:47.223159 (+    81us) write_op.cc:276] Timestamp: P: 1790560544470230 usec, L: 0
0928 01:55:47.223617 (+   458us) write_op.cc:270] Start()
0928 01:55:47.223709 (+    92us) write_op.cc:276] Timestamp: P: 1790560544481475 usec, L: 0
0928 01:55:47.224159 (+   450us) write_op.cc:270] Start()
0928 01:55:47.224259 (+   100us) write_op.cc:276] Timestamp: P: 1790560544605918 usec, L: 0
0928 01:55:47.338617 (+114358us) log.cc:844] Serialized 54382 byte log entry
0928 01:55:47.354843 (+ 16226us) raft_consensus.cc:1645] Marking committed up to 340
0928 01:55:47.601883 (+247040us) log.cc:844] Serialized 15 byte log entry
0928 01:55:47.631989 (+ 30106us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:55:47.643761 (+ 11772us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:55:47.645099 (+  1338us) raft_consensus.cc:1685] finished
0928 01:55:47.662716 (+ 17617us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:55:47.667088 (+  4372us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000203d4. stack: 00007fb7cb3da323 00007fb7cb3da220 00007fb7caf7e574 0000000000516964 00000000005168f9 00007fb7d24d85c0 00007fb7d25776fa 00007fb7d441efcc 00007fb7d44275dc 00007fb7d4427588 00007fb7d4427508 00007fb7d44274c3 00007fb7d442676c 00007fb7d29d2876 00007fb7d29d2808 00007fb7d258dd5a
0928 01:55:47.721231 (+ 54143us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:55:47.355017 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.355124 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.355223 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.355321 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.355416 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.355532 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.355634 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.355720 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.355815 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.355911 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.356010 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.356104 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.356246 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.356353 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.356455 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.356746 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.356863 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.356962 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.357062 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.357159 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.357262 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.357354 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.468419 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.468592 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.468876 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.469068 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.469197 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.469294 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.469405 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.469508 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.469623 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.469928 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.470050 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.470147 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.470272 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.470374 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.470552 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.470723 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.471139 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.471311 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.471486 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.471655 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.482643 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.482889 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.483081 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.483259 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.483441 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.483614 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.529533 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.529746 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.529943 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.530124 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.530323 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.530505 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.530689 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.530852 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.531037 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.531224 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.531390 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.531572 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.531754 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.531919 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.532100 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.545246 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.545458 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.545643 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.545817 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.545971 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.546160 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.546332 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.546522 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.546687 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.546858 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.547028 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.547373 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.547548 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.547736 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.547891 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.548063 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.548248 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.548403 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.600618 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.600862 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.601029 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.601198 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.601366 (+     0us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0928 01:55:47.601528 (+     0us) op_driver.cc:464] REPLICATION: finished
Metrics: {"raft.queue_time_us":319058,"raft.run_cpu_time_us":13972,"raft.run_wall_time_us":1368679,"spinlock_wait_cycles":2802187264,"thread_start_us":324777,"threads_started":2,"child_traces":[["op",{"replication_time_us":861415}],["op",{"replication_time_us":860742}],["op",{"replication_time_us":860233}],["op",{"replication_time_us":859737}],["op",{"replication_time_us":859251}],["op",{"replication_time_us":858725}],["op",{"replication_time_us":858293}],["op",{"replication_time_us":857708}],["op",{"replication_time_us":857242}],["op",{"replication_time_us":856753}],["op",{"replication_time_us":856297}],["op",{"replication_time_us":855861}],["op",{"replication_time_us":774777}],["op",{"replication_time_us":773852}],["op",{"replication_time_us":755887}],["op",{"replication_time_us":754840}],["op",{"replication_time_us":733883}],["op",{"replication_time_us":732898}],["op",{"replication_time_us":731943}],["op",{"replication_time_us":731040}],["op",{"replication_time_us":730192}],["op",{"replication_time_us":729351}],["op",{"replication_time_us":769779}],["op",{"replication_time_us":790907}],["op",{"replication_time_us":790155}],["op",{"replication_time_us":789215}],["op",{"replication_time_us":755864}],["op",{"replication_time_us":754944}],["op",{"replication_time_us":743836}],["op",{"replication_time_us":742943}],["op",{"replication_time_us":730855}],["op",{"replication_time_us":730053}],["op",{"replication_time_us":706307}],["op",{"replication_time_us":703454}],["op",{"replication_time_us":702906}],["op",{"replication_time_us":671337}],["op",{"replication_time_us":670405}],["op",{"replication_time_us":669586}],["op",{"replication_time_us":606248}],["op",{"replication_time_us":605831}],["op",{"replication_time_us":605425}],["op",{"replication_time_us":603844}],["op",{"replication_time_us":603334}],["op",{"replication_time_us":613796}],["op",{"replication_time_us":601708}],["op",{"replication_time_us":601217}],["op",{"replication_time_us":600581}],["op",{"replication_time_us":564910}],["op",{"replication_time_us":609641}],["op",{"replication_time_us":608900}],["op",{"replication_time_us":608127}],["op",{"replication_time_us":607211}],["op",{"replication_time_us":593220}],["op",{"replication_time_us":592190}],["op",{"replication_time_us":591359}],["op",{"replication_time_us":574484}],["op",{"replication_time_us":573709}],["op",{"replication_time_us":567943}],["op",{"replication_time_us":567332}],["op",{"replication_time_us":565180}],["op",{"replication_time_us":564569}],["op",{"replication_time_us":554961}],["op",{"replication_time_us":554363}],["op",{"replication_time_us":553849}],["op",{"replication_time_us":566357}],["op",{"replication_time_us":565940}],["op",{"replication_time_us":565558}],["op",{"replication_time_us":401786}],["op",{"replication_time_us":401266}],["op",{"replication_time_us":400778}],["op",{"replication_time_us":400313}],["op",{"replication_time_us":399803}],["op",{"replication_time_us":399412}],["op",{"replication_time_us":398953}],["op",{"replication_time_us":365827}],["op",{"replication_time_us":365490}],["op",{"replication_time_us":361267}],["op",{"replication_time_us":360734}],["op",{"replication_time_us":360362}],["op",{"replication_time_us":327755}],["op",{"replication_time_us":327331}],["op",{"replication_time_us":378850}],["op",{"replication_time_us":378732}],["op",{"replication_time_us":378396}],["op",{"replication_time_us":378041}],["op",{"replication_time_us":377671}],["op",{"replication_time_us":377281}]]}
I20260928 01:55:48.251744 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765]
I20260928 01:55:48.255481 19475 raft_consensus.cc:2468] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:48.273872 19556 leader_election.cc:304] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:48.276010 20914 ts_tablet_manager.cc:1929] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:55:48.278548 20914 log.cc:1199] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/57a81b9455a340728fea713318e1e77a
I20260928 01:55:48.279390 20914 ts_tablet_manager.cc:1950] T 57a81b9455a340728fea713318e1e77a P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:55:48.298024 20939 raft_consensus.cc:2804] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:48.299706 20939 raft_consensus.cc:697] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:48.300817 20939 consensus_queue.cc:237] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.309657 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7]
I20260928 01:55:48.311280 20914 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39104 (request call id 267) took 1633 ms. Trace:
I20260928 01:55:48.311705 20914 rpcz_store.cc:276] 0928 01:55:46.677862 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.678016 (+   154us) service_pool.cc:224] Handling call
0928 01:55:47.596556 (+918540us) ts_tablet_manager.cc:1151] Deleting tablet 57a81b9455a340728fea713318e1e77a
0928 01:55:47.596612 (+    56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:55:48.121997 (+525385us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:48.275854 (+153857us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:48.311197 (+ 35343us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":917692}
I20260928 01:55:48.313597 19104 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 57a81b9455a340728fea713318e1e77a (table default.Table_a3ed770c6c6f410ba1b6c0db32c665bc [id=49662aab8c5046d2a1f6b7d363da8ada]) successfully deleted
I20260928 01:55:48.333909 19890 tablet_bootstrap.cc:492] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:48.334600 19896 tablet_bootstrap.cc:492] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:48.335239 19896 ts_tablet_manager.cc:1403] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.000s
I20260928 01:55:48.340021 19890 ts_tablet_manager.cc:1403] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.362s	user 0.010s	sys 0.028s
I20260928 01:55:48.339815 19896 raft_consensus.cc:359] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.340618 19896 raft_consensus.cc:385] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:48.340886 19896 raft_consensus.cc:740] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:48.341570 19896 consensus_queue.cc:260] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.343662 19896 ts_tablet_manager.cc:1434] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260928 01:55:48.356050 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:48.366959 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb]
I20260928 01:55:48.369530 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f]
I20260928 01:55:48.376900 19890 raft_consensus.cc:359] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:48.377734 19890 raft_consensus.cc:385] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:48.378073 19890 raft_consensus.cc:740] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:48.378868 19890 consensus_queue.cc:260] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:48.383394 20906 raft_consensus.cc:493] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:48.384130 20906 raft_consensus.cc:515] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.386595 20906 leader_election.cc:290] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:48.388899 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae3663fbe024a4e946e47339a4b9090" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:48.390796 19412 leader_election.cc:343] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:48.395428 19896 tablet_bootstrap.cc:492] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:48.401540 19890 ts_tablet_manager.cc:1434] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260928 01:55:48.413704 19890 tablet_bootstrap.cc:492] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:48.442399 19890 tablet_bootstrap.cc:654] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:48.443138 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b]
I20260928 01:55:48.448529 19896 tablet_bootstrap.cc:654] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:48.457527 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260928 01:55:48.474006 20447 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.711s (SENT)
I20260928 01:55:48.479226 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b]
I20260928 01:55:48.485708 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]
I20260928 01:55:48.452800 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3505a502bff747deaf1e03c03375aafa" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:48.490628 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae3663fbe024a4e946e47339a4b9090" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:48.491065 19553 leader_election.cc:304] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:48.492419 19553 leader_election.cc:343] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:48.494278 20939 raft_consensus.cc:2749] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:48.500377 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3505a502bff747deaf1e03c03375aafa" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:55:48.508719 19409 leader_election.cc:343] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:48.509198 19409 leader_election.cc:304] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:48.510627 20906 raft_consensus.cc:2749] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:48.523727 20447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 49771us
I20260928 01:55:48.527531 20984 raft_consensus.cc:493] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:48.513648 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]
I20260928 01:55:48.538534 19125 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Refusing update from remote peer 04e48edd841a42d08a480be209f0d294: Log matching property violated. Preceding OpId in replica: term: 3 index: 340. Preceding OpId from leader: term: 4 index: 341. (index mismatch)
I20260928 01:55:48.540258 20934 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 341, Last known committed idx: 340, Time since last communication: 0.000s
I20260928 01:55:48.544832 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]
I20260928 01:55:48.559772 20934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:48.560858 20934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: LEADER
I20260928 01:55:48.561054 20993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e48edd841a42d08a480be209f0d294. Latest consensus state: current_term: 4 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
W20260928 01:55:48.566637 19553 leader_election.cc:343] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:48.568991 20993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:48.571000 19896 tablet_bootstrap.cc:492] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:48.571435 19896 ts_tablet_manager.cc:1403] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.007s
I20260928 01:55:48.573997 19896 raft_consensus.cc:359] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:48.574681 19896 raft_consensus.cc:385] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:48.574939 19896 raft_consensus.cc:740] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:48.538095 20029 tablet_bootstrap.cc:492] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:48.577263 20029 ts_tablet_manager.cc:1403] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.791s	user 0.050s	sys 0.043s
I20260928 01:55:48.582392 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]
I20260928 01:55:48.599918 19896 consensus_queue.cc:260] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:48.602182 19896 ts_tablet_manager.cc:1434] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260928 01:55:48.536157 20984 raft_consensus.cc:515] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.610477 20984 leader_election.cc:290] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:48.613006 19703 consensus_peers.cc:597] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57a81b9455a340728fea713318e1e77a. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:48.616271 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d]
I20260928 01:55:48.643870 20029 raft_consensus.cc:359] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.644693 20029 raft_consensus.cc:385] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:48.644990 20029 raft_consensus.cc:740] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:48.645673 20029 consensus_queue.cc:260] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.659929 19896 tablet_bootstrap.cc:492] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:48.663021 20991 raft_consensus.cc:493] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:48.663628 20991 raft_consensus.cc:515] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.666991 20991 leader_election.cc:290] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:48.667052 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fc9eff28c4436fb383c3d7169171bb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:48.667548 20991 raft_consensus.cc:493] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:48.667965 20991 raft_consensus.cc:515] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:48.668650 19412 leader_election.cc:343] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:48.669071 20993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:48.669739 20993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:48.684288 19890 tablet_bootstrap.cc:492] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:48.684865 19890 ts_tablet_manager.cc:1403] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.271s	user 0.020s	sys 0.013s
I20260928 01:55:48.687868 20991 leader_election.cc:290] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:48.684674 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:48.687460 19620 raft_consensus.cc:3060] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:48.691843 19412 leader_election.cc:343] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:48.701412 21001 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:48.703346 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:48.703972 19764 raft_consensus.cc:2468] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:48.704855 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fc9eff28c4436fb383c3d7169171bb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:48.706064 19409 leader_election.cc:304] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:48.707087 20981 consensus_queue.cc:1048] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:48.710662 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376b5a87b07b4f87a2a502b5fa1b23f8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:48.711325 19469 raft_consensus.cc:2468] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:48.712762 20906 raft_consensus.cc:2804] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:48.713157 20906 raft_consensus.cc:493] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:48.713475 20906 raft_consensus.cc:3060] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:48.721127 19409 leader_election.cc:343] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:48.721560 19409 leader_election.cc:304] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:48.724352 20991 raft_consensus.cc:2749] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:48.732518 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151]
I20260928 01:55:48.734138 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87]
I20260928 01:55:48.735026 20029 ts_tablet_manager.cc:1434] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.157s	user 0.007s	sys 0.002s
I20260928 01:55:48.741070 19703 leader_election.cc:304] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:48.744663 20906 raft_consensus.cc:515] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.702723 21001 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:48.756695 21001 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:48.757740 20552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:48.764528 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:48.767144 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:48.770779 20029 tablet_bootstrap.cc:492] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:48.773180 20984 raft_consensus.cc:2804] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:48.773623 20984 raft_consensus.cc:493] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:48.774010 20984 raft_consensus.cc:3060] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:48.786330 19620 raft_consensus.cc:3060] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:48.786713 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e]
I20260928 01:55:48.788594 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1]
I20260928 01:55:48.790174 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542]
I20260928 01:55:48.796612 19619 raft_consensus.cc:3060] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:48.798105 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376b5a87b07b4f87a2a502b5fa1b23f8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:48.798380 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:48.798972 19766 raft_consensus.cc:3060] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:48.799315 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:48.796657 20999 log.cc:927] Time spent T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260928 01:55:48.800273 20906 leader_election.cc:290] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:48.802822 21001 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260928 01:55:48.809648 19704 consensus_peers.cc:597] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 01:55:48.811219 19704 leader_election.cc:343] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:48.815608 19896 tablet_bootstrap.cc:654] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:48.821650 19890 raft_consensus.cc:359] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.828359 19890 raft_consensus.cc:385] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:48.828738 19890 raft_consensus.cc:740] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:48.829377 19890 consensus_queue.cc:260] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.831832 19890 ts_tablet_manager.cc:1434] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.102s	user 0.004s	sys 0.001s
I20260928 01:55:48.836081 19890 tablet_bootstrap.cc:492] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:48.840070 19766 raft_consensus.cc:2468] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
W20260928 01:55:48.843428 19412 leader_election.cc:343] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:48.847182 19104 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0d5018f065824614a42f93afd49f770e consensus state has no leader
I20260928 01:55:48.866448 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93]
I20260928 01:55:48.872964 21009 tablet.cc:1751] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:48.890946 19409 leader_election.cc:304] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:48.892686 20906 raft_consensus.cc:2804] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:48.893479 20906 raft_consensus.cc:697] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:48.894464 20906 consensus_queue.cc:237] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.892868 21007 tablet.cc:1751] T 4ee6d48172044c74aacd4b78683efb66 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:48.914220 19890 tablet_bootstrap.cc:654] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:48.888811 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 54173.9us
I20260928 01:55:48.783998 20984 raft_consensus.cc:515] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.932078 20984 leader_election.cc:290] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:48.935017 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376b5a87b07b4f87a2a502b5fa1b23f8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:48.935626 19472 raft_consensus.cc:3060] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:48.943878 19472 raft_consensus.cc:2468] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:48.946892 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376b5a87b07b4f87a2a502b5fa1b23f8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:48.948879 19704 leader_election.cc:343] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:48.868016 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]
I20260928 01:55:48.955341 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f]
I20260928 01:55:48.957073 19703 leader_election.cc:304] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:48.957523 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]
I20260928 01:55:48.958096 20029 tablet_bootstrap.cc:654] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:48.958015 20909 raft_consensus.cc:2804] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:48.958801 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55]
I20260928 01:55:48.958721 20909 raft_consensus.cc:697] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:48.959941 20909 consensus_queue.cc:237] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.965206 19896 tablet_bootstrap.cc:492] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:48.965863 19896 ts_tablet_manager.cc:1403] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.308s	user 0.009s	sys 0.002s
I20260928 01:55:48.968653 19896 raft_consensus.cc:359] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:48.973086 19890 tablet_bootstrap.cc:492] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:48.973546 19890 ts_tablet_manager.cc:1403] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.138s	user 0.010s	sys 0.001s
I20260928 01:55:48.967598 21011 tablet.cc:1751] T 4ee6d48172044c74aacd4b78683efb66 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:55:48.975840 19890 raft_consensus.cc:359] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.984984 19890 raft_consensus.cc:385] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:48.985268 19890 raft_consensus.cc:740] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:48.987686 19890 consensus_queue.cc:260] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.989997 19890 ts_tablet_manager.cc:1434] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260928 01:55:48.990947 19890 tablet_bootstrap.cc:492] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:48.993067 20971 raft_consensus.cc:493] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:48.993609 20971 raft_consensus.cc:515] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:48.995776 20971 leader_election.cc:290] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:48.999683 19890 tablet_bootstrap.cc:654] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:49.002888 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fc9eff28c4436fb383c3d7169171bb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:49.005497 19553 leader_election.cc:343] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:49.025198 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]
W20260928 01:55:49.054421 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:49.078955 19890 tablet_bootstrap.cc:492] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:49.079401 19890 ts_tablet_manager.cc:1403] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.001s
I20260928 01:55:49.081962 19890 raft_consensus.cc:359] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.082639 19890 raft_consensus.cc:385] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:49.082892 19890 raft_consensus.cc:740] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:49.090162 19890 consensus_queue.cc:260] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.092809 19890 ts_tablet_manager.cc:1434] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260928 01:55:48.969532 19896 raft_consensus.cc:385] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:49.001699 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fc9eff28c4436fb383c3d7169171bb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:49.004771 20991 raft_consensus.cc:493] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:49.098311 20991 raft_consensus.cc:515] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:49.100510 20991 leader_election.cc:290] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:49.102309 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:49.102752 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:49.103853 19409 leader_election.cc:343] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:49.101387 19890 tablet_bootstrap.cc:492] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:49.105074 19412 leader_election.cc:343] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:49.105487 19412 leader_election.cc:304] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:49.106623 20991 raft_consensus.cc:2749] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:49.103804 19472 raft_consensus.cc:2468] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:49.108922 19556 leader_election.cc:304] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:49.109808 20971 raft_consensus.cc:2804] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:49.110046 19896 raft_consensus.cc:740] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:49.110144 20971 raft_consensus.cc:493] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:49.110426 20971 raft_consensus.cc:3060] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:49.110774 19896 consensus_queue.cc:260] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:49.113301 19896 ts_tablet_manager.cc:1434] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.147s	user 0.005s	sys 0.001s
I20260928 01:55:49.118175 20971 raft_consensus.cc:515] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.121546 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fc9eff28c4436fb383c3d7169171bb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:55:49.123780 19553 leader_election.cc:343] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:49.126049 20984 raft_consensus.cc:493] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:49.126621 20984 raft_consensus.cc:515] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.128417 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fc9eff28c4436fb383c3d7169171bb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:49.128762 20984 leader_election.cc:290] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:49.129156 19472 raft_consensus.cc:3060] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:49.129678 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3505a502bff747deaf1e03c03375aafa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:49.134543 20971 leader_election.cc:290] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:49.136464 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]
I20260928 01:55:49.138839 19890 tablet_bootstrap.cc:654] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:49.138968 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9]
I20260928 01:55:49.157192 20029 tablet_bootstrap.cc:492] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:49.157763 20029 ts_tablet_manager.cc:1403] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.387s	user 0.010s	sys 0.002s
I20260928 01:55:49.144121 19472 raft_consensus.cc:2468] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:49.161494 19556 leader_election.cc:304] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:49.163121 20971 raft_consensus.cc:2804] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:49.163935 20971 raft_consensus.cc:697] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:49.164933 20971 consensus_queue.cc:237] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.172061 19890 tablet_bootstrap.cc:492] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:49.172577 19890 ts_tablet_manager.cc:1403] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.079s	user 0.006s	sys 0.006s
I20260928 01:55:49.175201 19890 raft_consensus.cc:359] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.175871 19890 raft_consensus.cc:385] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:49.176122 19890 raft_consensus.cc:740] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:49.183492 19890 consensus_queue.cc:260] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.189983 19890 ts_tablet_manager.cc:1434] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260928 01:55:49.189744 20029 raft_consensus.cc:359] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.190651 20029 raft_consensus.cc:385] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:49.190951 19890 tablet_bootstrap.cc:492] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:49.190984 20029 raft_consensus.cc:740] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:49.191906 20029 consensus_queue.cc:260] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.194258 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3505a502bff747deaf1e03c03375aafa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:49.195072 19469 raft_consensus.cc:2393] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:49.196669 19896 tablet_bootstrap.cc:492] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:49.212447 19890 tablet_bootstrap.cc:654] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:49.229319 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975]
I20260928 01:55:49.233943 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f]
I20260928 01:55:49.235603 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6]
I20260928 01:55:49.219137 19703 leader_election.cc:304] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:49.237907 19890 tablet_bootstrap.cc:492] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:49.238088 20984 raft_consensus.cc:3060] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:49.238344 19890 ts_tablet_manager.cc:1403] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.004s
I20260928 01:55:49.240800 19890 raft_consensus.cc:359] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.241446 19890 raft_consensus.cc:385] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:49.241943 19890 raft_consensus.cc:740] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:49.246052 20984 raft_consensus.cc:2749] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:49.248639 20447 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c17b7f9972364c76893311539b569e0f (127.18.161.61:43775): Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.711s (SENT)
I20260928 01:55:49.248562 19890 consensus_queue.cc:260] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.252911 20971 raft_consensus.cc:493] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:49.253592 20971 raft_consensus.cc:515] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.257833 20971 leader_election.cc:290] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:49.258074 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ab79c6ad03e481a903a0f95ae0512e6" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:49.259923 19556 leader_election.cc:343] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:49.264945 19890 ts_tablet_manager.cc:1434] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260928 01:55:49.266073 19890 tablet_bootstrap.cc:492] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:49.274489 19890 tablet_bootstrap.cc:654] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:49.276278 19896 tablet_bootstrap.cc:654] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:49.256978 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ab79c6ad03e481a903a0f95ae0512e6" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:49.260696 20909 raft_consensus.cc:493] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:49.341136 20909 raft_consensus.cc:515] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.270794 20029 ts_tablet_manager.cc:1434] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.113s	user 0.009s	sys 0.000s
I20260928 01:55:49.343314 20029 tablet_bootstrap.cc:492] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:49.343391 20909 leader_election.cc:290] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:49.345089 19553 leader_election.cc:343] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:49.345517 19553 leader_election.cc:304] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:49.346268 20971 raft_consensus.cc:2749] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:49.347692 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae3663fbe024a4e946e47339a4b9090" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:49.348382 19469 raft_consensus.cc:2468] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:49.349947 19703 leader_election.cc:304] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:49.350714 20909 raft_consensus.cc:2804] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:49.351061 20909 raft_consensus.cc:493] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:49.351383 20909 raft_consensus.cc:3060] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:49.353544 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae3663fbe024a4e946e47339a4b9090" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:49.354110 19620 raft_consensus.cc:2468] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:49.363976 20966 consensus_queue.cc:1048] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:55:49.384171 20447 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c17b7f9972364c76893311539b569e0f (127.18.161.61:43775): Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.723s (SENT)
I20260928 01:55:49.394137 21023 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:49.395812 21023 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:49.402174 21023 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:49.402838 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:49.407056 20552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:49.409363 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
W20260928 01:55:49.410885 20976 op_tracker.cc:284] OpTracker waiting for 105 outstanding ops to complete now for 1.170s
I20260928 01:55:49.411288 20976 op_tracker.cc:286] Dumping up to 50 currently running ops: 
I20260928 01:55:49.411535 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b580003b100 [op_id=(term: 2 index: 337), ts=7334135990150062080, rows=[]]]
I20260928 01:55:49.412220 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b5800010e00 [op_id=(term: 2 index: 332), ts=7334135987490082816, rows=[]]]
I20260928 01:55:49.412642 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b580003de00 [op_id=(term: 2 index: 334), ts=7334135988870283264, rows=[]]]
I20260928 01:55:49.413029 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000ed900 [op_id=(term: 2 index: 329), ts=7334135986024194048, rows=[]]]
I20260928 01:55:49.413399 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000ed000 [op_id=(term: 2 index: 326), ts=7334135983255355392, rows=[]]]
I20260928 01:55:49.413776 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000eca00 [op_id=(term: 2 index: 324), ts=7334135982854037504, rows=[]]]
I20260928 01:55:49.414151 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000ebe00 [op_id=(term: 2 index: 320), ts=7334135981675896832, rows=[]]]
I20260928 01:55:49.414521 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000ebb00 [op_id=(term: 2 index: 319), ts=7334135981483393024, rows=[]]]
I20260928 01:55:49.414902 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000eb800 [op_id=(term: 2 index: 318), ts=7334135981229600768, rows=[]]]
I20260928 01:55:49.415285 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000eb500 [op_id=(term: 2 index: 317), ts=7334135981137436672, rows=[]]]
I20260928 01:55:49.415661 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000eb200 [op_id=(term: 2 index: 316), ts=7334135981100892160, rows=[]]]
I20260928 01:55:49.416754 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000ea900 [op_id=(term: 2 index: 313), ts=7334135980347994112, rows=[]]]
I20260928 01:55:49.417409 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000ea600 [op_id=(term: 2 index: 312), ts=7334135980339552256, rows=[]]]
I20260928 01:55:49.417896 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000edf00 [op_id=(term: 2 index: 331), ts=7334135986288246784, rows=[]]]
I20260928 01:55:49.418058 21023 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:55:49.418416 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000ea300 [op_id=(term: 2 index: 311), ts=7334135979535990784, rows=[]]]
I20260928 01:55:49.418919 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e9d00 [op_id=(term: 2 index: 309), ts=7334135978973904896, rows=[]]]
I20260928 01:55:49.419380 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e9a00 [op_id=(term: 2 index: 308), ts=7334135978727202816, rows=[]]]
I20260928 01:55:49.419874 19890 tablet_bootstrap.cc:492] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:49.419859 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e9700 [op_id=(term: 2 index: 307), ts=7334135978389729280, rows=[]]]
I20260928 01:55:49.421012 19890 ts_tablet_manager.cc:1403] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.155s	user 0.024s	sys 0.015s
I20260928 01:55:49.421352 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e9400 [op_id=(term: 2 index: 306), ts=7334135978364243968, rows=[]]]
I20260928 01:55:49.421487 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37]
I20260928 01:55:49.421878 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e9100 [op_id=(term: 2 index: 305), ts=7334135978321399808, rows=[]]]
I20260928 01:55:49.422358 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e8e00 [op_id=(term: 2 index: 304), ts=7334135978272731136, rows=[]]]
I20260928 01:55:49.423491 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e8b00 [op_id=(term: 2 index: 303), ts=7334135978173399040, rows=[]]]
I20260928 01:55:49.423993 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e8800 [op_id=(term: 2 index: 302), ts=7334135978115399680, rows=[]]]
I20260928 01:55:49.424458 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b580003cc00 [op_id=(term: 2 index: 335), ts=7334135989100187648, rows=[]]]
I20260928 01:55:49.425793 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e8200 [op_id=(term: 2 index: 300), ts=7334135977749344256, rows=[]]]
I20260928 01:55:49.426299 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000edc00 [op_id=(term: 2 index: 330), ts=7334135986231779328, rows=[]]]
I20260928 01:55:49.426769 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e7900 [op_id=(term: 2 index: 297), ts=7334135976996962304, rows=[]]]
I20260928 01:55:49.427225 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e7600 [op_id=(term: 2 index: 296), ts=7334135976926908416, rows=[]]]
I20260928 01:55:49.428148 20029 tablet_bootstrap.cc:654] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:49.428659 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e7000 [op_id=(term: 2 index: 294), ts=7334135976387903488, rows=[]]]
I20260928 01:55:49.429528 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e6a00 [op_id=(term: 2 index: 292), ts=7334135976060657664, rows=[]]]
I20260928 01:55:49.431226 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e6700 [op_id=(term: 2 index: 291), ts=7334135975843495936, rows=[]]]
I20260928 01:55:49.431770 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000ed300 [op_id=(term: 2 index: 327), ts=7334135984169689088, rows=[]]]
I20260928 01:55:49.432276 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e6400 [op_id=(term: 2 index: 290), ts=7334135975605317632, rows=[]]]
I20260928 01:55:49.434804 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e6100 [op_id=(term: 2 index: 289), ts=7334135975594242048, rows=[]]]
I20260928 01:55:49.435364 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e5e00 [op_id=(term: 2 index: 288), ts=7334135975575060480, rows=[]]]
I20260928 01:55:49.436455 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e5b00 [op_id=(term: 2 index: 287), ts=7334135975405096960, rows=[]]]
I20260928 01:55:49.436945 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e5500 [op_id=(term: 2 index: 284), ts=7334135974985703424, rows=[]]]
I20260928 01:55:49.438328 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e5200 [op_id=(term: 2 index: 283), ts=7334135974554509312, rows=[]]]
I20260928 01:55:49.439589 21024 raft_consensus.cc:493] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:49.440096 21024 raft_consensus.cc:515] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.442312 21024 leader_election.cc:290] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:49.443006 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749]
I20260928 01:55:49.445389 21024 consensus_queue.cc:1048] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:49.445922 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4]
I20260928 01:55:49.449127 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417]
I20260928 01:55:49.451464 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]
I20260928 01:55:49.455019 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:49.423906 19890 raft_consensus.cc:359] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.458226 19896 tablet_bootstrap.cc:492] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:49.458482 19890 raft_consensus.cc:385] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:49.458680 19896 ts_tablet_manager.cc:1403] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.262s	user 0.009s	sys 0.001s
I20260928 01:55:49.458806 19890 raft_consensus.cc:740] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:49.459463 19890 consensus_queue.cc:260] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.466542 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:49.473349 19553 leader_election.cc:343] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:49.476444 19556 leader_election.cc:343] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:49.459566 20909 raft_consensus.cc:515] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.491585 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae3663fbe024a4e946e47339a4b9090" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:49.493489 19620 raft_consensus.cc:3060] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:49.497187 19890 ts_tablet_manager.cc:1434] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260928 01:55:49.511478 19556 leader_election.cc:304] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:49.512267 20029 tablet_bootstrap.cc:492] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:49.512753 20029 ts_tablet_manager.cc:1403] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.170s	user 0.009s	sys 0.002s
I20260928 01:55:49.514752 20966 raft_consensus.cc:2749] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:49.517210 19620 raft_consensus.cc:2468] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:49.523794 19704 leader_election.cc:304] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:49.531625 20984 raft_consensus.cc:2804] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:49.532274 20984 raft_consensus.cc:697] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:49.533557 20984 consensus_queue.cc:237] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:49.538856 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:49.541226 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae3663fbe024a4e946e47339a4b9090" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:49.541931 19469 raft_consensus.cc:3060] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:49.547672 19896 raft_consensus.cc:359] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.548537 19896 raft_consensus.cc:385] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:49.548810 19896 raft_consensus.cc:740] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:49.549552 19896 consensus_queue.cc:260] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.552244 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7]
I20260928 01:55:49.553802 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]
I20260928 01:55:49.555260 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]
I20260928 01:55:49.536029 20909 leader_election.cc:290] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:49.552023 19896 ts_tablet_manager.cc:1434] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.092s	user 0.001s	sys 0.002s
I20260928 01:55:49.592507 19890 tablet_bootstrap.cc:492] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:49.525426 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e4f00 [op_id=(term: 2 index: 282), ts=7334135974366416896, rows=[]]]
I20260928 01:55:49.604300 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e4c00 [op_id=(term: 2 index: 281), ts=7334135974345363456, rows=[]]]
I20260928 01:55:49.606531 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e4900 [op_id=(term: 2 index: 280), ts=7334135973612150784, rows=[]]]
I20260928 01:55:49.608307 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e4600 [op_id=(term: 2 index: 279), ts=7334135973568188416, rows=[]]]
I20260928 01:55:49.531654 20029 raft_consensus.cc:359] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.616873 20029 raft_consensus.cc:385] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:49.617192 20029 raft_consensus.cc:740] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:49.617422 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e3d00 [op_id=(term: 2 index: 276), ts=7334135973395197952, rows=[]]]
I20260928 01:55:49.621819 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e3a00 [op_id=(term: 2 index: 275), ts=7334135973310205952, rows=[]]]
I20260928 01:55:49.628904 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e3700 [op_id=(term: 2 index: 274), ts=7334135973107109888, rows=[]]]
I20260928 01:55:49.629657 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b580003c900 [op_id=(term: 2 index: 336), ts=7334135989655793664, rows=[]]]
I20260928 01:55:49.631109 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e3400 [op_id=(term: 2 index: 273), ts=7334135972819005440, rows=[]]]
I20260928 01:55:49.632678 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e3100 [op_id=(term: 2 index: 272), ts=7334135972725846016, rows=[]]]
I20260928 01:55:49.656527 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5]
I20260928 01:55:49.658356 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d]
I20260928 01:55:49.659770 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619]
I20260928 01:55:49.668874 20029 consensus_queue.cc:260] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.671145 20029 ts_tablet_manager.cc:1434] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.158s	user 0.005s	sys 0.000s
I20260928 01:55:49.672428 20029 tablet_bootstrap.cc:492] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:49.677886 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e2e00 [op_id=(term: 2 index: 271), ts=7334135972603740160, rows=[]]]
I20260928 01:55:49.679909 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e2500 [op_id=(term: 2 index: 269), ts=7334135972197441536, rows=[]]]
I20260928 01:55:49.682682 19469 raft_consensus.cc:2468] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
W20260928 01:55:49.675568 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 82798.1us
I20260928 01:55:49.694234 20906 raft_consensus.cc:493] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:49.695227 20029 tablet_bootstrap.cc:654] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:49.694787 20906 raft_consensus.cc:515] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.699019 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:49.699868 19620 raft_consensus.cc:2468] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:49.700928 20906 leader_election.cc:290] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:49.702353 19412 leader_election.cc:304] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:55:49.705818 19412 consensus_peers.cc:597] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:49.706732 20906 raft_consensus.cc:2804] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:49.707244 20906 raft_consensus.cc:493] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:49.707679 20906 raft_consensus.cc:3060] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:49.726313 19890 tablet_bootstrap.cc:654] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:49.729342 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:49.730026 19896 tablet_bootstrap.cc:492] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:49.745393 19409 leader_election.cc:343] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:49.759035 21024 raft_consensus.cc:493] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:49.759725 21024 raft_consensus.cc:515] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.771919 20991 raft_consensus.cc:493] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:49.772629 20991 raft_consensus.cc:515] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:49.779531 20991 leader_election.cc:290] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:49.780377 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5e07078b2a4fe59d9293d9511cbb6b" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:49.784468 19412 leader_election.cc:343] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:49.786439 21024 leader_election.cc:290] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:49.787818 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:49.789572 19556 leader_election.cc:343] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:49.799507 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:49.799090 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5e07078b2a4fe59d9293d9511cbb6b" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:49.801693 19553 leader_election.cc:343] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:49.802078 19553 leader_election.cc:304] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:49.803501 19409 leader_election.cc:343] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:49.803908 19409 leader_election.cc:304] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:49.805656 21024 raft_consensus.cc:2749] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:49.806668 20991 raft_consensus.cc:2749] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:49.819264 19896 tablet_bootstrap.cc:654] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:49.832520 19703 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 43661.3us
I20260928 01:55:49.847110 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]
I20260928 01:55:49.859136 19896 tablet_bootstrap.cc:492] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:49.859615 19896 ts_tablet_manager.cc:1403] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.130s	user 0.007s	sys 0.010s
I20260928 01:55:49.870668 19896 raft_consensus.cc:359] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.871376 19896 raft_consensus.cc:385] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:49.871650 19896 raft_consensus.cc:740] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
W20260928 01:55:49.882493 19704 consensus_peers.cc:597] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:49.882398 20991 consensus_queue.cc:1048] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:49.884554 19896 consensus_queue.cc:260] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.886669 20029 tablet_bootstrap.cc:492] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:49.886755 19896 ts_tablet_manager.cc:1434] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260928 01:55:49.887174 20029 ts_tablet_manager.cc:1403] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.215s	user 0.014s	sys 0.019s
I20260928 01:55:49.890347 20029 raft_consensus.cc:359] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.891062 20029 raft_consensus.cc:385] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:49.891373 19896 tablet_bootstrap.cc:492] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:49.891327 20029 raft_consensus.cc:740] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:49.891981 20029 consensus_queue.cc:260] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.893997 20029 ts_tablet_manager.cc:1434] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260928 01:55:49.894956 20029 tablet_bootstrap.cc:492] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:49.898270 20906 raft_consensus.cc:515] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.894892 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]
I20260928 01:55:49.904340 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d]
I20260928 01:55:49.921533 20029 tablet_bootstrap.cc:654] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:49.921685 19890 tablet_bootstrap.cc:492] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:49.922178 19890 ts_tablet_manager.cc:1403] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.330s	user 0.018s	sys 0.012s
I20260928 01:55:49.924885 19890 raft_consensus.cc:359] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.925575 19890 raft_consensus.cc:385] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:49.925833 19890 raft_consensus.cc:740] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:49.926496 19890 consensus_queue.cc:260] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:49.960294 19703 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 52390.3us
I20260928 01:55:49.907609 19896 tablet_bootstrap.cc:654] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:49.969398 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:49.969983 19620 raft_consensus.cc:3060] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:49.972342 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:49.978900 19620 raft_consensus.cc:2468] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:49.980350 19412 leader_election.cc:304] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:49.982522 19896 tablet_bootstrap.cc:492] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:49.983624 19896 ts_tablet_manager.cc:1403] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.010s
I20260928 01:55:49.988171 20991 raft_consensus.cc:2804] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:49.989338 19890 ts_tablet_manager.cc:1434] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.067s	user 0.013s	sys 0.001s
I20260928 01:55:49.992353 19896 raft_consensus.cc:359] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.995275 19896 raft_consensus.cc:385] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:49.996167 19896 raft_consensus.cc:740] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:49.998183 19890 tablet_bootstrap.cc:492] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:49.998512 19896 consensus_queue.cc:260] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:49.983075 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:50.012866 19767 raft_consensus.cc:3060] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:50.060909 20906 leader_election.cc:290] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:50.069289 21024 raft_consensus.cc:493] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:50.069792 21024 raft_consensus.cc:515] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.072057 21024 leader_election.cc:290] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:50.088742 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:50.103071 19896 ts_tablet_manager.cc:1434] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.119s	user 0.021s	sys 0.032s
W20260928 01:55:50.104635 19553 leader_election.cc:343] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:50.112779 19890 tablet_bootstrap.cc:654] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:50.121204 19104 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f709eccf4ab5413bbbd8b4746f185db4 (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f709eccf4ab5413bbbd8b4746f185db4 consensus state has no leader
I20260928 01:55:50.123818 19767 raft_consensus.cc:2468] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:50.131335 19896 tablet_bootstrap.cc:492] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:50.168918 20991 raft_consensus.cc:697] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:50.179406 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b]
I20260928 01:55:50.181807 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]
W20260928 01:55:50.183233 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 123780us
I20260928 01:55:50.190657 21044 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:50.191294 21044 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:50.170431 20991 consensus_queue.cc:237] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.238834 20029 tablet_bootstrap.cc:492] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:50.239288 20029 ts_tablet_manager.cc:1403] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.345s	user 0.024s	sys 0.010s
I20260928 01:55:50.251732 19896 tablet_bootstrap.cc:654] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:50.265676 21043 raft_consensus.cc:493] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:50.266300 21043 raft_consensus.cc:515] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.266793 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:50.267768 19469 raft_consensus.cc:2468] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:50.272163 21043 leader_election.cc:290] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:50.274387 21043 raft_consensus.cc:493] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:50.276422 21043 raft_consensus.cc:515] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.315568 21043 leader_election.cc:290] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:50.321930 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:50.323911 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:50.328552 19556 leader_election.cc:304] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:50.330772 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:50.331494 21053 raft_consensus.cc:2804] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:50.333992 19620 raft_consensus.cc:2468] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:50.334615 21053 raft_consensus.cc:493] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:50.337622 21053 raft_consensus.cc:3060] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:50.341554 21044 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:50.341897 21054 consensus_queue.cc:1048] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:50.342962 20552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:50.354105 20029 raft_consensus.cc:359] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.354853 20029 raft_consensus.cc:385] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:50.355139 20029 raft_consensus.cc:740] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:50.355857 21029 raft_consensus.cc:493] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:50.352910 19896 tablet_bootstrap.cc:492] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:50.356467 21029 raft_consensus.cc:515] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.355742 20029 consensus_queue.cc:260] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.358390 20029 ts_tablet_manager.cc:1434] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.119s	user 0.003s	sys 0.003s
I20260928 01:55:50.359836 21029 leader_election.cc:290] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:50.360523 19896 ts_tablet_manager.cc:1403] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.234s	user 0.022s	sys 0.009s
I20260928 01:55:50.361724 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416ccc1323fe41b2a7783dc95bba8d84" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:50.362478 19620 raft_consensus.cc:2468] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:50.363790 19704 leader_election.cc:304] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:50.364723 21029 raft_consensus.cc:2804] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:50.365118 21029 raft_consensus.cc:493] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:50.365499 21029 raft_consensus.cc:3060] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:50.373129 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 132232us
I20260928 01:55:50.317665 21052 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:50.376533 21052 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:50.381574 20552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:50.381199 21052 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
W20260928 01:55:50.368340 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:50.386883 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:50.394272 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:50.395853 21052 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:55:50.407724 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]
I20260928 01:55:50.405645 19896 raft_consensus.cc:359] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.411825 19896 raft_consensus.cc:385] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:50.414377 19896 raft_consensus.cc:740] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:50.420868 19896 consensus_queue.cc:260] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:50.428382 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 95788.4us
I20260928 01:55:50.432650 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:50.433328 19620 raft_consensus.cc:2468] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:50.443609 19896 ts_tablet_manager.cc:1434] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.008s
W20260928 01:55:50.449458 19409 leader_election.cc:343] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:50.450959 19409 leader_election.cc:343] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:50.452186 19896 tablet_bootstrap.cc:492] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:50.453789 19553 consensus_peers.cc:597] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:50.491295 20029 tablet_bootstrap.cc:492] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:50.463021 19890 tablet_bootstrap.cc:492] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:50.495508 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2]
I20260928 01:55:50.498129 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87]
I20260928 01:55:50.501022 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02]
W20260928 01:55:50.501505 19703 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 87003.7us
I20260928 01:55:50.510499 19896 tablet_bootstrap.cc:654] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:50.511900 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416ccc1323fe41b2a7783dc95bba8d84" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:50.512686 19474 raft_consensus.cc:2468] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:50.510041 19890 ts_tablet_manager.cc:1403] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.513s	user 0.032s	sys 0.057s
I20260928 01:55:50.536691 19412 leader_election.cc:304] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:50.555377 19412 leader_election.cc:304] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:50.558120 20984 consensus_queue.cc:1048] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:50.560870 20029 tablet_bootstrap.cc:654] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:50.461102 21029 raft_consensus.cc:515] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.588951 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416ccc1323fe41b2a7783dc95bba8d84" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:50.589735 19620 raft_consensus.cc:3060] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:50.609473 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 54170.8us
I20260928 01:55:50.619908 20029 tablet_bootstrap.cc:492] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:50.620373 20029 ts_tablet_manager.cc:1403] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.009s
I20260928 01:55:50.627074 20712 mvcc.cc:204] Tried to move back new op lower bound from 7334135968118550528 to 7334135886813192192. Current Snapshot: MvccSnapshot[applied={T|T < 7334135967785455616}]
I20260928 01:55:50.633448 20029 raft_consensus.cc:359] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:50.638882 20029 raft_consensus.cc:385] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:50.639200 20029 raft_consensus.cc:740] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:50.639973 20029 consensus_queue.cc:260] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:50.556056 20906 raft_consensus.cc:2804] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:50.648707 20906 raft_consensus.cc:493] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:50.649425 20906 raft_consensus.cc:3060] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:50.612056 20991 raft_consensus.cc:2804] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:50.630501 21043 raft_consensus.cc:493] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:50.655959 20991 raft_consensus.cc:493] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:50.656714 19896 tablet_bootstrap.cc:492] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:50.656232 21043 raft_consensus.cc:515] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:50.657272 19896 ts_tablet_manager.cc:1403] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.207s	user 0.021s	sys 0.019s
I20260928 01:55:50.659394 21043 leader_election.cc:290] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:50.659782 21042 raft_consensus.cc:493] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:50.660480 21042 raft_consensus.cc:515] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.660957 19896 raft_consensus.cc:359] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.661645 19896 raft_consensus.cc:385] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:50.661901 19896 raft_consensus.cc:740] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:50.662627 19896 consensus_queue.cc:260] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.666262 20029 ts_tablet_manager.cc:1434] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.003s
I20260928 01:55:50.666778 19896 ts_tablet_manager.cc:1434] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260928 01:55:50.672433 21042 leader_election.cc:290] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:50.615097 19890 raft_consensus.cc:359] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.674549 19890 raft_consensus.cc:385] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:50.675627 19890 raft_consensus.cc:740] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:50.676342 19890 consensus_queue.cc:260] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.682601 20029 tablet_bootstrap.cc:492] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:50.682516 20909 consensus_queue.cc:1048] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:50.656670 20991 raft_consensus.cc:3060] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:50.697602 19896 tablet_bootstrap.cc:492] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:50.701259 21029 leader_election.cc:290] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:50.702286 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416ccc1323fe41b2a7783dc95bba8d84" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:50.702889 19474 raft_consensus.cc:3060] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:50.710011 19474 raft_consensus.cc:2468] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:50.725783 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:50.727375 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ab79c6ad03e481a903a0f95ae0512e6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:50.727706 19890 ts_tablet_manager.cc:1434] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.200s	user 0.013s	sys 0.003s
I20260928 01:55:50.735088 20029 tablet_bootstrap.cc:654] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:50.737509 19703 leader_election.cc:304] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:50.740381 21029 raft_consensus.cc:2804] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:50.741379 21029 raft_consensus.cc:697] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:50.742661 21029 consensus_queue.cc:237] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.749074 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14]
I20260928 01:55:50.755383 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:50.757014 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ab79c6ad03e481a903a0f95ae0512e6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:50.758602 19615 raft_consensus.cc:2468] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:50.749874 19890 tablet_bootstrap.cc:492] T 376b5a87b07b4f87a2a502b5fa1b23f8 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:50.784649 19409 leader_election.cc:343] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:50.785629 19409 leader_election.cc:343] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:50.647269 19620 raft_consensus.cc:2468] T 416ccc1323fe41b2a7783dc95bba8d84 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:50.755880 21053 raft_consensus.cc:515] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.826673 19620 raft_consensus.cc:3060] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:50.869079 19412 leader_election.cc:343] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:50.859500 21053 leader_election.cc:290] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:50.874122 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]
I20260928 01:55:50.763803 20029 tablet_bootstrap.cc:492] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:50.768057 21036 consensus_queue.cc:1048] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260928 01:55:50.875869 20029 ts_tablet_manager.cc:1403] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.193s	user 0.007s	sys 0.007s
W20260928 01:55:50.817993 19820 tablet.cc:2433] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 01:55:50.879504 20029 raft_consensus.cc:359] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.880174 20029 raft_consensus.cc:385] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:50.881227 20029 raft_consensus.cc:740] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:50.882157 20029 consensus_queue.cc:260] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.841634 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:50.883214 19766 raft_consensus.cc:3060] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:50.846110 20989 raft_consensus.cc:493] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:50.885044 19890 tablet_bootstrap.cc:654] T 376b5a87b07b4f87a2a502b5fa1b23f8 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:50.886436 20989 raft_consensus.cc:515] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:50.892127 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:50.892802 19475 raft_consensus.cc:2468] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:50.895612 19703 leader_election.cc:304] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:50.895946 20029 ts_tablet_manager.cc:1434] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260928 01:55:50.896656 21036 raft_consensus.cc:2804] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:50.897195 21036 raft_consensus.cc:493] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:50.897511 21036 raft_consensus.cc:3060] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:50.921672 19766 raft_consensus.cc:2468] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:50.940644 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:50.948498 19896 tablet_bootstrap.cc:654] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:50.954460 19553 leader_election.cc:304] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:50.869663 19412 leader_election.cc:304] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:55:50.955302 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:50.931469 20989 leader_election.cc:290] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:50.942307 19704 leader_election.cc:343] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:50.956485 21053 raft_consensus.cc:2804] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:50.956995 21053 raft_consensus.cc:697] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:50.957424 21042 raft_consensus.cc:2749] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:50.957818 21053 consensus_queue.cc:237] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:50.960063 21036 raft_consensus.cc:515] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:50.962651 21036 leader_election.cc:290] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:55:50.963125 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 77350us
I20260928 01:55:50.964982 19890 tablet_bootstrap.cc:492] T 376b5a87b07b4f87a2a502b5fa1b23f8 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:50.966660 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:50.971925 19890 ts_tablet_manager.cc:1403] T 376b5a87b07b4f87a2a502b5fa1b23f8 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.226s	user 0.024s	sys 0.016s
W20260928 01:55:50.958451 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 89416.1us
I20260928 01:55:50.989914 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]
I20260928 01:55:51.000679 19412 leader_election.cc:304] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:50.998728 20906 raft_consensus.cc:515] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.014995 21042 raft_consensus.cc:2804] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:51.015365 21042 raft_consensus.cc:493] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:51.015148 20991 raft_consensus.cc:515] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.015689 21042 raft_consensus.cc:3060] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:51.009025 19890 raft_consensus.cc:359] T 376b5a87b07b4f87a2a502b5fa1b23f8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.017799 19890 raft_consensus.cc:385] T 376b5a87b07b4f87a2a502b5fa1b23f8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:55:50.969905 19704 leader_election.cc:343] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:51.022292 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 52437.2us
I20260928 01:55:50.993544 20029 tablet_bootstrap.cc:492] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:51.011793 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:51.018276 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:51.022377 19890 raft_consensus.cc:740] T 376b5a87b07b4f87a2a502b5fa1b23f8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:51.024170 19767 raft_consensus.cc:3060] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:51.028544 21042 raft_consensus.cc:515] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.033160 19766 raft_consensus.cc:2393] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:51.027725 19890 consensus_queue.cc:260] T 376b5a87b07b4f87a2a502b5fa1b23f8 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.038981 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:51.039693 19475 raft_consensus.cc:2393] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:51.045534 19767 raft_consensus.cc:2468] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:51.049690 21042 leader_election.cc:290] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:51.058485 20906 leader_election.cc:290] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:51.029311 20991 leader_election.cc:290] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:51.081532 19896 tablet_bootstrap.cc:492] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:51.087941 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:51.088192 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:51.088935 19620 raft_consensus.cc:3060] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:51.087323 19896 ts_tablet_manager.cc:1403] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.418s	user 0.016s	sys 0.018s
I20260928 01:55:51.089884 21042 raft_consensus.cc:493] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:51.082460 19890 ts_tablet_manager.cc:1434] T 376b5a87b07b4f87a2a502b5fa1b23f8 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.105s	user 0.013s	sys 0.004s
I20260928 01:55:51.090690 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ab79c6ad03e481a903a0f95ae0512e6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:51.090518 21042 raft_consensus.cc:515] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:51.091408 19615 raft_consensus.cc:3060] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:51.105561 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b]
I20260928 01:55:51.107076 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]
I20260928 01:55:51.113322 21042 leader_election.cc:290] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:51.114632 19409 leader_election.cc:304] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:51.121714 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ab79c6ad03e481a903a0f95ae0512e6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:55:51.124408 19409 leader_election.cc:343] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:51.124292 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:51.136286 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:51.142230 19412 leader_election.cc:304] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:51.143121 21043 raft_consensus.cc:2804] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 01:55:51.146160 19409 leader_election.cc:343] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:51.149928 21071 log.cc:927] Time spent T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260928 01:55:51.159301 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:51.159917 19469 raft_consensus.cc:3060] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:51.162263 19620 raft_consensus.cc:2468] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:51.164755 21042 raft_consensus.cc:2749] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:51.165522 21042 consensus_queue.cc:1048] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:51.179790 20029 tablet_bootstrap.cc:654] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:51.175010 19469 raft_consensus.cc:2468] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:51.179656 21043 raft_consensus.cc:697] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
W20260928 01:55:51.192099 19532 tablet.cc:2433] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 01:55:51.187536 21043 consensus_queue.cc:237] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.184072 21082 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:51.206610 21082 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
W20260928 01:55:51.208142 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 64712us
I20260928 01:55:51.205802 19890 tablet_bootstrap.cc:492] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:51.171406 19615 raft_consensus.cc:2468] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
W20260928 01:55:51.195719 19669 tablet.cc:2433] T 376b5a87b07b4f87a2a502b5fa1b23f8 P a3ee288ca1464d20a715673422a214a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 01:55:51.218333 19103 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2156dae74ee748cd845b6dea1d3b8ea8 consensus state has no leader
W20260928 01:55:51.220911 19412 leader_election.cc:343] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:51.221529 19412 leader_election.cc:304] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:51.222532 21085 raft_consensus.cc:2749] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:51.189102 19896 raft_consensus.cc:359] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.230649 21082 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:51.204182 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb]
I20260928 01:55:51.225829 19896 raft_consensus.cc:385] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:51.231334 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:51.233088 20860 catalog_manager.cc:692] Loaded metadata for table default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320]
I20260928 01:55:51.234736 20552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:51.237149 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:51.238441 21082 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:55:51.233397 19896 raft_consensus.cc:740] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:51.261176 19703 leader_election.cc:304] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:51.265163 19618 raft_consensus.cc:3060] T 376b5a87b07b4f87a2a502b5fa1b23f8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:51.224083 19412 leader_election.cc:304] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:51.293268 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 69263.8us
I20260928 01:55:51.294659 21085 raft_consensus.cc:2804] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:51.295177 21085 raft_consensus.cc:697] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:51.296624 21085 consensus_queue.cc:237] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.302817 21083 raft_consensus.cc:2804] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:51.303424 21083 raft_consensus.cc:697] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:51.279294 20029 tablet_bootstrap.cc:492] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:51.305836 20029 ts_tablet_manager.cc:1403] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.313s	user 0.006s	sys 0.005s
I20260928 01:55:51.304813 21083 consensus_queue.cc:237] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:51.314214 20029 raft_consensus.cc:359] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.315068 20029 raft_consensus.cc:385] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:51.316298 20029 raft_consensus.cc:740] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:51.277383 19896 consensus_queue.cc:260] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.323766 19890 tablet_bootstrap.cc:654] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:51.362756 19896 ts_tablet_manager.cc:1434] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.272s	user 0.020s	sys 0.003s
I20260928 01:55:51.385458 21043 consensus_queue.cc:1048] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260928 01:55:51.393108 20029 consensus_queue.cc:260] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.418550 21075 raft_consensus.cc:493] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:51.419202 21075 raft_consensus.cc:515] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.421957 21075 leader_election.cc:290] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:51.424281 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ab79c6ad03e481a903a0f95ae0512e6" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:51.424988 19620 raft_consensus.cc:2393] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:51.433759 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ab79c6ad03e481a903a0f95ae0512e6" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:51.437834 21043 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:51.438889 21043 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.443396 21043 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:51.445870 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:51.457370 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:51.458935 19409 leader_election.cc:343] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:51.479620 19890 tablet_bootstrap.cc:492] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:51.480149 19890 ts_tablet_manager.cc:1403] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.275s	user 0.026s	sys 0.013s
I20260928 01:55:51.492447 19890 raft_consensus.cc:359] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.493197 19890 raft_consensus.cc:385] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:51.493484 19890 raft_consensus.cc:740] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:51.505702 19890 consensus_queue.cc:260] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.509269 19890 ts_tablet_manager.cc:1434] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.000s
I20260928 01:55:51.512480 19703 leader_election.cc:304] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:51.515072 21076 raft_consensus.cc:3060] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:51.534880 19896 tablet_bootstrap.cc:492] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:51.537132 19412 leader_election.cc:343] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:51.537851 19412 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:51.539006 21043 raft_consensus.cc:2749] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:51.540319 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 77297.5us
I20260928 01:55:51.543171 19896 tablet_bootstrap.cc:654] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:51.547417 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:51.552553 19890 tablet_bootstrap.cc:492] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:51.557471 20029 ts_tablet_manager.cc:1434] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.251s	user 0.005s	sys 0.001s
I20260928 01:55:51.558660 20029 tablet_bootstrap.cc:492] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:51.563868 19890 tablet_bootstrap.cc:654] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:51.574872 19896 tablet_bootstrap.cc:492] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:51.575383 19896 ts_tablet_manager.cc:1403] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.041s	user 0.004s	sys 0.008s
W20260928 01:55:51.580605 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 68211.7us
W20260928 01:55:51.585296 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 48360.4us
I20260928 01:55:51.589414 19896 raft_consensus.cc:359] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.590159 19896 raft_consensus.cc:385] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:51.590435 19896 raft_consensus.cc:740] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:51.591143 19896 consensus_queue.cc:260] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.599334 19896 ts_tablet_manager.cc:1434] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.006s
I20260928 01:55:51.606048 19896 tablet_bootstrap.cc:492] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:51.612762 21076 raft_consensus.cc:2749] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:51.617348 19890 tablet_bootstrap.cc:492] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:51.617801 19890 ts_tablet_manager.cc:1403] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.000s
I20260928 01:55:51.620357 19890 raft_consensus.cc:359] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:51.621068 19890 raft_consensus.cc:385] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:51.621326 19890 raft_consensus.cc:740] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:51.621944 19890 consensus_queue.cc:260] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:51.623430 19890 ts_tablet_manager.cc:1434] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260928 01:55:51.630261 19896 tablet_bootstrap.cc:654] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:51.636281 19890 tablet_bootstrap.cc:492] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:51.639955 21043 raft_consensus.cc:493] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:51.640718 21043 raft_consensus.cc:515] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.644043 21043 leader_election.cc:290] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:51.661337 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:51.667642 19890 tablet_bootstrap.cc:654] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:51.663911 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:51.681910 19896 tablet_bootstrap.cc:492] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:51.682405 19896 ts_tablet_manager.cc:1403] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.077s	user 0.006s	sys 0.008s
W20260928 01:55:51.683262 19409 leader_election.cc:343] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:51.685050 19412 leader_election.cc:343] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:51.689622 19102 leader_election.cc:336] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c17b7f9972364c76893311539b569e0f (127.18.161.61:43775): Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.686s (SENT)
I20260928 01:55:51.690042 19102 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:55:51.691406 19890 tablet_bootstrap.cc:492] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:51.691846 19890 ts_tablet_manager.cc:1403] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.000s
I20260928 01:55:51.686200 19896 raft_consensus.cc:359] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.693711 19896 raft_consensus.cc:385] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:51.694041 19896 raft_consensus.cc:740] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:51.694772 19896 consensus_queue.cc:260] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.690304 19412 leader_election.cc:304] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:51.708689 21105 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:55:51.714975 19890 raft_consensus.cc:359] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:51.715646 19890 raft_consensus.cc:385] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:51.715898 19890 raft_consensus.cc:740] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:51.721149 21043 raft_consensus.cc:2749] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:51.725165 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 53993.3us
I20260928 01:55:51.711988 19896 ts_tablet_manager.cc:1434] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260928 01:55:51.733664 19896 tablet_bootstrap.cc:492] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:51.719926 19890 consensus_queue.cc:260] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:51.746224 19890 ts_tablet_manager.cc:1434] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260928 01:55:51.747295 19890 tablet_bootstrap.cc:492] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:51.748035 21056 consensus_queue.cc:1048] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:51.757264 20029 tablet_bootstrap.cc:654] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:51.763509 19896 tablet_bootstrap.cc:654] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:51.794349 19890 tablet_bootstrap.cc:654] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:51.810699 19896 tablet_bootstrap.cc:492] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:51.811144 19896 ts_tablet_manager.cc:1403] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.004s
I20260928 01:55:51.818828 19896 raft_consensus.cc:359] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.819535 19896 raft_consensus.cc:385] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:51.819790 19896 raft_consensus.cc:740] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:51.820641 19896 consensus_queue.cc:260] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.827562 19896 ts_tablet_manager.cc:1434] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.007s
I20260928 01:55:51.828629 19896 tablet_bootstrap.cc:492] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:51.831598 21056 consensus_queue.cc:1048] T c8fd6b965d22477aaee9bafccb2069b1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:51.838465 19890 tablet_bootstrap.cc:492] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:51.838896 19890 ts_tablet_manager.cc:1403] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.000s
I20260928 01:55:51.842618 19890 raft_consensus.cc:359] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:51.843307 19890 raft_consensus.cc:385] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:51.843585 19890 raft_consensus.cc:740] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:51.859498 19890 consensus_queue.cc:260] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:51.862299 19890 ts_tablet_manager.cc:1434] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260928 01:55:51.865197 19896 tablet_bootstrap.cc:654] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:51.875101 20029 tablet_bootstrap.cc:492] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
W20260928 01:55:51.895941 20976 op_tracker.cc:284] OpTracker waiting for 60 outstanding ops to complete now for 3.655s
I20260928 01:55:51.896736 20976 op_tracker.cc:286] Dumping up to 50 currently running ops: 
I20260928 01:55:51.897156 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b580003b100 [op_id=(term: 2 index: 337), ts=7334135990150062080, rows=[]]]
I20260928 01:55:51.898074 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b5800010e00 [op_id=(term: 2 index: 332), ts=7334135987490082816, rows=[]]]
I20260928 01:55:51.898857 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b580003de00 [op_id=(term: 2 index: 334), ts=7334135988870283264, rows=[]]]
I20260928 01:55:51.899843 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000ed900 [op_id=(term: 2 index: 329), ts=7334135986024194048, rows=[]]]
I20260928 01:55:51.900700 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000ed000 [op_id=(term: 2 index: 326), ts=7334135983255355392, rows=[]]]
I20260928 01:55:51.901482 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000eca00 [op_id=(term: 2 index: 324), ts=7334135982854037504, rows=[]]]
I20260928 01:55:51.902096 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000ebe00 [op_id=(term: 2 index: 320), ts=7334135981675896832, rows=[]]]
W20260928 01:55:51.902595 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 61035.7us
I20260928 01:55:51.902726 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000ebb00 [op_id=(term: 2 index: 319), ts=7334135981483393024, rows=[]]]
I20260928 01:55:51.905129 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000eb800 [op_id=(term: 2 index: 318), ts=7334135981229600768, rows=[]]]
I20260928 01:55:51.905966 21056 raft_consensus.cc:493] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:51.906661 21056 raft_consensus.cc:515] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:51.921360 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5e07078b2a4fe59d9293d9511cbb6b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:51.923429 19553 leader_election.cc:343] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:51.924304 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000eb500 [op_id=(term: 2 index: 317), ts=7334135981137436672, rows=[]]]
I20260928 01:55:51.925060 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000eb200 [op_id=(term: 2 index: 316), ts=7334135981100892160, rows=[]]]
I20260928 01:55:51.925730 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000ea900 [op_id=(term: 2 index: 313), ts=7334135980347994112, rows=[]]]
W20260928 01:55:51.928709 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:51.929296 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5e07078b2a4fe59d9293d9511cbb6b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:51.931136 19469 raft_consensus.cc:2468] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:51.932722 19556 leader_election.cc:304] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:51.933785 21098 raft_consensus.cc:2804] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:51.934266 21098 raft_consensus.cc:493] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:51.934728 21098 raft_consensus.cc:3060] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:51.941722 21076 consensus_queue.cc:1048] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:51.876012 20029 ts_tablet_manager.cc:1403] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.318s	user 0.014s	sys 0.002s
I20260928 01:55:51.955078 19896 tablet_bootstrap.cc:492] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:51.955554 19896 ts_tablet_manager.cc:1403] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.127s	user 0.010s	sys 0.013s
I20260928 01:55:51.955294 21098 raft_consensus.cc:515] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:51.957746 21043 raft_consensus.cc:493] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:51.958369 21043 raft_consensus.cc:515] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.959159 19896 raft_consensus.cc:359] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.959777 19896 raft_consensus.cc:385] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:51.960189 19896 raft_consensus.cc:740] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:51.960880 19896 consensus_queue.cc:260] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.961717 21043 leader_election.cc:290] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:51.962970 19896 ts_tablet_manager.cc:1434] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260928 01:55:51.962857 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:51.964665 19409 leader_election.cc:343] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:51.960367 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000ea600 [op_id=(term: 2 index: 312), ts=7334135980339552256, rows=[]]]
I20260928 01:55:51.978983 20029 raft_consensus.cc:359] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:51.967700 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000edf00 [op_id=(term: 2 index: 331), ts=7334135986288246784, rows=[]]]
I20260928 01:55:51.984925 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000ea300 [op_id=(term: 2 index: 311), ts=7334135979535990784, rows=[]]]
I20260928 01:55:51.985687 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e9d00 [op_id=(term: 2 index: 309), ts=7334135978973904896, rows=[]]]
I20260928 01:55:52.020330 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e9a00 [op_id=(term: 2 index: 308), ts=7334135978727202816, rows=[]]]
I20260928 01:55:52.021031 19896 tablet_bootstrap.cc:492] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:52.021410 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e9700 [op_id=(term: 2 index: 307), ts=7334135978389729280, rows=[]]]
I20260928 01:55:52.022208 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e9400 [op_id=(term: 2 index: 306), ts=7334135978364243968, rows=[]]]
I20260928 01:55:52.030186 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e9100 [op_id=(term: 2 index: 305), ts=7334135978321399808, rows=[]]]
I20260928 01:55:51.956955 21056 leader_election.cc:290] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:51.968132 19890 tablet_bootstrap.cc:492] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:51.973186 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:51.975598 19615 raft_consensus.cc:3060] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:52.041028 19412 leader_election.cc:343] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:52.041462 19412 leader_election.cc:304] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:52.042485 21085 raft_consensus.cc:2749] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:52.053571 19896 tablet_bootstrap.cc:654] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:52.061623 19890 tablet_bootstrap.cc:654] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:52.056839 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5e07078b2a4fe59d9293d9511cbb6b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:55:52.079762 19553 leader_election.cc:343] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:52.080593 20029 raft_consensus.cc:385] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:52.085321 21085 consensus_queue.cc:1048] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:52.096722 20029 raft_consensus.cc:740] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:52.098521 20029 consensus_queue.cc:260] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.100548 20029 ts_tablet_manager.cc:1434] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.152s	user 0.006s	sys 0.001s
I20260928 01:55:52.101301 21098 leader_election.cc:290] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:52.106318 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e8e00 [op_id=(term: 2 index: 304), ts=7334135978272731136, rows=[]]]
I20260928 01:55:52.108229 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e8b00 [op_id=(term: 2 index: 303), ts=7334135978173399040, rows=[]]]
I20260928 01:55:52.110980 20029 tablet_bootstrap.cc:492] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:52.135147 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e8800 [op_id=(term: 2 index: 302), ts=7334135978115399680, rows=[]]]
I20260928 01:55:52.128669 21078 consensus_queue.cc:1048] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:52.151417 20860 tablet_loader.cc:96] loaded metadata for tablet 01cc307b127446958bd4199a1aa60adb (table default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375])
I20260928 01:55:52.154906 21078 raft_consensus.cc:493] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:52.155663 21078 raft_consensus.cc:515] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.161549 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fc9eff28c4436fb383c3d7169171bb" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:52.165918 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5e07078b2a4fe59d9293d9511cbb6b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:52.168889 19470 raft_consensus.cc:3060] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:52.173997 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fc9eff28c4436fb383c3d7169171bb" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:52.175720 19703 leader_election.cc:304] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:52.176855 21079 raft_consensus.cc:2749] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:52.180719 21078 leader_election.cc:290] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:52.200532 21121 consensus_queue.cc:1048] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:52.202520 19890 tablet_bootstrap.cc:492] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:52.202975 19890 ts_tablet_manager.cc:1403] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.235s	user 0.007s	sys 0.010s
I20260928 01:55:52.205263 21085 raft_consensus.cc:493] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:52.217993 20860 tablet_loader.cc:96] loaded metadata for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6])
I20260928 01:55:52.205848 21085 raft_consensus.cc:515] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.231197 21085 leader_election.cc:290] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:52.235934 19766 raft_consensus.cc:3060] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:52.241694 19470 raft_consensus.cc:2468] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
W20260928 01:55:52.245927 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 45395.4us
I20260928 01:55:52.249785 19890 raft_consensus.cc:359] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:52.250465 19890 raft_consensus.cc:385] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:52.250746 19890 raft_consensus.cc:740] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:52.251420 19890 consensus_queue.cc:260] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:52.256830 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b222e5366a64f52bc97acd551c7a067" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:52.258989 19412 leader_election.cc:343] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:52.265435 19896 tablet_bootstrap.cc:492] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:52.266017 19896 ts_tablet_manager.cc:1403] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.245s	user 0.003s	sys 0.012s
I20260928 01:55:52.267187 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b222e5366a64f52bc97acd551c7a067" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:52.267513 19556 leader_election.cc:304] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:52.269158 19409 leader_election.cc:343] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:52.269809 19409 leader_election.cc:304] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:52.270855 21085 raft_consensus.cc:2749] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:52.270812 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b580003cc00 [op_id=(term: 2 index: 335), ts=7334135989100187648, rows=[]]]
I20260928 01:55:52.271637 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e8200 [op_id=(term: 2 index: 300), ts=7334135977749344256, rows=[]]]
I20260928 01:55:52.272356 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000edc00 [op_id=(term: 2 index: 330), ts=7334135986231779328, rows=[]]]
I20260928 01:55:52.273002 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e7900 [op_id=(term: 2 index: 297), ts=7334135976996962304, rows=[]]]
I20260928 01:55:52.273763 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e7600 [op_id=(term: 2 index: 296), ts=7334135976926908416, rows=[]]]
I20260928 01:55:52.274405 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e7000 [op_id=(term: 2 index: 294), ts=7334135976387903488, rows=[]]]
I20260928 01:55:52.220042 20860 tablet_loader.cc:96] loaded metadata for tablet 043ddb5b0b0e4ad0b30d2927d37971fb (table default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9])
I20260928 01:55:52.289203 20860 tablet_loader.cc:96] loaded metadata for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6])
I20260928 01:55:52.291405 20860 tablet_loader.cc:96] loaded metadata for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7])
I20260928 01:55:52.305342 21125 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:52.309736 21125 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:52.310348 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e6a00 [op_id=(term: 2 index: 292), ts=7334135976060657664, rows=[]]]
I20260928 01:55:52.311106 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e6700 [op_id=(term: 2 index: 291), ts=7334135975843495936, rows=[]]]
I20260928 01:55:52.311839 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000ed300 [op_id=(term: 2 index: 327), ts=7334135984169689088, rows=[]]]
I20260928 01:55:52.312542 20976 op_tracker.cc:290] RD-P WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e6400 [op_id=(term: 2 index: 290), ts=7334135975605317632, rows=[]]]
I20260928 01:55:52.313701 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:52.313210 20976 op_tracker.cc:290] RD-P WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e6100 [op_id=(term: 2 index: 289), ts=7334135975594242048, rows=[]]]
I20260928 01:55:52.316036 20976 op_tracker.cc:290] RD-P WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e5e00 [op_id=(term: 2 index: 288), ts=7334135975575060480, rows=[]]]
I20260928 01:55:52.319952 21125 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:52.319429 20552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:52.324358 20976 op_tracker.cc:290] RD-P WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e5b00 [op_id=(term: 2 index: 287), ts=7334135975405096960, rows=[]]]
I20260928 01:55:52.325372 20976 op_tracker.cc:290] RD-P WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e5500 [op_id=(term: 2 index: 284), ts=7334135974985703424, rows=[]]]
I20260928 01:55:52.326120 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:52.326681 20976 op_tracker.cc:290] RD-P WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e5200 [op_id=(term: 2 index: 283), ts=7334135974554509312, rows=[]]]
I20260928 01:55:52.327354 21125 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:55:52.328027 20976 op_tracker.cc:290] RD-P WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e4f00 [op_id=(term: 2 index: 282), ts=7334135974366416896, rows=[]]]
I20260928 01:55:52.330824 19890 ts_tablet_manager.cc:1434] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.128s	user 0.008s	sys 0.000s
I20260928 01:55:52.331128 21098 raft_consensus.cc:493] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:52.331220 20976 op_tracker.cc:290] RD-P WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e4c00 [op_id=(term: 2 index: 281), ts=7334135974345363456, rows=[]]]
I20260928 01:55:52.331902 19890 tablet_bootstrap.cc:492] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:52.331790 21098 raft_consensus.cc:515] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:52.332021 20976 op_tracker.cc:290] RD-P WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e4900 [op_id=(term: 2 index: 280), ts=7334135973612150784, rows=[]]]
W20260928 01:55:52.335005 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 67593.2us
I20260928 01:55:52.334780 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b580003c900 [op_id=(term: 2 index: 336), ts=7334135989655793664, rows=[]]]
I20260928 01:55:52.335011 19896 raft_consensus.cc:359] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.335759 19896 raft_consensus.cc:385] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:52.336035 19896 raft_consensus.cc:740] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:52.336989 21056 raft_consensus.cc:2804] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:52.337572 21056 raft_consensus.cc:697] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:52.337921 19896 consensus_queue.cc:260] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.338894 21056 consensus_queue.cc:237] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:52.339984 19896 ts_tablet_manager.cc:1434] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.001s
I20260928 01:55:52.345791 21123 consensus_queue.cc:1048] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:52.352662 21098 leader_election.cc:290] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:52.361770 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:52.362613 19470 raft_consensus.cc:2468] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:52.366215 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:52.370565 19556 leader_election.cc:304] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:52.372682 21113 raft_consensus.cc:2804] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:52.373199 21113 raft_consensus.cc:493] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:52.373651 21113 raft_consensus.cc:3060] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:52.335515 20976 op_tracker.cc:290] RD-P WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e2800 [op_id=(term: 2 index: 286), ts=7334135975080075264, rows=[]]]
I20260928 01:55:52.389864 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000ee200 [op_id=(term: 2 index: 338), ts=7334135990196121600, rows=[]]]
I20260928 01:55:52.394866 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e7c00 [op_id=(term: 2 index: 298), ts=7334135977555582976, rows=[]]]
I20260928 01:55:52.395603 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000ec400 [op_id=(term: 2 index: 322), ts=7334135982711668736, rows=[]]]
W20260928 01:55:52.396516 19553 leader_election.cc:343] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:52.397269 21053 raft_consensus.cc:493] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:52.397384 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b58000ee500 [op_id=(term: 2 index: 339), ts=7334135990705840128, rows=[]]]
I20260928 01:55:52.397763 21053 raft_consensus.cc:515] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.399967 21053 leader_election.cc:290] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:52.400506 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:47, state=WriteOpState 0x7b5800012900 [op_id=(term: 2 index: 333), ts=7334135988227481600, rows=[]]]
I20260928 01:55:52.400640 21083 consensus_queue.cc:1048] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:52.388111 20029 tablet_bootstrap.cc:654] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:52.413925 20860 tablet_loader.cc:96] loaded metadata for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0])
I20260928 01:55:52.415719 20860 tablet_loader.cc:96] loaded metadata for tablet 0e1ddfab489f4ace921d551c216039bd (table default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f])
W20260928 01:55:52.418279 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260928 01:55:52.422039 19553 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
I20260928 01:55:52.425240 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e7f00 [op_id=(term: 2 index: 299), ts=7334135977632620544, rows=[]]]
I20260928 01:55:52.433787 20976 op_tracker.cc:290] RD-NP WriteOp [type=FOLLOWER, start_time=2026-09-28 01:55:46, state=WriteOpState 0x7b58000e8500 [op_id=(term: 2 index: 301), ts=7334135977857765376, rows=[]]]
W20260928 01:55:52.446792 19556 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
I20260928 01:55:52.447315 19556 leader_election.cc:304] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:52.449988 19896 tablet_bootstrap.cc:492] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:52.454339 21056 raft_consensus.cc:2749] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:52.461220 21123 consensus_queue.cc:1048] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:52.472422 21123 raft_consensus.cc:493] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:52.473063 21123 raft_consensus.cc:515] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.476763 21123 leader_election.cc:290] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:52.476905 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602706a3fbc438d8d448c9ac057087c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:52.477839 20860 tablet_loader.cc:96] loaded metadata for tablet 10fa56df34ad44d88f1dd700c823d57c (table default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7])
I20260928 01:55:52.479236 20860 tablet_loader.cc:96] loaded metadata for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117])
W20260928 01:55:52.481402 19409 leader_election.cc:343] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:52.485093 19615 raft_consensus.cc:3060] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:52.519279 21133 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:52.519908 21133 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:52.522176 21133 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:52.545497 21078 consensus_queue.cc:1048] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260928 01:55:52.551223 19890 tablet_bootstrap.cc:654] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:52.556372 20860 tablet_loader.cc:96] loaded metadata for tablet 12b836e20d6b43cba8eaa08887afb076 (table default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4])
I20260928 01:55:52.558743 20860 tablet_loader.cc:96] loaded metadata for tablet 13c395a6a87f4927b10973720aa4d868 (table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92])
I20260928 01:55:52.564618 19896 tablet_bootstrap.cc:654] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:52.588497 20860 tablet_loader.cc:96] loaded metadata for tablet 1555e557370a4e92915a9c55107b573b (table default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6])
I20260928 01:55:52.590692 20860 tablet_loader.cc:96] loaded metadata for tablet 15f48cf74a1b4600b5140bf9cc8446e3 (table default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2])
I20260928 01:55:52.598325 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602706a3fbc438d8d448c9ac057087c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:52.605837 19412 leader_election.cc:343] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:52.606513 19412 leader_election.cc:304] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:52.607635 21123 raft_consensus.cc:2749] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:52.592013 20860 tablet_loader.cc:96] loaded metadata for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b])
W20260928 01:55:52.614915 21132 log.cc:927] Time spent T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260928 01:55:52.615254 20860 tablet_loader.cc:96] loaded metadata for tablet 202f1ead822548a2bbeae4e4d3cf9be8 (table default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975])
I20260928 01:55:52.617298 19890 tablet_bootstrap.cc:492] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:52.617753 19890 ts_tablet_manager.cc:1403] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.286s	user 0.009s	sys 0.006s
I20260928 01:55:52.618639 20029 tablet_bootstrap.cc:492] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:52.619059 20029 ts_tablet_manager.cc:1403] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.508s	user 0.006s	sys 0.013s
I20260928 01:55:52.620277 19890 raft_consensus.cc:359] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.620949 19890 raft_consensus.cc:385] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:52.621196 19890 raft_consensus.cc:740] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:52.621829 19890 consensus_queue.cc:260] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:52.622495 21127 log.cc:927] Time spent T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260928 01:55:52.625996 19896 tablet_bootstrap.cc:492] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:52.626469 19896 ts_tablet_manager.cc:1403] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.177s	user 0.005s	sys 0.009s
I20260928 01:55:52.628922 19896 raft_consensus.cc:359] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.629545 19896 raft_consensus.cc:385] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:52.629806 19896 raft_consensus.cc:740] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:52.630431 19896 consensus_queue.cc:260] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.633438 20860 tablet_loader.cc:96] loaded metadata for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d])
I20260928 01:55:52.634564 20860 tablet_loader.cc:96] loaded metadata for tablet 21906a8380e64d95b9454a57fc01c6f0 (table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a])
I20260928 01:55:52.635704 20860 tablet_loader.cc:96] loaded metadata for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d])
I20260928 01:55:52.637522 20860 tablet_loader.cc:96] loaded metadata for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5])
I20260928 01:55:52.639309 20860 tablet_loader.cc:96] loaded metadata for tablet 27a232fc915a46c1a833ec5f6721eece (table default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417])
I20260928 01:55:52.623324 19890 ts_tablet_manager.cc:1434] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260928 01:55:52.640738 19896 ts_tablet_manager.cc:1434] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.006s
I20260928 01:55:52.641745 19896 tablet_bootstrap.cc:492] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:52.645725 19890 tablet_bootstrap.cc:492] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:52.655350 19890 tablet_bootstrap.cc:654] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:52.660538 20860 tablet_loader.cc:96] loaded metadata for tablet 29f65b0966c04012bfec3c67a37acc25 (table default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e])
I20260928 01:55:52.661899 20860 tablet_loader.cc:96] loaded metadata for tablet 2c007b068b1d414298cce3fe44a91daa (table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc])
I20260928 01:55:52.663811 19896 tablet_bootstrap.cc:654] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:52.671180 20860 tablet_loader.cc:96] loaded metadata for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12])
I20260928 01:55:52.672685 21113 raft_consensus.cc:515] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:52.674099 20860 tablet_loader.cc:96] loaded metadata for tablet 36076aa674b9401b9b76fbf066348d06 (table default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a])
I20260928 01:55:52.676385 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:52.677830 19890 tablet_bootstrap.cc:492] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:52.678270 19890 ts_tablet_manager.cc:1403] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.033s	user 0.001s	sys 0.009s
W20260928 01:55:52.678722 19553 leader_election.cc:343] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:52.688406 20029 raft_consensus.cc:359] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:52.689486 20029 raft_consensus.cc:385] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:52.690714 20029 raft_consensus.cc:740] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:52.691105 21113 leader_election.cc:290] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:52.703279 20860 tablet_loader.cc:96] loaded metadata for tablet 376b5a87b07b4f87a2a502b5fa1b23f8 (table default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7])
I20260928 01:55:52.705864 20860 tablet_loader.cc:96] loaded metadata for tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7 (table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535])
I20260928 01:55:52.707756 20860 tablet_loader.cc:96] loaded metadata for tablet 3f4a1c903a04450684ba38081a75559e (table default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a])
I20260928 01:55:52.712782 20552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:52.714972 20029 consensus_queue.cc:260] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:52.724642 20029 ts_tablet_manager.cc:1434] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.105s	user 0.008s	sys 0.000s
I20260928 01:55:52.725750 20029 tablet_bootstrap.cc:492] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:52.770413 20029 tablet_bootstrap.cc:654] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:52.795683 20456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 81287.7us
I20260928 01:55:52.808600 21098 raft_consensus.cc:493] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:52.809124 21098 raft_consensus.cc:515] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:52.811170 21098 leader_election.cc:290] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:52.812846 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:52.815362 19553 leader_election.cc:343] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:52.700829 19890 raft_consensus.cc:359] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.832577 19890 raft_consensus.cc:385] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:52.832892 19890 raft_consensus.cc:740] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:52.833552 19890 consensus_queue.cc:260] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.835690 19890 ts_tablet_manager.cc:1434] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.157s	user 0.004s	sys 0.000s
W20260928 01:55:52.872838 21142 log.cc:927] Time spent T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260928 01:55:52.874079 19890 tablet_bootstrap.cc:492] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:52.893126 20860 tablet_loader.cc:96] loaded metadata for tablet 416ccc1323fe41b2a7783dc95bba8d84 (table default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d])
I20260928 01:55:52.895364 20860 tablet_loader.cc:96] loaded metadata for tablet 45d8d07b367b4fafbd7171f8ea7b2a26 (table default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921])
I20260928 01:55:52.910362 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:52.911800 19468 raft_consensus.cc:3060] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:52.912659 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:52.913565 19466 raft_consensus.cc:2468] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:52.915728 19556 leader_election.cc:304] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:52.918735 21098 raft_consensus.cc:2804] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:52.919108 21098 raft_consensus.cc:493] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:52.919457 21098 raft_consensus.cc:3060] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:52.926064 19103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:52.934787 19890 tablet_bootstrap.cc:654] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:52.937688 20860 tablet_loader.cc:96] loaded metadata for tablet 4c6f4708c641414aa59f01703c86aaf1 (table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8])
I20260928 01:55:52.938431 21098 raft_consensus.cc:515] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:52.939009 20860 tablet_loader.cc:96] loaded metadata for tablet 4e6b59144fe14daab98b0965c7f8af02 (table default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2])
I20260928 01:55:52.970324 20860 tablet_loader.cc:96] loaded metadata for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88])
I20260928 01:55:52.971884 20860 tablet_loader.cc:96] loaded metadata for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd])
I20260928 01:55:52.973282 20860 tablet_loader.cc:96] loaded metadata for tablet 522245da435b40ae84ae6dc5d19a2e95 (table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed])
W20260928 01:55:52.975591 21138 log.cc:927] Time spent T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260928 01:55:52.938901 20029 tablet_bootstrap.cc:492] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:52.956542 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:55:52.979341 19553 leader_election.cc:343] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:52.982086 19896 tablet_bootstrap.cc:492] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:52.982966 19896 ts_tablet_manager.cc:1403] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.341s	user 0.007s	sys 0.005s
I20260928 01:55:53.007169 19890 tablet_bootstrap.cc:492] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:53.007654 19890 ts_tablet_manager.cc:1403] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.134s	user 0.009s	sys 0.000s
I20260928 01:55:52.974392 20860 tablet_loader.cc:96] loaded metadata for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3 (table default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f])
I20260928 01:55:53.018765 20860 tablet_loader.cc:96] loaded metadata for tablet 5374596938d64cafb9621a1932ca1f68 (table default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f])
I20260928 01:55:53.010736 19890 raft_consensus.cc:359] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.022603 19890 raft_consensus.cc:385] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:53.022892 19890 raft_consensus.cc:740] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:53.023509 19890 consensus_queue.cc:260] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:52.978787 20029 ts_tablet_manager.cc:1403] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.253s	user 0.024s	sys 0.002s
I20260928 01:55:53.024978 19890 ts_tablet_manager.cc:1434] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260928 01:55:53.014240 21098 leader_election.cc:290] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:53.026674 20029 raft_consensus.cc:359] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:53.030995 21043 raft_consensus.cc:493] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.031623 21043 raft_consensus.cc:515] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:53.042313 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 52175.2us
I20260928 01:55:53.044823 19896 raft_consensus.cc:359] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.045150 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:53.045598 19896 raft_consensus.cc:385] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:53.045872 19896 raft_consensus.cc:740] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:53.046617 19896 consensus_queue.cc:260] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:53.047861 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 60900.4us
I20260928 01:55:53.049360 21043 leader_election.cc:290] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:53.052381 21043 raft_consensus.cc:493] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.052965 19896 ts_tablet_manager.cc:1434] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.001s
I20260928 01:55:53.053048 21043 raft_consensus.cc:515] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.055327 21043 leader_election.cc:290] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:53.055958 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:53.056679 19472 raft_consensus.cc:3060] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:53.055577 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:53.027288 20029 raft_consensus.cc:385] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:55:53.070978 19409 leader_election.cc:343] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.071417 20860 tablet_loader.cc:96] loaded metadata for tablet 53c755f16ea1496eb7fa26fb12e01708 (table default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85])
I20260928 01:55:53.072682 20860 tablet_loader.cc:96] loaded metadata for tablet 5442dd0aa28545c8bcf3a0b977c71e98 (table default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b])
I20260928 01:55:53.072564 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daa1b799e0d408287edc03988f5b683" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:53.076647 19409 leader_election.cc:343] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.079257 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daa1b799e0d408287edc03988f5b683" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:53.081094 21098 raft_consensus.cc:493] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.081667 21098 raft_consensus.cc:515] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.077342 19896 tablet_bootstrap.cc:492] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:53.091684 21075 raft_consensus.cc:493] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.092324 21075 raft_consensus.cc:515] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:53.097078 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:53.099285 21075 leader_election.cc:290] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:53.071768 20029 raft_consensus.cc:740] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:55:53.078392 19412 leader_election.cc:343] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.107862 19412 leader_election.cc:304] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:53.108794 21043 raft_consensus.cc:2749] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:53.109463 19412 leader_election.cc:343] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.110009 19412 leader_election.cc:304] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:53.096565 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:53.111450 21085 raft_consensus.cc:2749] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:53.111737 19618 raft_consensus.cc:2393] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:53.100776 19890 tablet_bootstrap.cc:492] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:53.114115 19704 leader_election.cc:304] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:53.115721 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602706a3fbc438d8d448c9ac057087c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:53.116168 21083 raft_consensus.cc:3060] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:53.117225 19553 leader_election.cc:343] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.127532 20860 tablet_loader.cc:96] loaded metadata for tablet 6546cfe6f3a6405fab41a4ebdcffb288 (table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df])
I20260928 01:55:53.041170 19468 raft_consensus.cc:2468] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:53.133630 20029 consensus_queue.cc:260] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:53.134573 21076 raft_consensus.cc:493] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.134613 19472 raft_consensus.cc:2468] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:53.135147 21076 raft_consensus.cc:515] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:53.138489 20029 ts_tablet_manager.cc:1434] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.000s
I20260928 01:55:53.138778 21076 leader_election.cc:290] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:53.139473 20029 tablet_bootstrap.cc:492] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:53.143198 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5e07078b2a4fe59d9293d9511cbb6b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:53.146668 19890 tablet_bootstrap.cc:654] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:53.148977 21083 raft_consensus.cc:2749] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:53.168937 19102 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.645s (SENT) [suppressed 1 similar messages]
I20260928 01:55:53.170984 19896 tablet_bootstrap.cc:654] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:53.178437 19556 leader_election.cc:304] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:53.178856 20860 tablet_loader.cc:96] loaded metadata for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435])
I20260928 01:55:53.180951 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5e07078b2a4fe59d9293d9511cbb6b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:53.182034 19472 raft_consensus.cc:2393] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:53.183424 19703 leader_election.cc:304] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:53.184967 21076 raft_consensus.cc:3060] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:53.192065 20860 tablet_loader.cc:96] loaded metadata for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee])
I20260928 01:55:53.192044 21098 leader_election.cc:290] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:53.193589 20860 tablet_loader.cc:96] loaded metadata for tablet 664b608bb0f54fc5baa10622f7d916c1 (table default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9])
I20260928 01:55:53.194870 20860 tablet_loader.cc:96] loaded metadata for tablet 675e1e1f2630411f8b070d8ca99e8ffb (table default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93])
I20260928 01:55:53.196910 21056 raft_consensus.cc:2804] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:53.197400 21056 raft_consensus.cc:697] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:53.198247 21056 consensus_queue.cc:237] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:53.203518 19556 leader_election.cc:304] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:53.212725 21076 raft_consensus.cc:2749] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:53.214082 21113 raft_consensus.cc:2804] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:53.214584 21113 raft_consensus.cc:697] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:53.215418 21113 consensus_queue.cc:237] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:53.226148 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 57241.5us
I20260928 01:55:53.227192 19890 tablet_bootstrap.cc:492] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:53.227649 19890 ts_tablet_manager.cc:1403] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.127s	user 0.000s	sys 0.010s
I20260928 01:55:53.230110 19890 raft_consensus.cc:359] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.230772 19890 raft_consensus.cc:385] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:53.231052 19890 raft_consensus.cc:740] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:53.238449 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602706a3fbc438d8d448c9ac057087c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:53.239130 19472 raft_consensus.cc:2468] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:53.196161 20860 tablet_loader.cc:96] loaded metadata for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331])
I20260928 01:55:53.240899 21043 raft_consensus.cc:493] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.240931 19556 leader_election.cc:304] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:53.241696 21113 raft_consensus.cc:2804] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:53.241454 21043 raft_consensus.cc:515] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.242031 21113 raft_consensus.cc:493] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:53.242352 21113 raft_consensus.cc:3060] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:53.243702 21043 leader_election.cc:290] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:53.244894 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:53.245146 20860 tablet_loader.cc:96] loaded metadata for tablet 6ea6adefd15a4ea19011419949047e83 (table default.Table_a82317fb7790483884cbb5ebcf554128 [id=292d90fe578e4470bced0890a4e646ef])
I20260928 01:55:53.246670 20860 tablet_loader.cc:96] loaded metadata for tablet 7441c2d1a7fa4dc8a89c6717a80d3efb (table default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233])
W20260928 01:55:53.247429 19409 leader_election.cc:343] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.253957 20029 tablet_bootstrap.cc:654] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:53.231681 19890 consensus_queue.cc:260] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.266858 21056 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.267628 21056 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.271045 19890 ts_tablet_manager.cc:1434] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260928 01:55:53.271402 20860 tablet_loader.cc:96] loaded metadata for tablet 75303ee92aae436ea6c46747a23b69b6 (table default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320])
I20260928 01:55:53.272701 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:53.274725 19553 leader_election.cc:343] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.270704 21056 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:53.276863 20860 tablet_loader.cc:96] loaded metadata for tablet 7801c623930d4e4eaf24c5c424b06d26 (table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006])
I20260928 01:55:53.278774 20860 tablet_loader.cc:96] loaded metadata for tablet 7979940c4a2e470bbecc40384edf38c9 (table default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87])
I20260928 01:55:53.281291 19896 tablet_bootstrap.cc:492] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:53.282017 19896 ts_tablet_manager.cc:1403] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.214s	user 0.008s	sys 0.006s
I20260928 01:55:53.285106 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:53.289564 19412 leader_election.cc:343] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.290103 19412 leader_election.cc:304] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:53.292610 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:53.293442 19468 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:53.295576 21085 raft_consensus.cc:2749] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:43.789364 20553 rpcz_store.cc:276] 0928 01:55:39.805380 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:39.805526 (+   146us) service_pool.cc:224] Handling call
0928 01:55:41.048647 (+1243121us) raft_consensus.cc:1471] Updating replica for 245 ops
0928 01:55:41.552453 (+503806us) raft_consensus.cc:1534] Early marking committed up to index 7
0928 01:55:41.768355 (+215902us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:55:41.768399 (+    44us) write_op.cc:454] Released schema lock
0928 01:55:41.768687 (+   288us) raft_consensus.cc:1539] Triggering prepare for 245 ops
0928 01:55:41.769454 (+   767us) write_op.cc:270] Start()
0928 01:55:41.769633 (+   179us) write_op.cc:276] Timestamp: P: 1790560520016856 usec, L: 0
0928 01:55:41.829114 (+ 59481us) write_op.cc:270] Start()
0928 01:55:41.829277 (+   163us) write_op.cc:276] Timestamp: P: 1790560520035363 usec, L: 0
0928 01:55:41.830223 (+   946us) write_op.cc:270] Start()
0928 01:55:41.830420 (+   197us) write_op.cc:276] Timestamp: P: 1790560520037845 usec, L: 0
0928 01:55:41.834281 (+  3861us) write_op.cc:270] Start()
0928 01:55:41.834424 (+   143us) write_op.cc:276] Timestamp: P: 1790560520047576 usec, L: 0
0928 01:55:41.835256 (+   832us) write_op.cc:270] Start()
0928 01:55:41.835387 (+   131us) write_op.cc:276] Timestamp: P: 1790560520050137 usec, L: 0
0928 01:55:41.848724 (+ 13337us) write_op.cc:270] Start()
0928 01:55:41.848930 (+   206us) write_op.cc:276] Timestamp: P: 1790560520058702 usec, L: 0
0928 01:55:41.849891 (+   961us) write_op.cc:270] Start()
0928 01:55:41.864139 (+ 14248us) write_op.cc:276] Timestamp: P: 1790560520068473 usec, L: 0
0928 01:55:41.865058 (+   919us) write_op.cc:270] Start()
0928 01:55:41.865200 (+   142us) write_op.cc:276] Timestamp: P: 1790560520071113 usec, L: 0
0928 01:55:41.866005 (+   805us) write_op.cc:270] Start()
0928 01:55:41.866087 (+    82us) write_op.cc:276] Timestamp: P: 1790560520085965 usec, L: 0
0928 01:55:41.866558 (+   471us) write_op.cc:270] Start()
0928 01:55:41.866657 (+    99us) write_op.cc:276] Timestamp: P: 1790560520169665 usec, L: 0
0928 01:55:41.867180 (+   523us) write_op.cc:270] Start()
0928 01:55:41.867269 (+    89us) write_op.cc:276] Timestamp: P: 1790560520269750 usec, L: 0
0928 01:55:41.867728 (+   459us) write_op.cc:270] Start()
0928 01:55:41.867828 (+   100us) write_op.cc:276] Timestamp: P: 1790560520298213 usec, L: 0
0928 01:55:41.868414 (+   586us) write_op.cc:270] Start()
0928 01:55:41.868501 (+    87us) write_op.cc:276] Timestamp: P: 1790560520310858 usec, L: 0
0928 01:55:41.869043 (+   542us) write_op.cc:270] Start()
0928 01:55:41.869124 (+    81us) write_op.cc:276] Timestamp: P: 1790560520319735 usec, L: 0
0928 01:55:41.869786 (+   662us) write_op.cc:270] Start()
0928 01:55:41.869904 (+   118us) write_op.cc:276] Timestamp: P: 1790560520346180 usec, L: 0
0928 01:55:41.917308 (+ 47404us) write_op.cc:270] Start()
0928 01:55:41.917565 (+   257us) write_op.cc:276] Timestamp: P: 1790560520410104 usec, L: 0
0928 01:55:41.918584 (+  1019us) write_op.cc:270] Start()
0928 01:55:41.918709 (+   125us) write_op.cc:276] Timestamp: P: 1790560520450443 usec, L: 0
0928 01:55:41.919581 (+   872us) write_op.cc:270] Start()
0928 01:55:41.919751 (+   170us) write_op.cc:276] Timestamp: P: 1790560520476653 usec, L: 0
0928 01:55:41.942514 (+ 22763us) write_op.cc:270] Start()
0928 01:55:41.942622 (+   108us) write_op.cc:276] Timestamp: P: 1790560520479505 usec, L: 0
0928 01:55:41.945099 (+  2477us) write_op.cc:270] Start()
0928 01:55:41.945193 (+    94us) write_op.cc:276] Timestamp: P: 1790560520569920 usec, L: 0
0928 01:55:41.945809 (+   616us) write_op.cc:270] Start()
0928 01:55:41.945941 (+   132us) write_op.cc:276] Timestamp: P: 1790560520581273 usec, L: 0
0928 01:55:41.946691 (+   750us) write_op.cc:270] Start()
0928 01:55:41.946818 (+   127us) write_op.cc:276] Timestamp: P: 1790560520753998 usec, L: 0
0928 01:55:41.947618 (+   800us) write_op.cc:270] Start()
0928 01:55:41.947942 (+   324us) write_op.cc:276] Timestamp: P: 1790560520766933 usec, L: 0
0928 01:55:41.964716 (+ 16774us) write_op.cc:270] Start()
0928 01:55:41.964945 (+   229us) write_op.cc:276] Timestamp: P: 1790560520808656 usec, L: 0
0928 01:55:41.974541 (+  9596us) write_op.cc:270] Start()
0928 01:55:41.974689 (+   148us) write_op.cc:276] Timestamp: P: 1790560520821231 usec, L: 0
0928 01:55:41.975554 (+   865us) write_op.cc:270] Start()
0928 01:55:41.975707 (+   153us) write_op.cc:276] Timestamp: P: 1790560520948469 usec, L: 0
0928 01:55:41.976585 (+   878us) write_op.cc:270] Start()
0928 01:55:41.976723 (+   138us) write_op.cc:276] Timestamp: P: 1790560521029100 usec, L: 0
0928 01:55:41.987466 (+ 10743us) write_op.cc:270] Start()
0928 01:55:41.987622 (+   156us) write_op.cc:276] Timestamp: P: 1790560521045852 usec, L: 0
0928 01:55:41.988641 (+  1019us) write_op.cc:270] Start()
0928 01:55:41.988801 (+   160us) write_op.cc:276] Timestamp: P: 1790560521124730 usec, L: 0
0928 01:55:41.997413 (+  8612us) write_op.cc:270] Start()
0928 01:55:41.997600 (+   187us) write_op.cc:276] Timestamp: P: 1790560521127459 usec, L: 0
0928 01:55:42.000492 (+  2892us) write_op.cc:270] Start()
0928 01:55:42.000627 (+   135us) write_op.cc:276] Timestamp: P: 1790560521137657 usec, L: 0
0928 01:55:42.003299 (+  2672us) write_op.cc:270] Start()
0928 01:55:42.003443 (+   144us) write_op.cc:276] Timestamp: P: 1790560521163417 usec, L: 0
0928 01:55:42.004512 (+  1069us) write_op.cc:270] Start()
0928 01:55:42.004646 (+   134us) write_op.cc:276] Timestamp: P: 1790560521240379 usec, L: 0
0928 01:55:42.005408 (+   762us) write_op.cc:270] Start()
0928 01:55:42.014936 (+  9528us) write_op.cc:276] Timestamp: P: 1790560521251595 usec, L: 0
0928 01:55:42.022384 (+  7448us) write_op.cc:270] Start()
0928 01:55:42.022538 (+   154us) write_op.cc:276] Timestamp: P: 1790560521268367 usec, L: 0
0928 01:55:42.023444 (+   906us) write_op.cc:270] Start()
0928 01:55:42.023572 (+   128us) write_op.cc:276] Timestamp: P: 1790560521396709 usec, L: 0
0928 01:55:42.026215 (+  2643us) write_op.cc:270] Start()
0928 01:55:42.026347 (+   132us) write_op.cc:276] Timestamp: P: 1790560521414781 usec, L: 0
0928 01:55:42.031029 (+  4682us) write_op.cc:270] Start()
0928 01:55:42.031160 (+   131us) write_op.cc:276] Timestamp: P: 1790560521455115 usec, L: 0
0928 01:55:42.031980 (+   820us) write_op.cc:270] Start()
0928 01:55:42.032096 (+   116us) write_op.cc:276] Timestamp: P: 1790560521494346 usec, L: 0
0928 01:55:42.032947 (+   851us) write_op.cc:270] Start()
0928 01:55:42.033078 (+   131us) write_op.cc:276] Timestamp: P: 1790560521585305 usec, L: 0
0928 01:55:42.033908 (+   830us) write_op.cc:270] Start()
0928 01:55:42.034041 (+   133us) write_op.cc:276] Timestamp: P: 1790560521598762 usec, L: 0
0928 01:55:42.034776 (+   735us) write_op.cc:270] Start()
0928 01:55:42.034895 (+   119us) write_op.cc:276] Timestamp: P: 1790560521608377 usec, L: 0
0928 01:55:42.035693 (+   798us) write_op.cc:270] Start()
0928 01:55:42.035812 (+   119us) write_op.cc:276] Timestamp: P: 1790560521617421 usec, L: 0
0928 01:55:42.036612 (+   800us) write_op.cc:270] Start()
0928 01:55:42.036730 (+   118us) write_op.cc:276] Timestamp: P: 1790560521636801 usec, L: 0
0928 01:55:42.037476 (+   746us) write_op.cc:270] Start()
0928 01:55:42.037588 (+   112us) write_op.cc:276] Timestamp: P: 1790560521648279 usec, L: 0
0928 01:55:42.038371 (+   783us) write_op.cc:270] Start()
0928 01:55:42.038494 (+   123us) write_op.cc:276] Timestamp: P: 1790560521734671 usec, L: 0
0928 01:55:42.039275 (+   781us) write_op.cc:270] Start()
0928 01:55:42.039398 (+   123us) write_op.cc:276] Timestamp: P: 1790560521748830 usec, L: 0
0928 01:55:42.040129 (+   731us) write_op.cc:270] Start()
0928 01:55:42.040464 (+   335us) write_op.cc:276] Timestamp: P: 1790560521757041 usec, L: 0
0928 01:55:42.041344 (+   880us) write_op.cc:270] Start()
0928 01:55:42.041461 (+   117us) write_op.cc:276] Timestamp: P: 1790560521948628 usec, L: 0
0928 01:55:42.042239 (+   778us) write_op.cc:270] Start()
0928 01:55:42.042368 (+   129us) write_op.cc:276] Timestamp: P: 1790560522005405 usec, L: 0
0928 01:55:42.043170 (+   802us) write_op.cc:270] Start()
0928 01:55:42.043299 (+   129us) write_op.cc:276] Timestamp: P: 1790560522007364 usec, L: 0
0928 01:55:42.044045 (+   746us) write_op.cc:270] Start()
0928 01:55:42.044172 (+   127us) write_op.cc:276] Timestamp: P: 1790560522026111 usec, L: 0
0928 01:55:42.046160 (+  1988us) write_op.cc:270] Start()
0928 01:55:42.046283 (+   123us) write_op.cc:276] Timestamp: P: 1790560522037518 usec, L: 0
0928 01:55:42.049990 (+  3707us) write_op.cc:270] Start()
0928 01:55:42.050114 (+   124us) write_op.cc:276] Timestamp: P: 1790560522084434 usec, L: 0
0928 01:55:42.050969 (+   855us) write_op.cc:270] Start()
0928 01:55:42.051095 (+   126us) write_op.cc:276] Timestamp: P: 1790560522245413 usec, L: 0
0928 01:55:42.052408 (+  1313us) write_op.cc:270] Start()
0928 01:55:42.052537 (+   129us) write_op.cc:276] Timestamp: P: 1790560522264525 usec, L: 0
0928 01:55:42.053327 (+   790us) write_op.cc:270] Start()
0928 01:55:42.053454 (+   127us) write_op.cc:276] Timestamp: P: 1790560522403596 usec, L: 0
0928 01:55:42.054482 (+  1028us) write_op.cc:270] Start()
0928 01:55:42.054619 (+   137us) write_op.cc:276] Timestamp: P: 1790560522411035 usec, L: 0
0928 01:55:42.055705 (+  1086us) write_op.cc:270] Start()
0928 01:55:42.055863 (+   158us) write_op.cc:276] Timestamp: P: 1790560522413498 usec, L: 0
0928 01:55:42.056692 (+   829us) write_op.cc:270] Start()
0928 01:55:42.056823 (+   131us) write_op.cc:276] Timestamp: P: 1790560522445060 usec, L: 0
0928 01:55:42.057766 (+   943us) write_op.cc:270] Start()
0928 01:55:42.057872 (+   106us) write_op.cc:276] Timestamp: P: 1790560522595491 usec, L: 0
0928 01:55:42.058687 (+   815us) write_op.cc:270] Start()
0928 01:55:42.058794 (+   107us) write_op.cc:276] Timestamp: P: 1790560522629433 usec, L: 0
0928 01:55:42.059784 (+   990us) write_op.cc:270] Start()
0928 01:55:42.059916 (+   132us) write_op.cc:276] Timestamp: P: 1790560522648049 usec, L: 0
0928 01:55:42.060901 (+   985us) write_op.cc:270] Start()
0928 01:55:42.061026 (+   125us) write_op.cc:276] Timestamp: P: 1790560522668636 usec, L: 0
0928 01:55:42.062077 (+  1051us) write_op.cc:270] Start()
0928 01:55:42.062208 (+   131us) write_op.cc:276] Timestamp: P: 1790560522672157 usec, L: 0
0928 01:55:42.063219 (+  1011us) write_op.cc:270] Start()
0928 01:55:42.063345 (+   126us) write_op.cc:276] Timestamp: P: 1790560522841385 usec, L: 0
0928 01:55:42.064107 (+   762us) write_op.cc:270] Start()
0928 01:55:42.064295 (+   188us) write_op.cc:276] Timestamp: P: 1790560522872157 usec, L: 0
0928 01:55:42.065027 (+   732us) write_op.cc:270] Start()
0928 01:55:42.065150 (+   123us) write_op.cc:276] Timestamp: P: 1790560522888630 usec, L: 0
0928 01:55:42.065895 (+   745us) write_op.cc:270] Start()
0928 01:55:42.066009 (+   114us) write_op.cc:276] Timestamp: P: 1790560522903023 usec, L: 0
0928 01:55:42.066820 (+   811us) write_op.cc:270] Start()
0928 01:55:42.066938 (+   118us) write_op.cc:276] Timestamp: P: 1790560523119002 usec, L: 0
0928 01:55:42.067803 (+   865us) write_op.cc:270] Start()
0928 01:55:42.067927 (+   124us) write_op.cc:276] Timestamp: P: 1790560523210197 usec, L: 0
0928 01:55:42.068737 (+   810us) write_op.cc:270] Start()
0928 01:55:42.068865 (+   128us) write_op.cc:276] Timestamp: P: 1790560523285488 usec, L: 0
0928 01:55:42.069631 (+   766us) write_op.cc:270] Start()
0928 01:55:42.069757 (+   126us) write_op.cc:276] Timestamp: P: 1790560523338181 usec, L: 0
0928 01:55:42.070450 (+   693us) write_op.cc:270] Start()
0928 01:55:42.070567 (+   117us) write_op.cc:276] Timestamp: P: 1790560523372084 usec, L: 0
0928 01:55:42.071389 (+   822us) write_op.cc:270] Start()
0928 01:55:42.071524 (+   135us) write_op.cc:276] Timestamp: P: 1790560523376036 usec, L: 0
0928 01:55:42.072380 (+   856us) write_op.cc:270] Start()
0928 01:55:42.072500 (+   120us) write_op.cc:276] Timestamp: P: 1790560523387989 usec, L: 0
0928 01:55:42.073297 (+   797us) write_op.cc:270] Start()
0928 01:55:42.073430 (+   133us) write_op.cc:276] Timestamp: P: 1790560523393169 usec, L: 0
0928 01:55:42.074312 (+   882us) write_op.cc:270] Start()
0928 01:55:42.074438 (+   126us) write_op.cc:276] Timestamp: P: 1790560523461121 usec, L: 0
0928 01:55:42.075188 (+   750us) write_op.cc:270] Start()
0928 01:55:42.075317 (+   129us) write_op.cc:276] Timestamp: P: 1790560523498607 usec, L: 0
0928 01:55:42.076145 (+   828us) write_op.cc:270] Start()
0928 01:55:42.076292 (+   147us) write_op.cc:276] Timestamp: P: 1790560523527550 usec, L: 0
0928 01:55:42.077128 (+   836us) write_op.cc:270] Start()
0928 01:55:42.077253 (+   125us) write_op.cc:276] Timestamp: P: 1790560523578782 usec, L: 0
0928 01:55:42.077990 (+   737us) write_op.cc:270] Start()
0928 01:55:42.078098 (+   108us) write_op.cc:276] Timestamp: P: 1790560523628973 usec, L: 0
0928 01:55:42.078865 (+   767us) write_op.cc:270] Start()
0928 01:55:42.078988 (+   123us) write_op.cc:276] Timestamp: P: 1790560523682694 usec, L: 0
0928 01:55:42.079734 (+   746us) write_op.cc:270] Start()
0928 01:55:42.079859 (+   125us) write_op.cc:276] Timestamp: P: 1790560523734302 usec, L: 0
0928 01:55:42.080733 (+   874us) write_op.cc:270] Start()
0928 01:55:42.080886 (+   153us) write_op.cc:276] Timestamp: P: 1790560523753651 usec, L: 0
0928 01:55:42.081641 (+   755us) write_op.cc:270] Start()
0928 01:55:42.081765 (+   124us) write_op.cc:276] Timestamp: P: 1790560523825026 usec, L: 0
0928 01:55:42.082754 (+   989us) write_op.cc:270] Start()
0928 01:55:42.082898 (+   144us) write_op.cc:276] Timestamp: P: 1790560523864409 usec, L: 0
0928 01:55:42.083642 (+   744us) write_op.cc:270] Start()
0928 01:55:42.083764 (+   122us) write_op.cc:276] Timestamp: P: 1790560523997789 usec, L: 0
0928 01:55:42.084633 (+   869us) write_op.cc:270] Start()
0928 01:55:42.084759 (+   126us) write_op.cc:276] Timestamp: P: 1790560524113921 usec, L: 0
0928 01:55:42.085525 (+   766us) write_op.cc:270] Start()
0928 01:55:42.085667 (+   142us) write_op.cc:276] Timestamp: P: 1790560524174042 usec, L: 0
0928 01:55:42.086501 (+   834us) write_op.cc:270] Start()
0928 01:55:42.086703 (+   202us) write_op.cc:276] Timestamp: P: 1790560524232055 usec, L: 0
0928 01:55:42.089320 (+  2617us) write_op.cc:270] Start()
0928 01:55:42.089458 (+   138us) write_op.cc:276] Timestamp: P: 1790560524332041 usec, L: 0
0928 01:55:42.090473 (+  1015us) write_op.cc:270] Start()
0928 01:55:42.090617 (+   144us) write_op.cc:276] Timestamp: P: 1790560524450550 usec, L: 0
0928 01:55:42.091423 (+   806us) write_op.cc:270] Start()
0928 01:55:42.091771 (+   348us) write_op.cc:276] Timestamp: P: 1790560524553506 usec, L: 0
0928 01:55:42.092559 (+   788us) write_op.cc:270] Start()
0928 01:55:42.092687 (+   128us) write_op.cc:276] Timestamp: P: 1790560524635124 usec, L: 0
0928 01:55:42.093662 (+   975us) write_op.cc:270] Start()
0928 01:55:42.093940 (+   278us) write_op.cc:276] Timestamp: P: 1790560524666290 usec, L: 0
0928 01:55:42.094761 (+   821us) write_op.cc:270] Start()
0928 01:55:42.094994 (+   233us) write_op.cc:276] Timestamp: P: 1790560524717862 usec, L: 0
0928 01:55:42.095871 (+   877us) write_op.cc:270] Start()
0928 01:55:42.096301 (+   430us) write_op.cc:276] Timestamp: P: 1790560524825984 usec, L: 0
0928 01:55:42.100014 (+  3713us) write_op.cc:270] Start()
0928 01:55:42.100148 (+   134us) write_op.cc:276] Timestamp: P: 1790560524861837 usec, L: 0
0928 01:55:42.103977 (+  3829us) write_op.cc:270] Start()
0928 01:55:42.104111 (+   134us) write_op.cc:276] Timestamp: P: 1790560524999783 usec, L: 0
0928 01:55:42.104945 (+   834us) write_op.cc:270] Start()
0928 01:55:42.105077 (+   132us) write_op.cc:276] Timestamp: P: 1790560525089635 usec, L: 0
0928 01:55:42.105838 (+   761us) write_op.cc:270] Start()
0928 01:55:42.106018 (+   180us) write_op.cc:276] Timestamp: P: 1790560525149848 usec, L: 0
0928 01:55:42.106840 (+   822us) write_op.cc:270] Start()
0928 01:55:42.106965 (+   125us) write_op.cc:276] Timestamp: P: 1790560525216871 usec, L: 0
0928 01:55:42.108332 (+  1367us) write_op.cc:270] Start()
0928 01:55:42.108460 (+   128us) write_op.cc:276] Timestamp: P: 1790560525409771 usec, L: 0
0928 01:55:42.109241 (+   781us) write_op.cc:270] Start()
0928 01:55:42.109366 (+   125us) write_op.cc:276] Timestamp: P: 1790560525557239 usec, L: 0
0928 01:55:42.110089 (+   723us) write_op.cc:270] Start()
0928 01:55:42.110233 (+   144us) write_op.cc:276] Timestamp: P: 1790560525621173 usec, L: 0
0928 01:55:42.110976 (+   743us) write_op.cc:270] Start()
0928 01:55:42.111103 (+   127us) write_op.cc:276] Timestamp: P: 1790560525885511 usec, L: 0
0928 01:55:42.111839 (+   736us) write_op.cc:270] Start()
0928 01:55:42.111959 (+   120us) write_op.cc:276] Timestamp: P: 1790560526241477 usec, L: 0
0928 01:55:42.112786 (+   827us) write_op.cc:270] Start()
0928 01:55:42.112912 (+   126us) write_op.cc:276] Timestamp: P: 1790560526300839 usec, L: 0
0928 01:55:42.113688 (+   776us) write_op.cc:270] Start()
0928 01:55:42.113830 (+   142us) write_op.cc:276] Timestamp: P: 1790560526552020 usec, L: 0
0928 01:55:42.114560 (+   730us) write_op.cc:270] Start()
0928 01:55:42.114686 (+   126us) write_op.cc:276] Timestamp: P: 1790560526870013 usec, L: 0
0928 01:55:42.115400 (+   714us) write_op.cc:270] Start()
0928 01:55:42.115525 (+   125us) write_op.cc:276] Timestamp: P: 1790560526900783 usec, L: 0
0928 01:55:42.116539 (+  1014us) write_op.cc:270] Start()
0928 01:55:42.116661 (+   122us) write_op.cc:276] Timestamp: P: 1790560526907973 usec, L: 0
0928 01:55:42.117444 (+   783us) write_op.cc:270] Start()
0928 01:55:42.117615 (+   171us) write_op.cc:276] Timestamp: P: 1790560526958430 usec, L: 0
0928 01:55:42.118352 (+   737us) write_op.cc:270] Start()
0928 01:55:42.118474 (+   122us) write_op.cc:276] Timestamp: P: 1790560526979659 usec, L: 0
0928 01:55:42.119192 (+   718us) write_op.cc:270] Start()
0928 01:55:42.119310 (+   118us) write_op.cc:276] Timestamp: P: 1790560527102151 usec, L: 0
0928 01:55:42.120802 (+  1492us) write_op.cc:270] Start()
0928 01:55:42.134983 (+ 14181us) write_op.cc:276] Timestamp: P: 1790560527131386 usec, L: 0
0928 01:55:42.139727 (+  4744us) write_op.cc:270] Start()
0928 01:55:42.139913 (+   186us) write_op.cc:276] Timestamp: P: 1790560527290945 usec, L: 0
0928 01:55:42.145143 (+  5230us) write_op.cc:270] Start()
0928 01:55:42.145957 (+   814us) write_op.cc:276] Timestamp: P: 1790560527366610 usec, L: 0
0928 01:55:42.146809 (+   852us) write_op.cc:270] Start()
0928 01:55:42.146939 (+   130us) write_op.cc:276] Timestamp: P: 1790560527512510 usec, L: 0
0928 01:55:42.147839 (+   900us) write_op.cc:270] Start()
0928 01:55:42.147962 (+   123us) write_op.cc:276] Timestamp: P: 1790560527552394 usec, L: 0
0928 01:55:42.166672 (+ 18710us) write_op.cc:270] Start()
0928 01:55:42.166854 (+   182us) write_op.cc:276] Timestamp: P: 1790560527627628 usec, L: 0
0928 01:55:42.167812 (+   958us) write_op.cc:270] Start()
0928 01:55:42.167960 (+   148us) write_op.cc:276] Timestamp: P: 1790560527652827 usec, L: 0
0928 01:55:42.168828 (+   868us) write_op.cc:270] Start()
0928 01:55:42.168975 (+   147us) write_op.cc:276] Timestamp: P: 1790560527656333 usec, L: 0
0928 01:55:42.169856 (+   881us) write_op.cc:270] Start()
0928 01:55:42.169992 (+   136us) write_op.cc:276] Timestamp: P: 1790560527684989 usec, L: 0
0928 01:55:42.170781 (+   789us) write_op.cc:270] Start()
0928 01:55:42.170925 (+   144us) write_op.cc:276] Timestamp: P: 1790560527687263 usec, L: 0
0928 01:55:42.171706 (+   781us) write_op.cc:270] Start()
0928 01:55:42.171782 (+    76us) write_op.cc:276] Timestamp: P: 1790560527733587 usec, L: 0
0928 01:55:42.176554 (+  4772us) write_op.cc:270] Start()
0928 01:55:42.176723 (+   169us) write_op.cc:276] Timestamp: P: 1790560527736497 usec, L: 0
0928 01:55:42.178491 (+  1768us) write_op.cc:270] Start()
0928 01:55:42.178692 (+   201us) write_op.cc:276] Timestamp: P: 1790560527756654 usec, L: 0
0928 01:55:42.180325 (+  1633us) write_op.cc:270] Start()
0928 01:55:42.180493 (+   168us) write_op.cc:276] Timestamp: P: 1790560527913187 usec, L: 0
0928 01:55:42.181808 (+  1315us) write_op.cc:270] Start()
0928 01:55:42.181984 (+   176us) write_op.cc:276] Timestamp: P: 1790560527923119 usec, L: 0
0928 01:55:42.183326 (+  1342us) write_op.cc:270] Start()
0928 01:55:42.183560 (+   234us) write_op.cc:276] Timestamp: P: 1790560528036525 usec, L: 0
0928 01:55:42.185136 (+  1576us) write_op.cc:270] Start()
0928 01:55:42.185312 (+   176us) write_op.cc:276] Timestamp: P: 1790560528040012 usec, L: 0
0928 01:55:42.186445 (+  1133us) write_op.cc:270] Start()
0928 01:55:42.186587 (+   142us) write_op.cc:276] Timestamp: P: 1790560528078255 usec, L: 0
0928 01:55:42.187660 (+  1073us) write_op.cc:270] Start()
0928 01:55:42.188745 (+  1085us) write_op.cc:276] Timestamp: P: 1790560528129683 usec, L: 0
0928 01:55:42.230962 (+ 42217us) write_op.cc:270] Start()
0928 01:55:42.231052 (+    90us) write_op.cc:276] Timestamp: P: 1790560528485821 usec, L: 0
0928 01:55:42.231686 (+   634us) write_op.cc:270] Start()
0928 01:55:42.231760 (+    74us) write_op.cc:276] Timestamp: P: 1790560528492328 usec, L: 0
0928 01:55:42.245115 (+ 13355us) write_op.cc:270] Start()
0928 01:55:42.245222 (+   107us) write_op.cc:276] Timestamp: P: 1790560528574955 usec, L: 0
0928 01:55:42.245972 (+   750us) write_op.cc:270] Start()
0928 01:55:42.246058 (+    86us) write_op.cc:276] Timestamp: P: 1790560528610173 usec, L: 0
0928 01:55:42.246615 (+   557us) write_op.cc:270] Start()
0928 01:55:42.246703 (+    88us) write_op.cc:276] Timestamp: P: 1790560528634131 usec, L: 0
0928 01:55:42.247315 (+   612us) write_op.cc:270] Start()
0928 01:55:42.247387 (+    72us) write_op.cc:276] Timestamp: P: 1790560528637810 usec, L: 0
0928 01:55:42.247907 (+   520us) write_op.cc:270] Start()
0928 01:55:42.247978 (+    71us) write_op.cc:276] Timestamp: P: 1790560528689362 usec, L: 0
0928 01:55:42.256129 (+  8151us) write_op.cc:270] Start()
0928 01:55:42.256510 (+   381us) write_op.cc:276] Timestamp: P: 1790560528791094 usec, L: 0
0928 01:55:42.257439 (+   929us) write_op.cc:270] Start()
0928 01:55:42.257519 (+    80us) write_op.cc:276] Timestamp: P: 1790560528910183 usec, L: 0
0928 01:55:42.258091 (+   572us) write_op.cc:270] Start()
0928 01:55:42.258161 (+    70us) write_op.cc:276] Timestamp: P: 1790560529013829 usec, L: 0
0928 01:55:42.258690 (+   529us) write_op.cc:270] Start()
0928 01:55:42.258797 (+   107us) write_op.cc:276] Timestamp: P: 1790560529289577 usec, L: 0
0928 01:55:42.259284 (+   487us) write_op.cc:270] Start()
0928 01:55:42.259353 (+    69us) write_op.cc:276] Timestamp: P: 1790560529448799 usec, L: 0
0928 01:55:42.304786 (+ 45433us) write_op.cc:270] Start()
0928 01:55:42.304879 (+    93us) write_op.cc:276] Timestamp: P: 1790560529948647 usec, L: 0
0928 01:55:42.307384 (+  2505us) write_op.cc:270] Start()
0928 01:55:42.307473 (+    89us) write_op.cc:276] Timestamp: P: 1790560530012416 usec, L: 0
0928 01:55:42.308090 (+   617us) write_op.cc:270] Start()
0928 01:55:42.308169 (+    79us) write_op.cc:276] Timestamp: P: 1790560530025479 usec, L: 0
0928 01:55:42.312916 (+  4747us) write_op.cc:270] Start()
0928 01:55:42.313946 (+  1030us) write_op.cc:276] Timestamp: P: 1790560530060131 usec, L: 0
0928 01:55:42.314559 (+   613us) write_op.cc:270] Start()
0928 01:55:42.314649 (+    90us) write_op.cc:276] Timestamp: P: 1790560530064394 usec, L: 0
0928 01:55:42.343349 (+ 28700us) write_op.cc:270] Start()
0928 01:55:42.343473 (+   124us) write_op.cc:276] Timestamp: P: 1790560530073672 usec, L: 0
0928 01:55:42.344168 (+   695us) write_op.cc:270] Start()
0928 01:55:42.344271 (+   103us) write_op.cc:276] Timestamp: P: 1790560530209897 usec, L: 0
0928 01:55:42.348589 (+  4318us) write_op.cc:270] Start()
0928 01:55:42.348684 (+    95us) write_op.cc:276] Timestamp: P: 1790560530285920 usec, L: 0
0928 01:55:42.349245 (+   561us) write_op.cc:270] Start()
0928 01:55:42.349333 (+    88us) write_op.cc:276] Timestamp: P: 1790560530293160 usec, L: 0
0928 01:55:42.349903 (+   570us) write_op.cc:270] Start()
0928 01:55:42.349975 (+    72us) write_op.cc:276] Timestamp: P: 1790560530478077 usec, L: 0
0928 01:55:42.350682 (+   707us) write_op.cc:270] Start()
0928 01:55:42.350762 (+    80us) write_op.cc:276] Timestamp: P: 1790560530866917 usec, L: 0
0928 01:55:42.351356 (+   594us) write_op.cc:270] Start()
0928 01:55:42.351434 (+    78us) write_op.cc:276] Timestamp: P: 1790560530902714 usec, L: 0
0928 01:55:42.351883 (+   449us) write_op.cc:270] Start()
0928 01:55:42.351949 (+    66us) write_op.cc:276] Timestamp: P: 1790560530946402 usec, L: 0
0928 01:55:42.352491 (+   542us) write_op.cc:270] Start()
0928 01:55:42.352558 (+    67us) write_op.cc:276] Timestamp: P: 1790560531024685 usec, L: 0
0928 01:55:42.353037 (+   479us) write_op.cc:270] Start()
0928 01:55:42.353103 (+    66us) write_op.cc:276] Timestamp: P: 1790560531075468 usec, L: 0
0928 01:55:42.353768 (+   665us) write_op.cc:270] Start()
0928 01:55:42.395167 (+ 41399us) write_op.cc:276] Timestamp: P: 1790560531093495 usec, L: 0
0928 01:55:42.397300 (+  2133us) write_op.cc:270] Start()
0928 01:55:42.397389 (+    89us) write_op.cc:276] Timestamp: P: 1790560531181274 usec, L: 0
0928 01:55:42.397951 (+   562us) write_op.cc:270] Start()
0928 01:55:42.398149 (+   198us) write_op.cc:276] Timestamp: P: 1790560531228728 usec, L: 0
0928 01:55:42.398694 (+   545us) write_op.cc:270] Start()
0928 01:55:42.398803 (+   109us) write_op.cc:276] Timestamp: P: 1790560531337654 usec, L: 0
0928 01:55:42.399300 (+   497us) write_op.cc:270] Start()
0928 01:55:42.399404 (+   104us) write_op.cc:276] Timestamp: P: 1790560531343690 usec, L: 0
0928 01:55:42.399931 (+   527us) write_op.cc:270] Start()
0928 01:55:42.400026 (+    95us) write_op.cc:276] Timestamp: P: 1790560531393230 usec, L: 0
0928 01:55:42.444691 (+ 44665us) write_op.cc:270] Start()
0928 01:55:42.444820 (+   129us) write_op.cc:276] Timestamp: P: 1790560531418132 usec, L: 0
0928 01:55:42.445382 (+   562us) write_op.cc:270] Start()
0928 01:55:42.445467 (+    85us) write_op.cc:276] Timestamp: P: 1790560531431035 usec, L: 0
0928 01:55:42.445906 (+   439us) write_op.cc:270] Start()
0928 01:55:42.446007 (+   101us) write_op.cc:276] Timestamp: P: 1790560531534814 usec, L: 0
0928 01:55:42.446438 (+   431us) write_op.cc:270] Start()
0928 01:55:42.446505 (+    67us) write_op.cc:276] Timestamp: P: 1790560531576394 usec, L: 0
0928 01:55:42.446953 (+   448us) write_op.cc:270] Start()
0928 01:55:42.447025 (+    72us) write_op.cc:276] Timestamp: P: 1790560531588277 usec, L: 0
0928 01:55:42.447474 (+   449us) write_op.cc:270] Start()
0928 01:55:42.447549 (+    75us) write_op.cc:276] Timestamp: P: 1790560531612839 usec, L: 0
0928 01:55:42.447972 (+   423us) write_op.cc:270] Start()
0928 01:55:42.448038 (+    66us) write_op.cc:276] Timestamp: P: 1790560531693122 usec, L: 0
0928 01:55:42.565016 (+116978us) write_op.cc:270] Start()
0928 01:55:42.565117 (+   101us) write_op.cc:276] Timestamp: P: 1790560531698138 usec, L: 0
0928 01:55:42.565614 (+   497us) write_op.cc:270] Start()
0928 01:55:42.565711 (+    97us) write_op.cc:276] Timestamp: P: 1790560531763609 usec, L: 0
0928 01:55:42.568920 (+  3209us) write_op.cc:270] Start()
0928 01:55:42.569000 (+    80us) write_op.cc:276] Timestamp: P: 1790560531765890 usec, L: 0
0928 01:55:42.570823 (+  1823us) write_op.cc:270] Start()
0928 01:55:42.570924 (+   101us) write_op.cc:276] Timestamp: P: 1790560531770858 usec, L: 0
0928 01:55:42.571392 (+   468us) write_op.cc:270] Start()
0928 01:55:42.571488 (+    96us) write_op.cc:276] Timestamp: P: 1790560531803005 usec, L: 0
0928 01:55:42.571967 (+   479us) write_op.cc:270] Start()
0928 01:55:42.572035 (+    68us) write_op.cc:276] Timestamp: P: 1790560531857742 usec, L: 0
0928 01:55:42.574790 (+  2755us) write_op.cc:270] Start()
0928 01:55:42.574878 (+    88us) write_op.cc:276] Timestamp: P: 1790560531899761 usec, L: 0
0928 01:55:42.575364 (+   486us) write_op.cc:270] Start()
0928 01:55:42.575474 (+   110us) write_op.cc:276] Timestamp: P: 1790560531935686 usec, L: 0
0928 01:55:42.576008 (+   534us) write_op.cc:270] Start()
0928 01:55:42.576103 (+    95us) write_op.cc:276] Timestamp: P: 1790560531999758 usec, L: 0
0928 01:55:42.576644 (+   541us) write_op.cc:270] Start()
0928 01:55:42.576876 (+   232us) write_op.cc:276] Timestamp: P: 1790560532002181 usec, L: 0
0928 01:55:42.577359 (+   483us) write_op.cc:270] Start()
0928 01:55:42.577432 (+    73us) write_op.cc:276] Timestamp: P: 1790560532004487 usec, L: 0
0928 01:55:42.578026 (+   594us) write_op.cc:270] Start()
0928 01:55:42.578145 (+   119us) write_op.cc:276] Timestamp: P: 1790560532023259 usec, L: 0
0928 01:55:42.578646 (+   501us) write_op.cc:270] Start()
0928 01:55:42.578735 (+    89us) write_op.cc:276] Timestamp: P: 1790560532039462 usec, L: 0
0928 01:55:42.579414 (+   679us) write_op.cc:270] Start()
0928 01:55:42.579492 (+    78us) write_op.cc:276] Timestamp: P: 1790560532053880 usec, L: 0
0928 01:55:42.579992 (+   500us) write_op.cc:270] Start()
0928 01:55:42.580079 (+    87us) write_op.cc:276] Timestamp: P: 1790560532074911 usec, L: 0
0928 01:55:42.580653 (+   574us) write_op.cc:270] Start()
0928 01:55:42.580864 (+   211us) write_op.cc:276] Timestamp: P: 1790560532318124 usec, L: 0
0928 01:55:42.581321 (+   457us) write_op.cc:270] Start()
0928 01:55:42.581390 (+    69us) write_op.cc:276] Timestamp: P: 1790560532453373 usec, L: 0
0928 01:55:42.581993 (+   603us) write_op.cc:270] Start()
0928 01:55:42.582071 (+    78us) write_op.cc:276] Timestamp: P: 1790560532459106 usec, L: 0
0928 01:55:42.582482 (+   411us) write_op.cc:270] Start()
0928 01:55:42.582550 (+    68us) write_op.cc:276] Timestamp: P: 1790560532511591 usec, L: 0
0928 01:55:42.583008 (+   458us) write_op.cc:270] Start()
0928 01:55:42.583073 (+    65us) write_op.cc:276] Timestamp: P: 1790560532660010 usec, L: 0
0928 01:55:42.583616 (+   543us) write_op.cc:270] Start()
0928 01:55:42.583691 (+    75us) write_op.cc:276] Timestam
I20260928 01:55:53.314294 19890 tablet_bootstrap.cc:492] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:53.319422 21113 raft_consensus.cc:515] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.321839 19896 raft_consensus.cc:359] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:53.322561 19896 raft_consensus.cc:385] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:53.322810 19896 raft_consensus.cc:740] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:53.323501 19896 consensus_queue.cc:260] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:53.325325 19556 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:53.325873 21098 consensus_queue.cc:1048] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:53.328287 21098 raft_consensus.cc:2804] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:53.328677 21098 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:53.328987 21098 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:53.336176 19890 tablet_bootstrap.cc:654] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:53.344784 19105 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0669f9f51b05479aa9715e06d4c42423 consensus state has no leader
I20260928 01:55:53.351557 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602706a3fbc438d8d448c9ac057087c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:55:53.355134 19553 leader_election.cc:343] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.362178 20029 tablet_bootstrap.cc:492] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:53.362977 21113 leader_election.cc:290] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:53.373762 19896 ts_tablet_manager.cc:1434] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.000s
W20260928 01:55:53.376631 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 51401.8us
I20260928 01:55:53.376821 20029 ts_tablet_manager.cc:1403] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.238s	user 0.009s	sys 0.004s
I20260928 01:55:53.389362 19896 tablet_bootstrap.cc:492] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:53.379897 21098 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.400084 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602706a3fbc438d8d448c9ac057087c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:53.400259 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:53.400904 19468 raft_consensus.cc:3060] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:53.401791 19553 leader_election.cc:343] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.386372 20029 raft_consensus.cc:359] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:53.406586 20029 raft_consensus.cc:385] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:53.407821 21098 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:53.411664 20029 raft_consensus.cc:740] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:53.414561 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:53.415228 19470 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:53.416682 21098 consensus_queue.cc:1048] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:53.419688 20029 consensus_queue.cc:260] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:53.442695 20860 tablet_loader.cc:96] loaded metadata for tablet 81c205176cb94d9f861cc140560944d4 (table default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765])
I20260928 01:55:53.444047 20860 tablet_loader.cc:96] loaded metadata for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9])
I20260928 01:55:53.445320 20860 tablet_loader.cc:96] loaded metadata for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780])
I20260928 01:55:53.454617 20029 ts_tablet_manager.cc:1434] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.001s
I20260928 01:55:53.469182 19890 tablet_bootstrap.cc:492] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:53.469623 19890 ts_tablet_manager.cc:1403] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.001s
I20260928 01:55:53.470995 19470 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:53.472064 21113 raft_consensus.cc:493] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.472760 21113 raft_consensus.cc:515] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.478197 21113 leader_election.cc:290] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:53.496693 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:53.497426 19470 raft_consensus.cc:2468] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:53.500113 19556 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:53.501860 21113 raft_consensus.cc:2804] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:53.502172 19556 leader_election.cc:304] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:53.502647 21113 raft_consensus.cc:697] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:53.502950 21056 raft_consensus.cc:2804] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:53.503836 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:53.483412 19890 raft_consensus.cc:359] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.503616 21113 consensus_queue.cc:237] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.504504 19890 raft_consensus.cc:385] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:53.503314 21056 raft_consensus.cc:493] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:53.505134 21056 raft_consensus.cc:3060] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:53.504799 19890 raft_consensus.cc:740] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:53.519948 19890 consensus_queue.cc:260] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.526417 19890 ts_tablet_manager.cc:1434] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260928 01:55:53.519104 20860 tablet_loader.cc:96] loaded metadata for tablet 8b48eacc1cec49baabe2d87bdd06cd5c (table default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd])
I20260928 01:55:53.534063 20860 tablet_loader.cc:96] loaded metadata for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4])
I20260928 01:55:53.535326 20860 tablet_loader.cc:96] loaded metadata for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca])
I20260928 01:55:53.537788 21056 raft_consensus.cc:515] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.543884 19896 tablet_bootstrap.cc:654] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:53.558089 20860 tablet_loader.cc:96] loaded metadata for tablet 8df69eb3a37445ed8a2be0ef3bf32cdb (table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624])
I20260928 01:55:53.564628 20029 tablet_bootstrap.cc:492] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:53.574518 20860 tablet_loader.cc:96] loaded metadata for tablet 8e39fce4f0a149a898de678d73052f52 (table default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55])
I20260928 01:55:53.548404 19890 tablet_bootstrap.cc:492] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:53.560534 19553 leader_election.cc:343] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.574476 19468 raft_consensus.cc:2468] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:53.588622 19556 leader_election.cc:304] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:53.589555 21153 raft_consensus.cc:2804] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:53.590065 21153 raft_consensus.cc:697] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:53.590884 21153 consensus_queue.cc:237] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.591523 20860 tablet_loader.cc:96] loaded metadata for tablet 9690a224bb004152ba65d525cc10bd9f (table default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5])
I20260928 01:55:53.602654 19890 tablet_bootstrap.cc:654] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:53.607160 21056 leader_election.cc:290] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:53.609150 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:53.610019 19468 raft_consensus.cc:3060] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:53.612834 20860 tablet_loader.cc:96] loaded metadata for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7])
I20260928 01:55:53.615150 20860 tablet_loader.cc:96] loaded metadata for tablet 99e806ba248746d2bde39a2eb76b17df (table default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542])
I20260928 01:55:53.616431 20860 tablet_loader.cc:96] loaded metadata for tablet 9a9c2db89fb8467d91c6bd01985d8b40 (table default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3])
I20260928 01:55:53.616869 21118 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.617573 21118 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.618046 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:53.618649 20860 tablet_loader.cc:96] loaded metadata for tablet 9ec3f279423a46c1acb1cbfecf4a608a (table default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b])
I20260928 01:55:53.619781 20860 tablet_loader.cc:96] loaded metadata for tablet 9f80b652a19a41968d1bfbaaf020b721 (table default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1])
I20260928 01:55:53.620123 21118 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:53.622514 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:53.624765 19412 leader_election.cc:343] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.629676 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:53.631249 19409 leader_election.cc:343] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.631714 19409 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:53.632548 21118 raft_consensus.cc:2749] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:53.644872 20029 tablet_bootstrap.cc:654] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:53.656638 19896 tablet_bootstrap.cc:492] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:53.657128 19896 ts_tablet_manager.cc:1403] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.268s	user 0.011s	sys 0.002s
I20260928 01:55:53.663234 19890 tablet_bootstrap.cc:492] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:53.663704 19890 ts_tablet_manager.cc:1403] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.000s
I20260928 01:55:53.666364 19890 raft_consensus.cc:359] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.667068 19890 raft_consensus.cc:385] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:53.667331 19890 raft_consensus.cc:740] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:53.667928 19890 consensus_queue.cc:260] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.678287 19890 ts_tablet_manager.cc:1434] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260928 01:55:53.679242 19890 tablet_bootstrap.cc:492] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:53.685302 20860 tablet_loader.cc:96] loaded metadata for tablet a01b795606604960bc7cafab4ff6f3d0 (table default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae])
I20260928 01:55:53.686465 20860 tablet_loader.cc:96] loaded metadata for tablet a12bafcc09ef4342bff89b0475f721af (table default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b])
I20260928 01:55:53.687564 20860 tablet_loader.cc:96] loaded metadata for tablet a1710b95678440b1bff8a92080d43272 (table default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d])
I20260928 01:55:53.688745 20860 tablet_loader.cc:96] loaded metadata for tablet a23b494afa1f45988d447519356d2b03 (table default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305])
I20260928 01:55:53.690145 19896 raft_consensus.cc:359] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.690840 19896 raft_consensus.cc:385] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:53.691214 19896 raft_consensus.cc:740] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:53.691995 19896 consensus_queue.cc:260] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.703384 19468 raft_consensus.cc:2468] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:53.704720 19556 leader_election.cc:304] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:53.713188 19896 ts_tablet_manager.cc:1434] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260928 01:55:53.717300 20860 tablet_loader.cc:96] loaded metadata for tablet a735102c576640b69323cacb50393a42 (table default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e])
I20260928 01:55:53.718814 20860 tablet_loader.cc:96] loaded metadata for tablet a82d3233e4514813b22121f75d11eebc (table default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151])
I20260928 01:55:53.733026 20029 tablet_bootstrap.cc:492] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:53.733479 20029 ts_tablet_manager.cc:1403] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.171s	user 0.009s	sys 0.003s
I20260928 01:55:53.736555 20029 raft_consensus.cc:359] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.737236 20029 raft_consensus.cc:385] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:53.746625 20860 tablet_loader.cc:96] loaded metadata for tablet b4b520e89c364692af1aedde2a59c3da (table default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca])
I20260928 01:55:53.748129 20860 tablet_loader.cc:96] loaded metadata for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5])
I20260928 01:55:53.748917 19896 tablet_bootstrap.cc:492] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:53.755538 19896 tablet_bootstrap.cc:654] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:53.764029 20860 tablet_loader.cc:96] loaded metadata for tablet b8cacb4a90a54cd3b5b3e7a9310e06ed (table default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d])
I20260928 01:55:53.770531 20860 tablet_loader.cc:96] loaded metadata for tablet ba89039dcfa848159112caa76802b5f1 (table default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749])
I20260928 01:55:53.774041 21118 raft_consensus.cc:493] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.774588 21118 raft_consensus.cc:515] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:53.779217 21118 leader_election.cc:290] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:53.780810 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a73835e2854976b40b31fe752d1b1b" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:53.782800 19409 leader_election.cc:343] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.783438 20860 tablet_loader.cc:96] loaded metadata for tablet bab12ba3e1f542949e3f203dae0fa80e (table default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb])
I20260928 01:55:53.786087 20860 tablet_loader.cc:96] loaded metadata for tablet c2597de2c4304074977db5a3c0426814 (table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e])
I20260928 01:55:53.737488 20029 raft_consensus.cc:740] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:53.791153 20029 consensus_queue.cc:260] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.793560 20029 ts_tablet_manager.cc:1434] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260928 01:55:53.788018 20860 tablet_loader.cc:96] loaded metadata for tablet c53d75604ee3405d83fe9ecaa824ea68 (table default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513])
I20260928 01:55:53.797562 20860 tablet_loader.cc:96] loaded metadata for tablet c74a4a00552c4a14a871a59465524f1c (table default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a])
I20260928 01:55:53.725677 19890 tablet_bootstrap.cc:654] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:53.784392 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a73835e2854976b40b31fe752d1b1b" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:53.717973 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 95611.4us
W20260928 01:55:53.804596 19553 leader_election.cc:343] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:53.804611 19412 leader_election.cc:343] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:53.805096 19412 leader_election.cc:304] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:53.799722 20860 tablet_loader.cc:96] loaded metadata for tablet c8fd6b965d22477aaee9bafccb2069b1 (table default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02])
I20260928 01:55:53.807869 20029 tablet_bootstrap.cc:492] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:53.808360 20860 tablet_loader.cc:96] loaded metadata for tablet c9f3e966ab0d46d187fb9daa356b16fc (table default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b])
I20260928 01:55:53.712749 21056 raft_consensus.cc:2804] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:53.809556 20860 tablet_loader.cc:96] loaded metadata for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e])
I20260928 01:55:53.811470 20860 tablet_loader.cc:96] loaded metadata for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305])
I20260928 01:55:53.810822 21098 raft_consensus.cc:493] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.813014 21098 raft_consensus.cc:515] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.827365 19890 tablet_bootstrap.cc:492] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:53.828938 19890 ts_tablet_manager.cc:1403] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.150s	user 0.018s	sys 0.000s
I20260928 01:55:53.830295 21123 raft_consensus.cc:2749] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:53.831171 20860 tablet_loader.cc:96] loaded metadata for tablet d114d5ba862044b4b88eee27395db7e3 (table default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb])
I20260928 01:55:53.831178 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:53.831789 19468 raft_consensus.cc:2468] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:53.834573 20860 tablet_loader.cc:96] loaded metadata for tablet d7774406b22547d29d9d42c969cf0874 (table default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa])
I20260928 01:55:53.839509 21166 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.846390 19556 leader_election.cc:304] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:53.846903 19890 raft_consensus.cc:359] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.847353 21153 raft_consensus.cc:493] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.847579 19890 raft_consensus.cc:385] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:53.847913 19890 raft_consensus.cc:740] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:53.847781 21153 raft_consensus.cc:515] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.848078 21113 raft_consensus.cc:2804] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:53.848843 21113 raft_consensus.cc:493] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:53.848575 19890 consensus_queue.cc:260] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.849457 21113 raft_consensus.cc:3060] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:53.849758 21153 leader_election.cc:290] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:53.850775 19890 ts_tablet_manager.cc:1434] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.005s
I20260928 01:55:53.851727 19890 tablet_bootstrap.cc:492] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:53.847457 21056 raft_consensus.cc:697] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:53.854938 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:53.855983 20029 tablet_bootstrap.cc:654] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:53.861910 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b222e5366a64f52bc97acd551c7a067" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:53.865598 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b222e5366a64f52bc97acd551c7a067" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:53.866268 19468 raft_consensus.cc:2468] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:53.867583 19556 leader_election.cc:304] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:53.872607 21166 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
W20260928 01:55:53.873087 19102 leader_election.cc:336] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c17b7f9972364c76893311539b569e0f (127.18.161.61:43775): Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.645s (SENT)
I20260928 01:55:53.873481 19102 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:55:53.874223 19890 tablet_bootstrap.cc:654] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:53.874351 21153 raft_consensus.cc:2804] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:53.874650 21153 raft_consensus.cc:493] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:53.843349 20860 tablet_loader.cc:96] loaded metadata for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4])
I20260928 01:55:53.876869 20860 tablet_loader.cc:96] loaded metadata for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e])
I20260928 01:55:53.877128 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:53.877871 20860 tablet_loader.cc:96] loaded metadata for tablet e6206afe245740b1819069a48e8b548e (table default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37])
I20260928 01:55:53.879347 20860 tablet_loader.cc:96] loaded metadata for tablet e8f6ce7612d4463ebe95e07557bca4e7 (table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67])
I20260928 01:55:53.880545 20860 tablet_loader.cc:96] loaded metadata for tablet e927cd8a991f46278c2bb663cee7f753 (table default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75])
I20260928 01:55:53.881713 20860 tablet_loader.cc:96] loaded metadata for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba])
I20260928 01:55:53.874989 21153 raft_consensus.cc:3060] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:53.912719 20860 tablet_loader.cc:96] loaded metadata for tablet eb014699060e4a6caf4caaf33c31710a (table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f])
I20260928 01:55:53.914790 20860 tablet_loader.cc:96] loaded metadata for tablet ef752c3b4b22490ab42292f61278da52 (table default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619])
I20260928 01:55:53.896406 21056 consensus_queue.cc:237] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.919335 20029 tablet_bootstrap.cc:492] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:53.929173 20860 tablet_loader.cc:96] loaded metadata for tablet f7b78eb499d6418f8877bf3b59bbbec2 (table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d])
I20260928 01:55:53.930358 20860 tablet_loader.cc:96] loaded metadata for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9])
I20260928 01:55:53.931550 20860 tablet_loader.cc:96] loaded metadata for tablet fa3b9ec9f88342c0aa77c0fc92d26205 (table default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87])
I20260928 01:55:53.941859 21166 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:53.942682 21171 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:55:53.945531 20029 ts_tablet_manager.cc:1403] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.151s	user 0.012s	sys 0.000s
W20260928 01:55:53.945587 19553 leader_election.cc:343] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:53.946616 19553 leader_election.cc:343] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:53.947363 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 74311.4us
I20260928 01:55:53.948719 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:53.955467 19896 tablet_bootstrap.cc:492] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:53.955385 20860 tablet_loader.cc:96] loaded metadata for tablet fb159b3aad31479f80683b0d80549cc3 (table default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b])
I20260928 01:55:53.966205 20029 raft_consensus.cc:359] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.966917 20029 raft_consensus.cc:385] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:53.967181 20029 raft_consensus.cc:740] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:53.967820 20860 tablet_loader.cc:96] loaded metadata for tablet fc428ccbf88e4d5cbae197cb67e9a0a5 (table default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14])
I20260928 01:55:53.969264 20860 tablet_loader.cc:96] loaded metadata for tablet fcf1b727e86a43b08bd464647fa529a3 (table default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619])
I20260928 01:55:53.985343 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:53.918890 21153 raft_consensus.cc:515] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.952386 19890 tablet_bootstrap.cc:492] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:53.988413 21166 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:55:53.988785 19890 ts_tablet_manager.cc:1403] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.137s	user 0.017s	sys 0.004s
I20260928 01:55:53.989864 21153 leader_election.cc:290] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:53.900929 21098 leader_election.cc:290] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:53.991148 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 44561.5us
I20260928 01:55:53.992682 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b222e5366a64f52bc97acd551c7a067" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:53.994683 21098 raft_consensus.cc:493] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:53.995235 21098 raft_consensus.cc:515] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.991149 19890 raft_consensus.cc:359] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.996874 19890 raft_consensus.cc:385] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:53.997129 19890 raft_consensus.cc:740] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:53.997780 21098 leader_election.cc:290] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:53.997905 19890 consensus_queue.cc:260] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:53.999964 19890 ts_tablet_manager.cc:1434] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260928 01:55:54.000995 19890 tablet_bootstrap.cc:492] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:54.001540 19896 ts_tablet_manager.cc:1403] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.253s	user 0.005s	sys 0.013s
W20260928 01:55:54.012841 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 52341.9us
I20260928 01:55:54.016005 21083 raft_consensus.cc:493] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:54.017541 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daa1b799e0d408287edc03988f5b683" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:54.016552 21083 raft_consensus.cc:515] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:54.018409 19475 raft_consensus.cc:2468] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:54.019393 19890 tablet_bootstrap.cc:654] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:54.020715 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b222e5366a64f52bc97acd551c7a067" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:54.020815 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:54.021283 19476 raft_consensus.cc:3060] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:54.021602 20860 catalog_manager.cc:1525] Time spent T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: Loading table and tablet metadata into memory: real 7.736s	user 0.410s	sys 0.087s
I20260928 01:55:54.021898 20860 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 01:55:54.024350 19200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 4 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f"
I20260928 01:55:54.026098 19556 leader_election.cc:304] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:54.027663 21175 raft_consensus.cc:2804] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:54.029075 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daa1b799e0d408287edc03988f5b683" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:54.029621 19767 raft_consensus.cc:2468] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:54.030797 21175 raft_consensus.cc:493] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:54.035535 21083 leader_election.cc:290] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:54.036406 21175 raft_consensus.cc:3060] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:54.042673 19196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:55:54.043882 19196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 364) took 3828 ms (client timeout 686 ms). Trace:
W20260928 01:55:54.044404 19196 rpcz_store.cc:269] 0928 01:55:50.215891 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:50.216144 (+   253us) service_pool.cc:224] Handling call
0928 01:55:54.043784 (+3827640us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 01:55:54.046172 19196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 367) took 814 ms (client timeout 645 ms). Trace:
W20260928 01:55:54.046553 19196 rpcz_store.cc:269] 0928 01:55:53.232088 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:54.045816 (+813728us) service_pool.cc:211] Skipping call since client already timed out
0928 01:55:54.046100 (+   284us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 01:55:54.047797 19201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:55:54.048590 19201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 363) took 6824 ms (client timeout 624 ms). Trace:
W20260928 01:55:54.048897 19201 rpcz_store.cc:269] 0928 01:55:47.224389 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:47.225046 (+   657us) service_pool.cc:224] Handling call
0928 01:55:54.048521 (+6823475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:54.050277 19194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:55:54.051558 19194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 366) took 1528 ms (client timeout 645 ms). Trace:
W20260928 01:55:54.051923 19194 rpcz_store.cc:269] 0928 01:55:52.523356 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:52.523643 (+   287us) service_pool.cc:224] Handling call
0928 01:55:54.051477 (+1527834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:54.053884 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 4 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f"
W20260928 01:55:54.033484 19553 leader_election.cc:343] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:54.056010 19197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 9) took 5395 ms (client timeout 723 ms). Trace:
W20260928 01:55:54.056402 19197 rpcz_store.cc:269] 0928 01:55:48.660155 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:48.660463 (+   308us) service_pool.cc:224] Handling call
0928 01:55:54.055935 (+5395472us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:54.057345 19195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:55:54.058581 19195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 365) took 3055 ms (client timeout 686 ms). Trace:
I20260928 01:55:53.967804 20029 consensus_queue.cc:260] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:54.058933 19195 rpcz_store.cc:269] 0928 01:55:51.002968 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:51.003197 (+   229us) service_pool.cc:224] Handling call
0928 01:55:54.058513 (+3055316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:54.060185 19203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:54.060318 19890 tablet_bootstrap.cc:492] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:54.060922 19890 ts_tablet_manager.cc:1403] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.060s	user 0.004s	sys 0.006s
I20260928 01:55:54.060915 20029 ts_tablet_manager.cc:1434] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.112s	user 0.006s	sys 0.000s
W20260928 01:55:54.061019 19203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 362) took 7546 ms (client timeout 624 ms). Trace:
W20260928 01:55:54.061360 19203 rpcz_store.cc:269] 0928 01:55:46.514223 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:46.514363 (+   140us) service_pool.cc:224] Handling call
0928 01:55:54.060928 (+7546565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:54.062650 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 4 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:55:54.063531 19202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 5) took 6290 ms (client timeout 711 ms). Trace:
I20260928 01:55:54.063604 19890 raft_consensus.cc:359] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:54.064375 19890 raft_consensus.cc:385] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:54.053009 19198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 4 candidate_status { last_received { term: 3 index: 340 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:54.064754 19890 raft_consensus.cc:740] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
W20260928 01:55:54.065333 19198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 8) took 5538 ms (client timeout 711 ms). Trace:
I20260928 01:55:54.065419 19890 consensus_queue.cc:260] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:54.065685 19198 rpcz_store.cc:269] 0928 01:55:48.526950 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:48.527446 (+   496us) service_pool.cc:224] Handling call
0928 01:55:54.065265 (+5537819us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 01:55:54.063876 19202 rpcz_store.cc:269] 0928 01:55:47.772808 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:47.773075 (+   267us) service_pool.cc:224] Handling call
0928 01:55:54.063455 (+6290380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:54.032352 21113 raft_consensus.cc:515] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.055141 19896 raft_consensus.cc:359] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.081099 19896 raft_consensus.cc:385] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:54.081468 19896 raft_consensus.cc:740] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:54.082141 19200 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e48edd841a42d08a480be209f0d294 in term 4.
I20260928 01:55:54.082229 19896 consensus_queue.cc:260] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.084808 19896 ts_tablet_manager.cc:1434] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.083s	user 0.004s	sys 0.002s
I20260928 01:55:54.085539 19189 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:60098 (request call id 4) took 6425 ms. Trace:
I20260928 01:55:54.088840 19189 rpcz_store.cc:276] 0928 01:55:47.659697 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:47.659907 (+   210us) service_pool.cc:224] Handling call
0928 01:55:54.085046 (+6425139us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b5400030554. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbaaa1 00007f2fcdc5a7b9 00007f2fcfa8a076 00007f2fcfacd427 00007f2fcd671534 00007f2fcd6714c2 00007f2fcd6713f1 00007f2fcd67136c 00007f2fcd670622 00007f2fcb92009c 00007f2fcb91f4d6
0928 01:55:54.085335 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96928640}
I20260928 01:55:54.097144 19199 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Refusing update from remote peer 04e48edd841a42d08a480be209f0d294: Log matching property violated. Preceding OpId in replica: term: 3 index: 340. Preceding OpId from leader: term: 4 index: 341. (index mismatch)
I20260928 01:55:54.098819 19199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 7) took 5572 ms. Trace:
I20260928 01:55:54.099238 19199 rpcz_store.cc:276] 0928 01:55:48.526507 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:48.527182 (+   675us) service_pool.cc:224] Handling call
0928 01:55:54.096551 (+5569369us) raft_consensus.cc:1471] Updating replica for 0 ops
0928 01:55:54.097540 (+   989us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:55:54.098536 (+   996us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b5400030550. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbaaa1 00007f2fcdc5106d 00007f2fcecb1659 00007f2fcd32dd34 00007f2fcd32dcc2 00007f2fcd32dbf1 00007f2fcd32db6c 00007f2fcd32ce22 00007f2fcb92009c 00007f2fcb91f4d6 00007f2fcb91ee7f
0928 01:55:54.098729 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122135296}
I20260928 01:55:54.066919 19890 ts_tablet_manager.cc:1434] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260928 01:55:54.100946 19200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 6) took 6166 ms (client timeout 723 ms). Trace:
W20260928 01:55:54.101339 19200 rpcz_store.cc:269] 0928 01:55:47.934861 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:47.935244 (+   383us) service_pool.cc:224] Handling call
0928 01:55:54.100828 (+6165584us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:54.101886 21164 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 341, Last known committed idx: 340, Time since last communication: 0.001s
I20260928 01:55:54.102725 19890 tablet_bootstrap.cc:492] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:54.108101 19890 tablet_bootstrap.cc:654] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:54.126587 20860 catalog_manager.cc:1308] Loaded cluster ID: 726a03a5ce124d548da65567db2a283d
I20260928 01:55:54.127007 20860 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:55:54.135028 19890 tablet_bootstrap.cc:492] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:54.135630 19890 ts_tablet_manager.cc:1403] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.001s
I20260928 01:55:54.138322 19890 raft_consensus.cc:359] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.148348 19890 raft_consensus.cc:385] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:54.151717 19767 raft_consensus.cc:3060] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:54.154675 19890 raft_consensus.cc:740] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:54.155496 19890 consensus_queue.cc:260] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.157615 19890 ts_tablet_manager.cc:1434] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.003s
I20260928 01:55:54.158609 19890 tablet_bootstrap.cc:492] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:54.147996 21113 leader_election.cc:290] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:54.173223 20029 tablet_bootstrap.cc:492] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:54.177356 21173 consensus_queue.cc:1048] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:54.182232 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:54.182919 19767 raft_consensus.cc:3060] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:54.110539 19476 raft_consensus.cc:2468] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:54.112699 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:54.192152 19475 raft_consensus.cc:2393] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:54.168644 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:54.193080 19468 raft_consensus.cc:3060] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:54.195253 20860 catalog_manager.cc:1553] Loading token signing keys...
I20260928 01:55:54.196537 19890 tablet_bootstrap.cc:654] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:54.203008 19468 raft_consensus.cc:2468] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:54.205359 19703 leader_election.cc:304] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:54.205627 19556 leader_election.cc:304] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:54.206874 21083 raft_consensus.cc:2749] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:54.207268 21173 raft_consensus.cc:2804] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:54.207726 21173 raft_consensus.cc:697] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:54.208570 21173 consensus_queue.cc:237] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.218034 19890 tablet_bootstrap.cc:492] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:54.218516 19890 ts_tablet_manager.cc:1403] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.060s	user 0.003s	sys 0.006s
I20260928 01:55:54.219244 19896 tablet_bootstrap.cc:492] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:54.219657 20029 tablet_bootstrap.cc:654] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:54.220988 19890 raft_consensus.cc:359] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:54.221669 19890 raft_consensus.cc:385] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:54.221923 19890 raft_consensus.cc:740] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:54.222545 19890 consensus_queue.cc:260] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:54.237535 19890 ts_tablet_manager.cc:1434] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260928 01:55:54.238489 19890 tablet_bootstrap.cc:492] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:54.252892 19890 tablet_bootstrap.cc:654] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:54.261632 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 56081.1us
I20260928 01:55:54.262347 20976 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 01:55:54.267109 21185 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:54.267984 21185 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:54.269570 19556 leader_election.cc:304] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:54.294720 19890 tablet_bootstrap.cc:492] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:54.295198 19890 ts_tablet_manager.cc:1403] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.000s
I20260928 01:55:54.298655 19890 raft_consensus.cc:359] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.299503 19890 raft_consensus.cc:385] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:54.299850 19890 raft_consensus.cc:740] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:54.311270 19890 consensus_queue.cc:260] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.312932 20029 tablet_bootstrap.cc:492] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:54.313397 19890 ts_tablet_manager.cc:1434] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260928 01:55:54.313702 20029 ts_tablet_manager.cc:1403] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.000s
I20260928 01:55:54.314347 19890 tablet_bootstrap.cc:492] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:54.335103 20029 raft_consensus.cc:359] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.336037 20029 raft_consensus.cc:385] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:54.336449 20029 raft_consensus.cc:740] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:55:54.337478 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 67992.2us
I20260928 01:55:54.338711 21098 raft_consensus.cc:2804] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:54.339422 19890 tablet_bootstrap.cc:654] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:54.337538 20029 consensus_queue.cc:260] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.341738 20029 ts_tablet_manager.cc:1434] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.002s
I20260928 01:55:54.342724 20029 tablet_bootstrap.cc:492] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:54.343302 21098 raft_consensus.cc:697] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:54.344897 21098 consensus_queue.cc:237] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.235862 21175 raft_consensus.cc:515] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.383327 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daa1b799e0d408287edc03988f5b683" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:54.384004 19766 raft_consensus.cc:3060] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:54.390673 19766 raft_consensus.cc:2468] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:54.391302 21113 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:54.391760 21113 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.394140 21113 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:54.397519 19890 tablet_bootstrap.cc:492] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:54.398005 19890 ts_tablet_manager.cc:1403] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.084s	user 0.029s	sys 0.021s
I20260928 01:55:54.271562 21166 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e48edd841a42d08a480be209f0d294. Latest consensus state: current_term: 4 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:54.309060 20860 catalog_manager.cc:6230] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: Loaded TSK: 0
I20260928 01:55:54.398525 21166 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:54.399676 20860 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 01:55:54.399803 21098 raft_consensus.cc:493] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:54.400637 21098 raft_consensus.cc:515] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:54.403956 21098 leader_election.cc:290] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:54.401630 19890 raft_consensus.cc:359] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.404556 19890 raft_consensus.cc:385] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:54.404851 19890 raft_consensus.cc:740] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:54.405553 19890 consensus_queue.cc:260] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.408881 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba]
I20260928 01:55:54.411494 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619]
I20260928 01:55:54.411180 21113 consensus_queue.cc:1048] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260928 01:55:54.413188 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e]
I20260928 01:55:54.414976 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]
I20260928 01:55:54.416589 19890 ts_tablet_manager.cc:1434] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260928 01:55:54.416673 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2]
I20260928 01:55:54.418613 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85]
I20260928 01:55:54.420534 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]
I20260928 01:55:54.423543 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca]
I20260928 01:55:54.417879 19890 tablet_bootstrap.cc:492] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:54.427989 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae]
I20260928 01:55:54.430787 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]
I20260928 01:55:54.431053 19890 tablet_bootstrap.cc:654] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:54.433300 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9]
I20260928 01:55:54.435249 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa]
I20260928 01:55:54.438267 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_a82317fb7790483884cbb5ebcf554128 [id=292d90fe578e4470bced0890a4e646ef]
I20260928 01:55:54.440567 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]
I20260928 01:55:54.440636 21173 raft_consensus.cc:493] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:54.398835 20029 tablet_bootstrap.cc:654] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:54.442415 20860 catalog_manager.cc:1458] Failed waiting for node to catch up after master election: Illegal state: Node c17b7f9972364c76893311539b569e0f not leader. Raft Consensus state: current_term: 4 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:54.448920 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]
I20260928 01:55:54.452371 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a]
I20260928 01:55:54.360749 21175 leader_election.cc:290] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:54.459295 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305]
I20260928 01:55:54.463372 20029 tablet_bootstrap.cc:492] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:54.463877 20029 ts_tablet_manager.cc:1403] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.004s
I20260928 01:55:54.456424 19890 tablet_bootstrap.cc:492] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:54.464895 19890 ts_tablet_manager.cc:1403] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.004s
I20260928 01:55:54.466760 20029 raft_consensus.cc:359] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.467291 19890 raft_consensus.cc:359] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.467892 19890 raft_consensus.cc:385] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:54.468151 19890 raft_consensus.cc:740] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:54.469236 19890 consensus_queue.cc:260] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.470027 20029 raft_consensus.cc:385] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:54.470428 20029 raft_consensus.cc:740] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:54.471674 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75]
I20260928 01:55:54.472013 19890 ts_tablet_manager.cc:1434] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260928 01:55:54.472435 20029 consensus_queue.cc:260] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.472926 19890 tablet_bootstrap.cc:492] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:54.474484 20029 ts_tablet_manager.cc:1434] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260928 01:55:54.446022 21173 raft_consensus.cc:515] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:54.458295 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 47300.4us
I20260928 01:55:54.476986 20029 tablet_bootstrap.cc:492] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:54.466530 19767 raft_consensus.cc:2468] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:54.478127 19553 leader_election.cc:304] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:54.488741 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3]
I20260928 01:55:54.494047 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]
I20260928 01:55:54.497653 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921]
I20260928 01:55:54.500466 20029 tablet_bootstrap.cc:654] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:54.502138 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375]
I20260928 01:55:54.506897 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]
I20260928 01:55:54.508491 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]
I20260928 01:55:54.510177 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]
I20260928 01:55:54.511904 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a]
I20260928 01:55:54.514452 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]
I20260928 01:55:54.525220 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]
I20260928 01:55:54.528294 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513]
I20260928 01:55:54.535409 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]
I20260928 01:55:54.538926 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd]
I20260928 01:55:54.540951 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]
I20260928 01:55:54.546473 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]
I20260928 01:55:54.549479 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a]
I20260928 01:55:54.552696 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]
I20260928 01:55:54.555861 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]
I20260928 01:55:54.558879 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]
I20260928 01:55:54.563103 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b]
I20260928 01:55:54.568030 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]
I20260928 01:55:54.571746 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]
I20260928 01:55:54.574769 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]
I20260928 01:55:54.578449 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233]
I20260928 01:55:54.582863 21198 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:54.583410 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e]
I20260928 01:55:54.583498 21198 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:54.588687 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765]
I20260928 01:55:54.591569 19200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:54.592696 21198 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:54.595176 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7]
I20260928 01:55:54.598803 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb]
I20260928 01:55:54.602594 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f]
I20260928 01:55:54.606518 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b]
I20260928 01:55:54.609548 21166 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:54.609691 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b]
I20260928 01:55:54.610067 21166 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:54.611129 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]
I20260928 01:55:54.613341 21166 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:54.616559 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:55:54.617218 19125 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c17b7f9972364c76893311539b569e0f in term 4.
I20260928 01:55:54.618659 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f; no voters: 
I20260928 01:55:54.619695 21166 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260928 01:55:54.620100 21166 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:54.620740 21166 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 4 FOLLOWER]: Advancing to term 5
I20260928 01:55:54.624928 21123 raft_consensus.cc:493] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:54.625454 21123 raft_consensus.cc:515] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.627480 21123 leader_election.cc:290] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:54.632592 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]
I20260928 01:55:54.634145 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]
I20260928 01:55:54.635557 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]
I20260928 01:55:54.644114 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d]
I20260928 01:55:54.645589 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151]
I20260928 01:55:54.652585 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87]
I20260928 01:55:54.654238 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e]
I20260928 01:55:54.657143 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1]
I20260928 01:55:54.662107 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542]
I20260928 01:55:54.663710 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:54.666589 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93]
I20260928 01:55:54.600715 19896 tablet_bootstrap.cc:700] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614: Time spent opening tablet: real 0.233s	user 0.001s	sys 0.000s
I20260928 01:55:54.671473 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]
I20260928 01:55:54.672904 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f]
I20260928 01:55:54.674978 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]
I20260928 01:55:54.677105 19896 tablet_bootstrap.cc:654] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:54.684315 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55]
I20260928 01:55:54.685789 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]
I20260928 01:55:54.687150 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]
I20260928 01:55:54.690315 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daa1b799e0d408287edc03988f5b683" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:54.690949 19468 raft_consensus.cc:3060] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:54.694265 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9]
I20260928 01:55:54.699074 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:54.701592 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:54.702255 19476 raft_consensus.cc:2468] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:54.705327 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975]
I20260928 01:55:54.706784 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f]
I20260928 01:55:54.708184 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6]
I20260928 01:55:54.710269 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37]
I20260928 01:55:54.712252 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749]
I20260928 01:55:54.713496 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4]
I20260928 01:55:54.714757 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417]
I20260928 01:55:54.716176 19468 raft_consensus.cc:2468] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:54.717011 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]
I20260928 01:55:54.718521 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7]
I20260928 01:55:54.719864 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]
I20260928 01:55:54.721179 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]
I20260928 01:55:54.722479 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5]
I20260928 01:55:54.723737 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d]
I20260928 01:55:54.725081 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619]
I20260928 01:55:54.726059 21166 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:54.727116 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]
I20260928 01:55:54.729385 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc"
I20260928 01:55:54.732728 21166 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 election: Requested vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
W20260928 01:55:54.737859 19409 leader_election.cc:343] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:54.739756 20029 tablet_bootstrap.cc:492] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:54.740239 20029 ts_tablet_manager.cc:1403] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.263s	user 0.049s	sys 0.045s
I20260928 01:55:54.492899 19890 tablet_bootstrap.cc:654] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:54.583276 21098 raft_consensus.cc:493] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:54.599566 21056 raft_consensus.cc:493] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:54.648169 21175 raft_consensus.cc:493] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:54.738142 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]
I20260928 01:55:54.773802 20029 raft_consensus.cc:359] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.725191 21173 leader_election.cc:290] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:54.776729 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d]
I20260928 01:55:54.777204 20029 raft_consensus.cc:385] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:54.780340 20029 raft_consensus.cc:740] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:54.784524 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b]
I20260928 01:55:54.785439 20029 consensus_queue.cc:260] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.787842 21202 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:54.788404 21202 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.792250 21202 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:54.794270 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:54.795465 19469 raft_consensus.cc:2393] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:54.796957 20029 ts_tablet_manager.cc:1434] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.004s
I20260928 01:55:54.799597 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]
I20260928 01:55:54.801471 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]
I20260928 01:55:54.814759 20029 tablet_bootstrap.cc:492] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:54.818728 19896 tablet_bootstrap.cc:492] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
W20260928 01:55:54.752012 19556 leader_election.cc:343] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:54.792919 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:54.828637 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 76798.8us
I20260928 01:55:54.829161 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2]
I20260928 01:55:54.829260 19556 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:54.830345 19896 ts_tablet_manager.cc:1403] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.611s	user 0.012s	sys 0.001s
I20260928 01:55:54.834054 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87]
I20260928 01:55:54.840837 19704 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:54.843190 21202 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:54.838380 21163 raft_consensus.cc:2804] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:54.848994 21163 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:54.849625 21163 raft_consensus.cc:3060] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:54.820801 21113 raft_consensus.cc:2804] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:54.821126 21175 raft_consensus.cc:515] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.821323 21056 raft_consensus.cc:515] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:54.820892 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 342834us
I20260928 01:55:54.821520 21098 raft_consensus.cc:515] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.873909 21175 leader_election.cc:290] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:54.877511 19896 raft_consensus.cc:359] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.878212 19896 raft_consensus.cc:385] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:54.878494 19896 raft_consensus.cc:740] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:54.879240 19896 consensus_queue.cc:260] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.879524 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:54.881559 20029 tablet_bootstrap.cc:654] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:54.887957 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02]
W20260928 01:55:54.875260 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 44967.4us
I20260928 01:55:54.902967 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14]
I20260928 01:55:54.905566 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:54.906248 19618 raft_consensus.cc:2468] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:54.907161 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:54.907954 21173 consensus_queue.cc:1048] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260928 01:55:54.912621 21056 leader_election.cc:290] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:54.919296 21098 leader_election.cc:290] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:54.922086 19896 ts_tablet_manager.cc:1434] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.001s
I20260928 01:55:54.927590 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]
I20260928 01:55:54.932659 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:54.928653 21113 raft_consensus.cc:697] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:54.937662 21113 consensus_queue.cc:237] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.945576 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:54.946429 19767 raft_consensus.cc:2468] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:54.946627 19896 tablet_bootstrap.cc:492] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:54.949324 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab12ba3e1f542949e3f203dae0fa80e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:54.951100 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a73835e2854976b40b31fe752d1b1b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:54.960711 19553 leader_election.cc:343] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:54.961174 19553 leader_election.cc:304] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:54.962718 21205 raft_consensus.cc:2749] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:54.963157 19412 leader_election.cc:304] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:54.963923 21118 raft_consensus.cc:2804] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:54.964427 21118 raft_consensus.cc:493] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:54.964862 21118 raft_consensus.cc:3060] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:54.961596 19890 tablet_bootstrap.cc:492] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:54.972375 19890 ts_tablet_manager.cc:1403] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.499s	user 0.016s	sys 0.027s
W20260928 01:55:54.977162 19553 leader_election.cc:343] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:54.980965 19553 consensus_peers.cc:597] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:55:54.975049 21202 raft_consensus.cc:2749] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:54.983405 19553 leader_election.cc:343] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:54.985092 19553 leader_election.cc:304] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:54.989372 21118 raft_consensus.cc:515] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.994724 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]
I20260928 01:55:54.995090 21163 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:54.998497 21163 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:55.014569 20029 tablet_bootstrap.cc:492] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:55.015154 20029 ts_tablet_manager.cc:1403] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.201s	user 0.009s	sys 0.006s
I20260928 01:55:55.020505 21173 raft_consensus.cc:2804] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 01:55:55.020798 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 54003.1us
I20260928 01:55:55.021054 21173 raft_consensus.cc:493] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:55.021528 21173 raft_consensus.cc:3060] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:55.022643 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:55.031563 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b]
I20260928 01:55:55.033360 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]
I20260928 01:55:55.035604 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a73835e2854976b40b31fe752d1b1b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:55.036298 19476 raft_consensus.cc:2468] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:55.037909 19468 raft_consensus.cc:2393] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:55.052588 21123 raft_consensus.cc:493] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:55.053234 21123 raft_consensus.cc:515] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.025038 20029 raft_consensus.cc:359] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.056586 20029 raft_consensus.cc:385] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:55.056892 20029 raft_consensus.cc:740] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:55.057382 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab12ba3e1f542949e3f203dae0fa80e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:55.057554 20029 consensus_queue.cc:260] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.058027 19476 raft_consensus.cc:2468] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:55.059052 20029 ts_tablet_manager.cc:1434] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.002s
I20260928 01:55:55.060081 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:55.072872 21205 raft_consensus.cc:493] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:55.068759 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb]
I20260928 01:55:55.073800 19890 raft_consensus.cc:359] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:55.077821 19890 raft_consensus.cc:385] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:55.078127 19890 raft_consensus.cc:740] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:55.080566 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:55.082149 20976 catalog_manager.cc:692] Loaded metadata for table default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320]
I20260928 01:55:55.082010 19890 consensus_queue.cc:260] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:55.083351 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:55.084690 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6a5cb9b09e4e5a8400bf71dbf99987" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:55.073530 21205 raft_consensus.cc:515] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.088793 21075 raft_consensus.cc:493] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:55:55.090147 19409 leader_election.cc:343] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:55.081758 21056 raft_consensus.cc:493] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:55.093382 21056 raft_consensus.cc:515] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.092818 21075 raft_consensus.cc:515] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.112742 19468 raft_consensus.cc:2468] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:55.118029 20029 tablet_bootstrap.cc:492] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:55.133780 19896 tablet_bootstrap.cc:654] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:55.134672 21118 leader_election.cc:290] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:55.140287 20029 tablet_bootstrap.cc:654] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:55.153610 21123 leader_election.cc:290] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:55.183372 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b222e5366a64f52bc97acd551c7a067" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:55.182852 21197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "04e48edd841a42d08a480be209f0d294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:55.184367 19468 raft_consensus.cc:2393] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:55.185688 21197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: LEADER
I20260928 01:55:55.186221 19200 raft_consensus.cc:1240] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 5 FOLLOWER]: Rejecting Update request from peer 04e48edd841a42d08a480be209f0d294 for earlier term 4. Current term is 5. Ops: []
I20260928 01:55:55.183902 21075 leader_election.cc:290] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:55.189517 21197 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 }, Status: INVALID_TERM, Last received: 4.341, Next index: 342, Last known committed idx: 341, Time since last communication: 0.001s
I20260928 01:55:55.220705 19896 tablet_bootstrap.cc:492] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:55.221217 19896 ts_tablet_manager.cc:1403] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.275s	user 0.017s	sys 0.009s
I20260928 01:55:55.225001 19896 raft_consensus.cc:359] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:55.225684 19896 raft_consensus.cc:385] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:55.225950 19896 raft_consensus.cc:740] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:55.238823 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b222e5366a64f52bc97acd551c7a067" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:55.239266 19896 consensus_queue.cc:260] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:55.240792 19704 leader_election.cc:304] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:55.241775 19896 ts_tablet_manager.cc:1434] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260928 01:55:55.241943 21078 raft_consensus.cc:3060] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:55.244359 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 153086us
I20260928 01:55:55.245137 21164 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 4 LEADER]: Stepping down as leader of term 4
I20260928 01:55:55.245584 21164 raft_consensus.cc:740] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 04e48edd841a42d08a480be209f0d294, State: Running, Role: LEADER
I20260928 01:55:55.247196 21164 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 341, Committed index: 341, Last appended: 4.341, Last appended by leader: 341, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:55.249346 20029 tablet_bootstrap.cc:492] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:55.249835 20029 ts_tablet_manager.cc:1403] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.132s	user 0.014s	sys 0.002s
I20260928 01:55:55.254202 20029 raft_consensus.cc:359] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.254971 20029 raft_consensus.cc:385] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:55.255270 20029 raft_consensus.cc:740] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:55.256446 21078 raft_consensus.cc:2749] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:55.257495 19896 tablet_bootstrap.cc:492] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:55.255945 20029 consensus_queue.cc:260] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.263309 20976 tablet_loader.cc:96] loaded metadata for tablet 01cc307b127446958bd4199a1aa60adb (table default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375])
I20260928 01:55:55.265667 20976 tablet_loader.cc:96] loaded metadata for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6])
I20260928 01:55:55.267608 20976 tablet_loader.cc:96] loaded metadata for tablet 043ddb5b0b0e4ad0b30d2927d37971fb (table default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9])
I20260928 01:55:55.269832 20976 tablet_loader.cc:96] loaded metadata for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6])
I20260928 01:55:55.271883 20029 ts_tablet_manager.cc:1434] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260928 01:55:55.271883 20976 tablet_loader.cc:96] loaded metadata for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7])
I20260928 01:55:55.274164 20976 tablet_loader.cc:96] loaded metadata for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0])
I20260928 01:55:55.276280 20976 tablet_loader.cc:96] loaded metadata for tablet 0e1ddfab489f4ace921d551c216039bd (table default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f])
I20260928 01:55:55.276806 20029 tablet_bootstrap.cc:492] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:55.278298 20976 tablet_loader.cc:96] loaded metadata for tablet 10fa56df34ad44d88f1dd700c823d57c (table default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7])
I20260928 01:55:55.279693 20976 tablet_loader.cc:96] loaded metadata for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117])
I20260928 01:55:55.280984 20976 tablet_loader.cc:96] loaded metadata for tablet 12b836e20d6b43cba8eaa08887afb076 (table default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4])
I20260928 01:55:55.283165 20976 tablet_loader.cc:96] loaded metadata for tablet 13c395a6a87f4927b10973720aa4d868 (table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92])
I20260928 01:55:55.284415 20976 tablet_loader.cc:96] loaded metadata for tablet 1555e557370a4e92915a9c55107b573b (table default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6])
I20260928 01:55:55.286280 20976 tablet_loader.cc:96] loaded metadata for tablet 15f48cf74a1b4600b5140bf9cc8446e3 (table default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2])
I20260928 01:55:55.287494 20976 tablet_loader.cc:96] loaded metadata for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b])
I20260928 01:55:55.288705 20976 tablet_loader.cc:96] loaded metadata for tablet 202f1ead822548a2bbeae4e4d3cf9be8 (table default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975])
I20260928 01:55:55.290630 20976 tablet_loader.cc:96] loaded metadata for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d])
I20260928 01:55:55.291785 20976 tablet_loader.cc:96] loaded metadata for tablet 21906a8380e64d95b9454a57fc01c6f0 (table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a])
I20260928 01:55:55.293537 20976 tablet_loader.cc:96] loaded metadata for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d])
I20260928 01:55:55.295648 20976 tablet_loader.cc:96] loaded metadata for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5])
I20260928 01:55:55.297091 20029 tablet_bootstrap.cc:654] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:55.297578 20976 tablet_loader.cc:96] loaded metadata for tablet 27a232fc915a46c1a833ec5f6721eece (table default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417])
I20260928 01:55:55.215543 21056 leader_election.cc:290] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:55.300395 20976 tablet_loader.cc:96] loaded metadata for tablet 29f65b0966c04012bfec3c67a37acc25 (table default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e])
I20260928 01:55:55.301514 20976 tablet_loader.cc:96] loaded metadata for tablet 2c007b068b1d414298cce3fe44a91daa (table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc])
I20260928 01:55:55.304586 20976 tablet_loader.cc:96] loaded metadata for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12])
I20260928 01:55:55.304733 21205 leader_election.cc:290] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:55.305896 20976 tablet_loader.cc:96] loaded metadata for tablet 36076aa674b9401b9b76fbf066348d06 (table default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a])
I20260928 01:55:55.307119 20976 tablet_loader.cc:96] loaded metadata for tablet 376b5a87b07b4f87a2a502b5fa1b23f8 (table default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7])
I20260928 01:55:55.309775 20976 tablet_loader.cc:96] loaded metadata for tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7 (table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535])
I20260928 01:55:55.311290 19890 ts_tablet_manager.cc:1434] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.332s	user 0.020s	sys 0.005s
I20260928 01:55:55.311756 20976 tablet_loader.cc:96] loaded metadata for tablet 3f4a1c903a04450684ba38081a75559e (table default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a])
I20260928 01:55:55.312953 20976 tablet_loader.cc:96] loaded metadata for tablet 416ccc1323fe41b2a7783dc95bba8d84 (table default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d])
I20260928 01:55:55.314949 20976 tablet_loader.cc:96] loaded metadata for tablet 45d8d07b367b4fafbd7171f8ea7b2a26 (table default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921])
I20260928 01:55:55.316854 20976 tablet_loader.cc:96] loaded metadata for tablet 4c6f4708c641414aa59f01703c86aaf1 (table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8])
I20260928 01:55:55.318025 20976 tablet_loader.cc:96] loaded metadata for tablet 4e6b59144fe14daab98b0965c7f8af02 (table default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2])
I20260928 01:55:55.319154 20976 tablet_loader.cc:96] loaded metadata for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88])
I20260928 01:55:55.320511 20976 tablet_loader.cc:96] loaded metadata for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd])
I20260928 01:55:55.321619 20976 tablet_loader.cc:96] loaded metadata for tablet 522245da435b40ae84ae6dc5d19a2e95 (table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed])
I20260928 01:55:55.323319 20029 tablet_bootstrap.cc:492] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:55.322772 21173 raft_consensus.cc:515] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.323480 20976 tablet_loader.cc:96] loaded metadata for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3 (table default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f])
I20260928 01:55:55.323951 20029 ts_tablet_manager.cc:1403] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.005s
I20260928 01:55:55.324999 21173 leader_election.cc:290] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:55.325259 20976 tablet_loader.cc:96] loaded metadata for tablet 5374596938d64cafb9621a1932ca1f68 (table default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f])
I20260928 01:55:55.326998 20976 tablet_loader.cc:96] loaded metadata for tablet 53c755f16ea1496eb7fa26fb12e01708 (table default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85])
I20260928 01:55:55.328105 20976 tablet_loader.cc:96] loaded metadata for tablet 5442dd0aa28545c8bcf3a0b977c71e98 (table default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b])
I20260928 01:55:55.328975 19890 tablet_bootstrap.cc:492] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:55.331130 20029 raft_consensus.cc:359] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.333840 20976 tablet_loader.cc:96] loaded metadata for tablet 6546cfe6f3a6405fab41a4ebdcffb288 (table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df])
I20260928 01:55:55.333961 20029 raft_consensus.cc:385] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:55.334446 20029 raft_consensus.cc:740] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:55.335016 20976 tablet_loader.cc:96] loaded metadata for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435])
I20260928 01:55:55.336154 20976 tablet_loader.cc:96] loaded metadata for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee])
I20260928 01:55:55.336522 20029 consensus_queue.cc:260] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.337416 20976 tablet_loader.cc:96] loaded metadata for tablet 664b608bb0f54fc5baa10622f7d916c1 (table default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9])
I20260928 01:55:55.338748 20976 tablet_loader.cc:96] loaded metadata for tablet 675e1e1f2630411f8b070d8ca99e8ffb (table default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93])
I20260928 01:55:55.339879 20976 tablet_loader.cc:96] loaded metadata for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331])
I20260928 01:55:55.338807 20029 ts_tablet_manager.cc:1434] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260928 01:55:55.340900 20976 tablet_loader.cc:96] loaded metadata for tablet 6ea6adefd15a4ea19011419949047e83 (table default.Table_a82317fb7790483884cbb5ebcf554128 [id=292d90fe578e4470bced0890a4e646ef])
I20260928 01:55:55.342043 20976 tablet_loader.cc:96] loaded metadata for tablet 7441c2d1a7fa4dc8a89c6717a80d3efb (table default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233])
I20260928 01:55:55.341107 20029 tablet_bootstrap.cc:492] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:55.343099 20976 tablet_loader.cc:96] loaded metadata for tablet 75303ee92aae436ea6c46747a23b69b6 (table default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320])
I20260928 01:55:55.346172 20976 tablet_loader.cc:96] loaded metadata for tablet 7801c623930d4e4eaf24c5c424b06d26 (table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006])
I20260928 01:55:55.348028 20976 tablet_loader.cc:96] loaded metadata for tablet 7979940c4a2e470bbecc40384edf38c9 (table default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87])
I20260928 01:55:55.353313 20976 tablet_loader.cc:96] loaded metadata for tablet 81c205176cb94d9f861cc140560944d4 (table default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765])
I20260928 01:55:55.354535 20976 tablet_loader.cc:96] loaded metadata for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9])
I20260928 01:55:55.355702 20976 tablet_loader.cc:96] loaded metadata for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780])
W20260928 01:55:55.358964 19179 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.60:39095 timed out after 0.740s (SENT) [suppressed 1 similar messages]
I20260928 01:55:55.359175 20976 tablet_loader.cc:96] loaded metadata for tablet 8b48eacc1cec49baabe2d87bdd06cd5c (table default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd])
I20260928 01:55:55.360615 20976 tablet_loader.cc:96] loaded metadata for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4])
I20260928 01:55:55.361904 20976 tablet_loader.cc:96] loaded metadata for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca])
I20260928 01:55:55.363158 20976 tablet_loader.cc:96] loaded metadata for tablet 8df69eb3a37445ed8a2be0ef3bf32cdb (table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624])
I20260928 01:55:55.249174 21164 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 4 FOLLOWER]: Advancing to term 5
I20260928 01:55:55.368546 20976 tablet_loader.cc:96] loaded metadata for tablet 8e39fce4f0a149a898de678d73052f52 (table default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55])
I20260928 01:55:55.368971 20029 tablet_bootstrap.cc:654] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:55.372849 20976 tablet_loader.cc:96] loaded metadata for tablet 9690a224bb004152ba65d525cc10bd9f (table default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5])
I20260928 01:55:55.373996 20976 tablet_loader.cc:96] loaded metadata for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7])
I20260928 01:55:55.375797 20976 tablet_loader.cc:96] loaded metadata for tablet 99e806ba248746d2bde39a2eb76b17df (table default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542])
I20260928 01:55:55.376984 20976 tablet_loader.cc:96] loaded metadata for tablet 9a9c2db89fb8467d91c6bd01985d8b40 (table default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3])
W20260928 01:55:55.378477 19409 leader_election.cc:343] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:55.379680 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 300476us
I20260928 01:55:55.379485 20976 tablet_loader.cc:96] loaded metadata for tablet 9ec3f279423a46c1acb1cbfecf4a608a (table default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b])
W20260928 01:55:55.354368 19553 leader_election.cc:343] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:55.381269 20976 tablet_loader.cc:96] loaded metadata for tablet 9f80b652a19a41968d1bfbaaf020b721 (table default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1])
W20260928 01:55:55.382826 19553 leader_election.cc:343] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:55.383900 20976 tablet_loader.cc:96] loaded metadata for tablet a01b795606604960bc7cafab4ff6f3d0 (table default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae])
I20260928 01:55:55.384927 20976 tablet_loader.cc:96] loaded metadata for tablet a12bafcc09ef4342bff89b0475f721af (table default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b])
I20260928 01:55:55.385927 20976 tablet_loader.cc:96] loaded metadata for tablet a1710b95678440b1bff8a92080d43272 (table default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d])
I20260928 01:55:55.388782 20976 tablet_loader.cc:96] loaded metadata for tablet a23b494afa1f45988d447519356d2b03 (table default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305])
I20260928 01:55:55.385504 21205 consensus_queue.cc:1048] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260928 01:55:55.393529 20029 tablet_bootstrap.cc:492] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:55.394109 20029 ts_tablet_manager.cc:1403] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.000s
I20260928 01:55:55.396363 20976 tablet_loader.cc:96] loaded metadata for tablet a735102c576640b69323cacb50393a42 (table default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e])
I20260928 01:55:55.396905 20029 raft_consensus.cc:359] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.397571 20029 raft_consensus.cc:385] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:55.397559 20976 tablet_loader.cc:96] loaded metadata for tablet a82d3233e4514813b22121f75d11eebc (table default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151])
I20260928 01:55:55.397823 20029 raft_consensus.cc:740] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:55.398459 20029 consensus_queue.cc:260] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.403113 20029 ts_tablet_manager.cc:1434] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260928 01:55:55.404150 20029 tablet_bootstrap.cc:492] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:55.405556 20976 tablet_loader.cc:96] loaded metadata for tablet b4b520e89c364692af1aedde2a59c3da (table default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca])
I20260928 01:55:55.406852 20976 tablet_loader.cc:96] loaded metadata for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5])
W20260928 01:55:55.385210 19553 leader_election.cc:343] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:55.416237 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:55.417182 19763 raft_consensus.cc:2468] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:55.421985 21075 raft_consensus.cc:493] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:55.422518 21075 raft_consensus.cc:515] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.423594 20976 tablet_loader.cc:96] loaded metadata for tablet b8cacb4a90a54cd3b5b3e7a9310e06ed (table default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d])
I20260928 01:55:55.424726 21075 leader_election.cc:290] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:55.379890 21217 raft_consensus.cc:493] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:55.425563 20976 tablet_loader.cc:96] loaded metadata for tablet ba89039dcfa848159112caa76802b5f1 (table default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749])
I20260928 01:55:55.425274 21217 raft_consensus.cc:515] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:55.426738 20976 tablet_loader.cc:96] loaded metadata for tablet bab12ba3e1f542949e3f203dae0fa80e (table default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb])
I20260928 01:55:55.426647 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:55.427280 21217 leader_election.cc:290] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:55.427268 19619 raft_consensus.cc:2468] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:55.427516 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:55.428296 19468 raft_consensus.cc:2393] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:55.430128 19704 leader_election.cc:304] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:55.431734 21075 raft_consensus.cc:2804] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:55.432174 21075 raft_consensus.cc:493] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:55.432593 21075 raft_consensus.cc:3060] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:55.434660 19896 tablet_bootstrap.cc:654] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:55.435151 19179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 76200.6us
I20260928 01:55:55.434449 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6a5cb9b09e4e5a8400bf71dbf99987" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:55.437971 19763 raft_consensus.cc:3060] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:55.443409 20976 tablet_loader.cc:96] loaded metadata for tablet c2597de2c4304074977db5a3c0426814 (table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e])
I20260928 01:55:55.448622 20976 tablet_loader.cc:96] loaded metadata for tablet c53d75604ee3405d83fe9ecaa824ea68 (table default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513])
I20260928 01:55:55.449968 20976 tablet_loader.cc:96] loaded metadata for tablet c74a4a00552c4a14a871a59465524f1c (table default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a])
I20260928 01:55:55.430819 19890 tablet_bootstrap.cc:654] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:55.458797 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6a5cb9b09e4e5a8400bf71dbf99987" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:55.459628 19476 raft_consensus.cc:2468] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:55.458690 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:55.462249 19468 raft_consensus.cc:3060] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:55.462123 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:55.464135 19471 raft_consensus.cc:2468] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:55.452032 20976 tablet_loader.cc:96] loaded metadata for tablet c8fd6b965d22477aaee9bafccb2069b1 (table default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02])
W20260928 01:55:55.465739 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 consensus state has no leader
I20260928 01:55:55.466648 20976 tablet_loader.cc:96] loaded metadata for tablet c9f3e966ab0d46d187fb9daa356b16fc (table default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b])
I20260928 01:55:55.468042 20976 tablet_loader.cc:96] loaded metadata for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e])
I20260928 01:55:55.475389 19468 raft_consensus.cc:2468] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:55.476125 20976 tablet_loader.cc:96] loaded metadata for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305])
I20260928 01:55:55.478544 20029 tablet_bootstrap.cc:654] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:55.482242 21075 raft_consensus.cc:515] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.486111 20976 tablet_loader.cc:96] loaded metadata for tablet d114d5ba862044b4b88eee27395db7e3 (table default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb])
I20260928 01:55:55.489598 20976 tablet_loader.cc:96] loaded metadata for tablet d7774406b22547d29d9d42c969cf0874 (table default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa])
I20260928 01:55:55.497123 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:55.497778 19619 raft_consensus.cc:3060] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:55.504069 20976 tablet_loader.cc:96] loaded metadata for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4])
I20260928 01:55:55.506001 20976 tablet_loader.cc:96] loaded metadata for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e])
I20260928 01:55:55.507025 20976 tablet_loader.cc:96] loaded metadata for tablet e6206afe245740b1819069a48e8b548e (table default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37])
I20260928 01:55:55.509354 19619 raft_consensus.cc:2468] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:55.511765 19704 leader_election.cc:304] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:55.512799 21076 raft_consensus.cc:2804] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:55.513429 21076 raft_consensus.cc:697] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:55.514660 21076 consensus_queue.cc:237] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.519639 20976 tablet_loader.cc:96] loaded metadata for tablet e8f6ce7612d4463ebe95e07557bca4e7 (table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67])
I20260928 01:55:55.521000 20976 tablet_loader.cc:96] loaded metadata for tablet e927cd8a991f46278c2bb663cee7f753 (table default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75])
I20260928 01:55:55.522224 20976 tablet_loader.cc:96] loaded metadata for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba])
I20260928 01:55:55.526247 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:55.527176 19763 raft_consensus.cc:3060] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:55.531025 19890 tablet_bootstrap.cc:492] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:55.531535 19890 ts_tablet_manager.cc:1403] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.203s	user 0.005s	sys 0.008s
I20260928 01:55:55.533782 21075 leader_election.cc:290] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:55.535969 20976 tablet_loader.cc:96] loaded metadata for tablet eb014699060e4a6caf4caaf33c31710a (table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f])
I20260928 01:55:55.538285 20976 tablet_loader.cc:96] loaded metadata for tablet ef752c3b4b22490ab42292f61278da52 (table default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619])
I20260928 01:55:55.555214 20976 tablet_loader.cc:96] loaded metadata for tablet f7b78eb499d6418f8877bf3b59bbbec2 (table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d])
I20260928 01:55:55.564821 20976 tablet_loader.cc:96] loaded metadata for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9])
I20260928 01:55:55.566526 20976 tablet_loader.cc:96] loaded metadata for tablet fa3b9ec9f88342c0aa77c0fc92d26205 (table default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87])
W20260928 01:55:55.568354 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 188326us
I20260928 01:55:55.567961 20976 tablet_loader.cc:96] loaded metadata for tablet fb159b3aad31479f80683b0d80549cc3 (table default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b])
I20260928 01:55:55.576506 20976 tablet_loader.cc:96] loaded metadata for tablet fc428ccbf88e4d5cbae197cb67e9a0a5 (table default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14])
I20260928 01:55:55.580240 20976 tablet_loader.cc:96] loaded metadata for tablet fcf1b727e86a43b08bd464647fa529a3 (table default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619])
I20260928 01:55:55.580332 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:55.585740 19409 leader_election.cc:343] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:55.587589 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:55.588629 19476 raft_consensus.cc:3060] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:55.599642 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:55.601879 19471 raft_consensus.cc:2393] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:55.607910 19476 raft_consensus.cc:2468] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
W20260928 01:55:55.631837 20976 catalog_manager.cc:1525] Time spent T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Loading table and tablet metadata into memory: real 1.369s	user 0.382s	sys 0.047s
I20260928 01:55:55.632302 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:55.633265 20551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294"
I20260928 01:55:55.644754 20976 catalog_manager.cc:1533] Initializing Kudu cluster ID...
W20260928 01:55:55.645006 20551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35724 (request call id 11) took 912 ms (client timeout 685 ms). Trace:
W20260928 01:55:55.645427 20551 rpcz_store.cc:269] 0928 01:55:54.732493 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:54.732707 (+   214us) service_pool.cc:224] Handling call
0928 01:55:55.644930 (+912223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:55.632076 20552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
W20260928 01:55:55.647373 20552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35724 (request call id 10) took 1031 ms (client timeout 740 ms). Trace:
I20260928 01:55:55.647773 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:55:55.647760 20552 rpcz_store.cc:269] 0928 01:55:54.616112 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:54.616322 (+   210us) service_pool.cc:224] Handling call
0928 01:55:55.647212 (+1030890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:55.634812 20541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294"
I20260928 01:55:55.636134 20545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:55.637148 20547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
W20260928 01:55:55.650518 20547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35722 (request call id 5) took 456 ms (client timeout 522 ms). Trace:
W20260928 01:55:55.650926 20547 rpcz_store.cc:269] 0928 01:55:55.193928 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:55.194356 (+   428us) service_pool.cc:224] Handling call
0928 01:55:55.650451 (+456095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:55:55.652714 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:55:55.654186 21075 raft_consensus.cc:493] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:55.654749 21075 raft_consensus.cc:515] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.658020 19890 raft_consensus.cc:359] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.658826 19890 raft_consensus.cc:385] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:55.659081 19890 raft_consensus.cc:740] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:55.660100 20029 tablet_bootstrap.cc:492] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:55.659719 19890 consensus_queue.cc:260] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.660589 20029 ts_tablet_manager.cc:1403] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.257s	user 0.005s	sys 0.012s
I20260928 01:55:55.663031 19890 ts_tablet_manager.cc:1434] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.131s	user 0.010s	sys 0.004s
I20260928 01:55:55.664667 19890 tablet_bootstrap.cc:492] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:55.665709 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:55.671244 21239 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:55:55.678473 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6a5cb9b09e4e5a8400bf71dbf99987" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:55.678768 19763 raft_consensus.cc:2468] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:55.679113 19618 raft_consensus.cc:2468] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:55.648505 19619 raft_consensus.cc:2393] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:55.680152 21075 leader_election.cc:290] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:55.668349 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:55:55.684166 20976 catalog_manager.cc:1308] Loaded cluster ID: 726a03a5ce124d548da65567db2a283d
I20260928 01:55:55.684494 20976 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:55:55.683135 20029 raft_consensus.cc:359] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.686218 20029 raft_consensus.cc:385] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:55.686527 20029 raft_consensus.cc:740] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:55.687193 20029 consensus_queue.cc:260] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.698745 20029 ts_tablet_manager.cc:1434] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260928 01:55:55.699874 20029 tablet_bootstrap.cc:492] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:55.700686 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:55.701268 19618 raft_consensus.cc:2468] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:55.707356 21212 consensus_queue.cc:1048] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:55.708820 19890 tablet_bootstrap.cc:654] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:55.727815 20029 tablet_bootstrap.cc:654] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:55.738248 20553 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81ebb46a410e43ebaec3ef4dd13a71fc in term 5.
I20260928 01:55:55.741808 20520 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:35728 (request call id 5) took 1454 ms. Trace:
I20260928 01:55:55.742205 20520 rpcz_store.cc:276] 0928 01:55:54.286916 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:54.287060 (+   144us) service_pool.cc:224] Handling call
0928 01:55:55.740939 (+1453879us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000203d4. stack: 00007fb7cb3da323 00007fb7cb3da220 00007fb7caf7e574 0000000000516964 00000000005168f9 00007fb7d24d7aa1 00007fb7d25777b9 00007fb7d43a7076 00007fb7d43ea427 00007fb7d1f8e534 00007fb7d1f8e4c2 00007fb7d1f8e3f1 00007fb7d1f8e36c 00007fb7d1f8d622 00007fb7d023d09c 00007fb7d023c4d6
0928 01:55:55.741254 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247776512}
W20260928 01:55:55.746131 20553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35722 (request call id 4) took 1154 ms (client timeout 522 ms). Trace:
W20260928 01:55:55.747388 20553 rpcz_store.cc:269] 0928 01:55:54.592081 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:54.592384 (+   303us) service_pool.cc:224] Handling call
0928 01:55:55.745944 (+1153560us) spinlock_profiling.cc:243] Waited 93.4 ms on lock 0x7b54000203d4. stack: 00007fb7cb3da323 00007fb7cb3da220 00007fb7caf7e574 0000000000516964 00000000005168f9 00007fb7d24d7aa1 00007fb7d2572aba 00007fb7d35cfd57 00007fb7d1c4f834 00007fb7d1c4f7c2 00007fb7d1c4f6f1 00007fb7d1c4f66c 00007fb7d1c4e922 00007fb7d023d09c 00007fb7d023c4d6 00007fb7d023be7f
0928 01:55:55.746061 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214905600}
I20260928 01:55:55.750641 20976 catalog_manager.cc:1553] Loading token signing keys...
I20260928 01:55:55.757294 19890 tablet_bootstrap.cc:492] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:55.757742 19890 ts_tablet_manager.cc:1403] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.093s	user 0.008s	sys 0.013s
I20260928 01:55:55.763566 19553 leader_election.cc:304] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:55.764429 21173 raft_consensus.cc:2804] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:55.764895 21173 raft_consensus.cc:493] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:55.765354 21173 raft_consensus.cc:3060] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:55.792515 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 74150.4us
I20260928 01:55:55.794440 19896 tablet_bootstrap.cc:492] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:55.794924 19896 ts_tablet_manager.cc:1403] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.538s	user 0.020s	sys 0.008s
I20260928 01:55:55.795212 20029 tablet_bootstrap.cc:492] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:55.795673 20029 ts_tablet_manager.cc:1403] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.006s
I20260928 01:55:55.798276 19890 raft_consensus.cc:359] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.799081 19890 raft_consensus.cc:385] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:55.799387 19890 raft_consensus.cc:740] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
W20260928 01:55:55.801038 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 94490.8us
W20260928 01:55:55.804095 19553 leader_election.cc:343] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:55.804939 21241 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260928 01:55:55.806097 19179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 151730us
I20260928 01:55:55.806896 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:55.807631 19469 raft_consensus.cc:2468] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:55.808995 19703 leader_election.cc:304] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:55.811764 21076 raft_consensus.cc:2804] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:55:55.812305 21076 raft_consensus.cc:493] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:55.812440 19764 raft_consensus.cc:3060] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:55.812811 21076 raft_consensus.cc:3060] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:55.817035 20976 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294: Loaded TSK: 0
I20260928 01:55:55.816954 19896 raft_consensus.cc:359] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:55.817667 19896 raft_consensus.cc:385] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:55.817950 19896 raft_consensus.cc:740] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:55.818588 19896 consensus_queue.cc:260] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:55.799471 20029 raft_consensus.cc:359] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.819792 20029 raft_consensus.cc:385] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:55.821127 20029 raft_consensus.cc:740] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:55.822044 20029 consensus_queue.cc:260] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.831053 19896 ts_tablet_manager.cc:1434] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260928 01:55:55.832161 19896 tablet_bootstrap.cc:492] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:55.833961 20029 ts_tablet_manager.cc:1434] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.006s
I20260928 01:55:55.834702 20976 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 01:55:55.838037 20029 tablet_bootstrap.cc:492] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:55.842386 21076 raft_consensus.cc:515] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.811172 19556 leader_election.cc:304] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:55.878996 21075 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:55.879674 21075 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.887024 19896 tablet_bootstrap.cc:654] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:55.888897 21075 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:55.888895 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:55.890064 19469 raft_consensus.cc:2393] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:55.800077 19890 consensus_queue.cc:260] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.919502 21213 consensus_queue.cc:1048] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260928 01:55:55.928041 19553 leader_election.cc:304] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:55.893829 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:55.931313 19617 raft_consensus.cc:2393] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:55.931226 21213 raft_consensus.cc:2804] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:55.928084 19890 ts_tablet_manager.cc:1434] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.170s	user 0.010s	sys 0.001s
I20260928 01:55:55.878685 21163 consensus_queue.cc:1048] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260928 01:55:55.933069 19890 tablet_bootstrap.cc:492] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:55.932077 21213 raft_consensus.cc:697] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:55.933189 21173 raft_consensus.cc:515] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.907258 21223 consensus_queue.cc:1048] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.081s
I20260928 01:55:55.934444 21213 consensus_queue.cc:237] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:55.919282 21056 raft_consensus.cc:2804] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 01:55:55.916903 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 105809us
I20260928 01:55:55.939273 21076 leader_election.cc:290] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:55.895059 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:55.936301 19556 leader_election.cc:304] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:55.935868 21056 raft_consensus.cc:493] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:55.945246 21056 raft_consensus.cc:3060] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:55.946084 19556 leader_election.cc:304] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:55.947279 21163 raft_consensus.cc:2749] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:55.948618 21163 consensus_queue.cc:1048] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:55.949626 21212 raft_consensus.cc:2804] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:55.956470 21212 raft_consensus.cc:493] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:55.957114 21212 raft_consensus.cc:3060] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:55.966207 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:55.967083 19469 raft_consensus.cc:3060] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:55.970498 19890 tablet_bootstrap.cc:654] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:55.988548 21075 raft_consensus.cc:493] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:55:55.989625 21075 raft_consensus.cc:515] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.006259 19896 tablet_bootstrap.cc:492] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:56.006834 19896 ts_tablet_manager.cc:1403] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.175s	user 0.012s	sys 0.009s
I20260928 01:55:56.012986 19896 raft_consensus.cc:359] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.014277 19890 tablet_bootstrap.cc:492] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:56.014744 19890 ts_tablet_manager.cc:1403] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.004s
I20260928 01:55:56.018477 19890 raft_consensus.cc:359] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.019196 19890 raft_consensus.cc:385] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.019490 19890 raft_consensus.cc:740] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.019375 19896 raft_consensus.cc:385] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.027890 19896 raft_consensus.cc:740] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.016835 19469 raft_consensus.cc:2468] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:55:56.029747 19703 leader_election.cc:304] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:56.030885 21202 raft_consensus.cc:2804] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:55:56.031562 21202 raft_consensus.cc:697] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:56.032822 21202 consensus_queue.cc:237] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.038516 19896 consensus_queue.cc:260] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:56.042779 20976 catalog_manager.cc:1458] Failed waiting for node to catch up after master election: Illegal state: Node 04e48edd841a42d08a480be209f0d294 not leader. Raft Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
W20260928 01:55:56.043612 20976 catalog_manager.cc:1458] Failed waiting for node to catch up after master election: Illegal state: Node 04e48edd841a42d08a480be209f0d294 not leader. Raft Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:56.042306 19704 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:56.051630 21246 raft_consensus.cc:3060] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:56.059837 21075 leader_election.cc:290] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:55.969430 21173 leader_election.cc:290] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:56.062489 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602706a3fbc438d8d448c9ac057087c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:56.063573 19469 raft_consensus.cc:2468] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:56.065258 19703 leader_election.cc:304] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:56.071568 21245 raft_consensus.cc:2804] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:55:56.072083 21245 raft_consensus.cc:493] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:55:56.072727 21245 raft_consensus.cc:3060] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:56.084761 19896 ts_tablet_manager.cc:1434] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260928 01:55:56.088997 20029 tablet_bootstrap.cc:654] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.092242 19896 tablet_bootstrap.cc:492] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:56.114916 21245 raft_consensus.cc:515] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.127575 21245 leader_election.cc:290] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:56.133448 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602706a3fbc438d8d448c9ac057087c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:56.134037 19471 raft_consensus.cc:3060] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:56.134238 20029 tablet_bootstrap.cc:492] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:56.134670 20029 ts_tablet_manager.cc:1403] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.297s	user 0.015s	sys 0.001s
I20260928 01:55:56.140451 20029 raft_consensus.cc:359] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.141113 20029 raft_consensus.cc:385] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.141374 20029 raft_consensus.cc:740] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.142026 20029 consensus_queue.cc:260] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.143999 20029 ts_tablet_manager.cc:1434] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260928 01:55:56.144953 20029 tablet_bootstrap.cc:492] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:56.148655 21246 raft_consensus.cc:2749] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:56.169866 19471 raft_consensus.cc:2468] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:55:56.172113 19703 leader_election.cc:304] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:56.172904 21076 raft_consensus.cc:2804] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:55:56.176074 21076 raft_consensus.cc:697] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:56.177009 21076 consensus_queue.cc:237] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.181713 20029 tablet_bootstrap.cc:654] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.193298 19896 tablet_bootstrap.cc:654] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.221565 19896 tablet_bootstrap.cc:492] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:56.222004 19896 ts_tablet_manager.cc:1403] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.130s	user 0.007s	sys 0.003s
I20260928 01:55:56.230270 20029 tablet_bootstrap.cc:492] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:56.237782 20029 ts_tablet_manager.cc:1403] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.093s	user 0.007s	sys 0.007s
I20260928 01:55:56.236555 19896 raft_consensus.cc:359] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.264561 19896 raft_consensus.cc:385] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.264868 19896 raft_consensus.cc:740] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.265556 19896 consensus_queue.cc:260] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.267148 19896 ts_tablet_manager.cc:1434] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260928 01:55:56.272912 21255 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:56.276438 21255 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:56.284050 19200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:55:56.284890 19200 raft_consensus.cc:2393] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81ebb46a410e43ebaec3ef4dd13a71fc in current term 5: Already voted for candidate c17b7f9972364c76893311539b569e0f in this term.
I20260928 01:55:56.020133 19890 consensus_queue.cc:260] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.084189 21212 raft_consensus.cc:515] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.297613 21255 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
W20260928 01:55:56.227157 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 296069us
W20260928 01:55:56.229004 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 282896us
I20260928 01:55:56.303133 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:56.241526 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602706a3fbc438d8d448c9ac057087c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:56.251543 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602706a3fbc438d8d448c9ac057087c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:56.297972 21212 leader_election.cc:290] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:56.303797 20553 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81ebb46a410e43ebaec3ef4dd13a71fc in term 5.
I20260928 01:55:56.311885 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: c17b7f9972364c76893311539b569e0f
I20260928 01:55:56.312707 21255 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260928 01:55:56.313110 21255 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 04e48edd841a42d08a480be209f0d294)
I20260928 01:55:56.313525 21255 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 4 FOLLOWER]: Advancing to term 5
I20260928 01:55:56.318068 21076 consensus_queue.cc:1048] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:56.321249 21118 raft_consensus.cc:493] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:56.321722 21118 raft_consensus.cc:515] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.324749 21118 leader_election.cc:290] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:56.292588 21098 raft_consensus.cc:493] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:56.335745 21098 raft_consensus.cc:515] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.337929 21098 leader_election.cc:290] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:56.292593 19890 ts_tablet_manager.cc:1434] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.277s	user 0.007s	sys 0.005s
I20260928 01:55:56.291533 21163 raft_consensus.cc:493] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:56.309528 21205 consensus_queue.cc:1048] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260928 01:55:56.339257 21163 raft_consensus.cc:515] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.340160 19890 tablet_bootstrap.cc:492] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:56.341584 21163 leader_election.cc:290] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:56.347290 19890 tablet_bootstrap.cc:654] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.352697 19766 raft_consensus.cc:1240] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 01:55:56.362504 19890 tablet_bootstrap.cc:492] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:56.362963 19890 ts_tablet_manager.cc:1403] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.003s
I20260928 01:55:56.308179 21056 raft_consensus.cc:515] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.368428 21056 leader_election.cc:290] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:56.375759 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d70a8be7244c86864187420a4fd5f5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:56.377957 19409 leader_election.cc:343] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:56.394024 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:56.385126 19890 raft_consensus.cc:359] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.394645 19890 raft_consensus.cc:385] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.394858 19764 raft_consensus.cc:3060] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:56.394975 19890 raft_consensus.cc:740] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.395682 19890 consensus_queue.cc:260] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.374233 21255 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:56.401127 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab12ba3e1f542949e3f203dae0fa80e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:56.401705 19767 raft_consensus.cc:3060] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:56.402984 19764 raft_consensus.cc:2468] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:56.403836 19200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f"
I20260928 01:55:56.404599 19200 raft_consensus.cc:2393] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 81ebb46a410e43ebaec3ef4dd13a71fc in current term 5: Already voted for candidate c17b7f9972364c76893311539b569e0f in this term.
I20260928 01:55:56.410064 21118 raft_consensus.cc:493] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:56.410723 21118 raft_consensus.cc:515] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.415194 19767 raft_consensus.cc:2468] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:56.425323 19890 ts_tablet_manager.cc:1434] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260928 01:55:56.426826 19890 tablet_bootstrap.cc:492] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:56.430109 21255 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 5 election: Requested vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:56.431653 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294"
I20260928 01:55:56.438320 20553 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81ebb46a410e43ebaec3ef4dd13a71fc in term 5.
I20260928 01:55:56.439822 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: c17b7f9972364c76893311539b569e0f
I20260928 01:55:56.444465 21255 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 5 FOLLOWER]: Leader election won for term 5
I20260928 01:55:56.423483 21118 leader_election.cc:290] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:56.454088 21255 raft_consensus.cc:697] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 5 LEADER]: Becoming Leader. State: Replica: 81ebb46a410e43ebaec3ef4dd13a71fc, State: Running, Role: LEADER
I20260928 01:55:56.456542 21255 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 341, Committed index: 341, Last appended: 4.341, Last appended by leader: 341, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:56.466440 19896 tablet_bootstrap.cc:492] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:56.467072 19890 tablet_bootstrap.cc:654] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.471069 21223 raft_consensus.cc:493] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:56.471665 21223 raft_consensus.cc:515] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:56.472536 19896 tablet_bootstrap.cc:654] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.474114 21223 leader_election.cc:290] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:56.477814 21267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81ebb46a410e43ebaec3ef4dd13a71fc. Latest consensus state: current_term: 5 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:56.478968 21267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: LEADER
I20260928 01:55:56.480866 21271 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 01:55:56.497107 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:56.498142 21272 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:56.498656 19896 tablet_bootstrap.cc:492] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:56.499145 19896 ts_tablet_manager.cc:1403] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.000s
I20260928 01:55:56.501936 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf1b727e86a43b08bd464647fa529a3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:56.504808 19409 leader_election.cc:343] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:56.504832 19896 raft_consensus.cc:359] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.505753 19896 raft_consensus.cc:385] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.507283 19896 raft_consensus.cc:740] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.508101 19896 consensus_queue.cc:260] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.499094 21272 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:56.510454 19896 ts_tablet_manager.cc:1434] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
W20260928 01:55:56.523945 19103 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0669f9f51b05479aa9715e06d4c42423 consensus state has no leader
I20260928 01:55:56.527604 20029 raft_consensus.cc:359] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.528317 20029 raft_consensus.cc:385] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.528594 20029 raft_consensus.cc:740] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.529314 20029 consensus_queue.cc:260] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.531360 20029 ts_tablet_manager.cc:1434] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.291s	user 0.000s	sys 0.004s
I20260928 01:55:56.533514 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d70a8be7244c86864187420a4fd5f5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:56.550519 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:56.546891 21272 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:56.551270 20553 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c17b7f9972364c76893311539b569e0f in term 5.
I20260928 01:55:56.552547 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f; no voters: 
I20260928 01:55:56.557037 21272 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260928 01:55:56.560340 21272 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:56.562549 19896 tablet_bootstrap.cc:492] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:56.563169 21272 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 5 FOLLOWER]: Advancing to term 6
I20260928 01:55:56.570145 19890 tablet_bootstrap.cc:492] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:56.570708 19890 ts_tablet_manager.cc:1403] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.144s	user 0.019s	sys 0.028s
I20260928 01:55:56.575577 21246 raft_consensus.cc:493] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:56.576124 21246 raft_consensus.cc:515] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.577855 19890 raft_consensus.cc:359] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.578527 19890 raft_consensus.cc:385] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.578460 21246 leader_election.cc:290] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:56.578761 19890 raft_consensus.cc:740] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.568075 19896 tablet_bootstrap.cc:654] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:56.584817 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 282208us
I20260928 01:55:56.593601 21078 consensus_queue.cc:1048] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:56.597234 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a73835e2854976b40b31fe752d1b1b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:56.597841 19476 raft_consensus.cc:2468] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:56.586126 19890 consensus_queue.cc:260] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.603829 19896 tablet_bootstrap.cc:492] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:56.604852 19896 ts_tablet_manager.cc:1403] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.005s
W20260928 01:55:56.605820 19179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 53319.2us
I20260928 01:55:56.607404 19896 raft_consensus.cc:359] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.608053 19896 raft_consensus.cc:385] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.608340 19896 raft_consensus.cc:740] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.609027 19896 consensus_queue.cc:260] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.611048 19896 ts_tablet_manager.cc:1434] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260928 01:55:56.612023 19896 tablet_bootstrap.cc:492] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:56.618156 19703 leader_election.cc:304] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:56.619098 21078 raft_consensus.cc:2804] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:56.619448 21078 raft_consensus.cc:493] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:56.619756 21078 raft_consensus.cc:3060] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:56.621881 21272 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:56.627826 21078 raft_consensus.cc:515] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.628172 21272 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 6 election: Requested vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:56.630887 19890 ts_tablet_manager.cc:1434] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260928 01:55:56.631804 21266 raft_consensus.cc:493] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:56.632129 19890 tablet_bootstrap.cc:492] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:56.632401 21266 raft_consensus.cc:515] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:56.634616 21266 leader_election.cc:290] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:56.635321 19556 leader_election.cc:304] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:56.636351 21223 raft_consensus.cc:2804] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:56.636729 21223 raft_consensus.cc:493] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:56.637049 21223 raft_consensus.cc:3060] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:56.643164 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a73835e2854976b40b31fe752d1b1b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:56.643695 19896 tablet_bootstrap.cc:654] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.644407 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53d75604ee3405d83fe9ecaa824ea68" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:56.649852 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294"
I20260928 01:55:56.651211 20553 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 5 FOLLOWER]: Advancing to term 6
I20260928 01:55:56.654479 19764 raft_consensus.cc:1240] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:55:56.655241 19896 tablet_bootstrap.cc:492] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:56.655767 19896 ts_tablet_manager.cc:1403] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.005s
I20260928 01:55:56.656165 21078 leader_election.cc:290] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:56.658730 19896 raft_consensus.cc:359] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.659426 19896 raft_consensus.cc:385] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.659694 19896 raft_consensus.cc:740] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.660380 19896 consensus_queue.cc:260] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.662536 19896 ts_tablet_manager.cc:1434] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260928 01:55:56.663419 20029 tablet_bootstrap.cc:492] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:56.663544 19896 tablet_bootstrap.cc:492] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:56.653569 19766 raft_consensus.cc:2393] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:56.669467 19896 tablet_bootstrap.cc:654] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.677731 19890 tablet_bootstrap.cc:654] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:56.683460 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 48300.5us
I20260928 01:55:56.693498 20029 tablet_bootstrap.cc:654] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.695957 19896 tablet_bootstrap.cc:492] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:56.696457 19896 ts_tablet_manager.cc:1403] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.004s
I20260928 01:55:56.699205 19896 raft_consensus.cc:359] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.699918 19896 raft_consensus.cc:385] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.700189 19896 raft_consensus.cc:740] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.700896 19896 consensus_queue.cc:260] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.701663 21266 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:56.702199 21266 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.704286 21266 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:56.704340 19409 leader_election.cc:343] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:56.706593 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53d75604ee3405d83fe9ecaa824ea68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:56.709003 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a73835e2854976b40b31fe752d1b1b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:56.709625 19476 raft_consensus.cc:3060] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:56.711130 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a73835e2854976b40b31fe752d1b1b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:56.712044 19616 raft_consensus.cc:2393] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:56.711071 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a73835e2854976b40b31fe752d1b1b" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:56.713291 19619 raft_consensus.cc:2393] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:56.718550 21223 raft_consensus.cc:515] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.721710 19553 leader_election.cc:304] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:56.722720 19553 leader_election.cc:304] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:55:56.724637 21163 consensus_queue.cc:1059] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:56.725325 21163 consensus_queue.cc:1243] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer 8373bfae1f384c36b5e4c5ca26b208da log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260928 01:55:56.727195 21163 raft_consensus.cc:2804] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:56.731242 19896 ts_tablet_manager.cc:1434] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260928 01:55:56.732369 19896 tablet_bootstrap.cc:492] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:56.736852 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:56.738531 19409 leader_election.cc:343] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:56.728168 21205 raft_consensus.cc:2804] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:56.727679 21163 raft_consensus.cc:697] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:56.753265 19896 tablet_bootstrap.cc:654] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.755681 19476 raft_consensus.cc:2468] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:56.766829 19896 tablet_bootstrap.cc:492] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:56.767257 19896 ts_tablet_manager.cc:1403] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.003s
I20260928 01:55:56.766935 20553 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c17b7f9972364c76893311539b569e0f in term 6.
I20260928 01:55:56.772485 20029 tablet_bootstrap.cc:492] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:56.773205 19703 leader_election.cc:304] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:55:56.774771 21245 raft_consensus.cc:2804] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:56.775278 21245 raft_consensus.cc:697] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:56.776182 21245 consensus_queue.cc:237] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.776530 19896 raft_consensus.cc:359] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.777200 19896 raft_consensus.cc:385] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.777446 19896 raft_consensus.cc:740] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.778084 19896 consensus_queue.cc:260] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.780067 19896 ts_tablet_manager.cc:1434] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260928 01:55:56.781051 19896 tablet_bootstrap.cc:492] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:56.783663 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f; no voters: 
I20260928 01:55:56.785307 21272 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 6 FOLLOWER]: Leader election won for term 6
I20260928 01:55:56.785787 21272 raft_consensus.cc:697] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 6 LEADER]: Becoming Leader. State: Replica: c17b7f9972364c76893311539b569e0f, State: Running, Role: LEADER
I20260928 01:55:56.786577 21272 consensus_queue.cc:237] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 341, Committed index: 341, Last appended: 4.341, Last appended by leader: 341, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:56.790125 20029 ts_tablet_manager.cc:1403] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.258s	user 0.012s	sys 0.000s
I20260928 01:55:56.792780 20029 raft_consensus.cc:359] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:56.796620 20029 raft_consensus.cc:385] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.796934 19896 tablet_bootstrap.cc:654] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.797562 20029 raft_consensus.cc:740] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.729435 21256 raft_consensus.cc:3055] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
W20260928 01:55:56.762343 19553 leader_election.cc:343] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:56.800479 21275 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17b7f9972364c76893311539b569e0f. Latest consensus state: current_term: 6 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:56.801180 21275 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: LEADER
W20260928 01:55:56.801329 19701 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 47264.6us
I20260928 01:55:56.800418 20029 consensus_queue.cc:260] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:55:56.802227 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 114428us
I20260928 01:55:56.805840 20029 ts_tablet_manager.cc:1434] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260928 01:55:56.818812 19896 tablet_bootstrap.cc:492] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:56.819236 19896 ts_tablet_manager.cc:1403] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.002s
I20260928 01:55:56.820034 20029 tablet_bootstrap.cc:492] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:56.821642 19896 raft_consensus.cc:359] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.822299 19896 raft_consensus.cc:385] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.822553 19896 raft_consensus.cc:740] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.823189 19896 consensus_queue.cc:260] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.825538 21266 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:56.825949 21266 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:56.828768 21266 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:56.837164 19890 tablet_bootstrap.cc:492] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:56.837634 19890 ts_tablet_manager.cc:1403] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.206s	user 0.021s	sys 0.008s
I20260928 01:55:56.800474 21256 raft_consensus.cc:740] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:56.839552 21245 raft_consensus.cc:493] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:56.840039 21245 raft_consensus.cc:515] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.801957 21205 raft_consensus.cc:697] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:56.842491 21205 consensus_queue.cc:237] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.843524 21245 leader_election.cc:290] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:56.845845 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6a5cb9b09e4e5a8400bf71dbf99987" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:56.846484 19476 raft_consensus.cc:2468] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:56.846961 19896 ts_tablet_manager.cc:1434] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260928 01:55:56.847704 19703 leader_election.cc:304] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:56.824750 21212 consensus_queue.cc:1048] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260928 01:55:56.848626 21245 raft_consensus.cc:2804] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:56.849030 21245 raft_consensus.cc:493] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:56.849404 21245 raft_consensus.cc:3060] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:56.849670 21163 consensus_queue.cc:237] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.851018 19890 raft_consensus.cc:359] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.854029 19890 raft_consensus.cc:385] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.854323 19890 raft_consensus.cc:740] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.854998 19890 consensus_queue.cc:260] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.857008 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:56.860387 19409 leader_election.cc:343] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:56.862229 21289 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 01:55:56.871541 20029 tablet_bootstrap.cc:654] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.872303 19890 ts_tablet_manager.cc:1434] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260928 01:55:56.872780 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6a5cb9b09e4e5a8400bf71dbf99987" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:56.847858 21223 leader_election.cc:290] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:56.883031 21245 raft_consensus.cc:515] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.883376 19617 raft_consensus.cc:2393] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:56.897701 19476 raft_consensus.cc:1275] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:55:56.907655 19890 tablet_bootstrap.cc:492] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:56.910864 19896 tablet_bootstrap.cc:492] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:56.921370 19896 tablet_bootstrap.cc:654] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.935647 19896 tablet_bootstrap.cc:492] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:56.936163 19896 ts_tablet_manager.cc:1403] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.004s
I20260928 01:55:56.945566 19896 raft_consensus.cc:359] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.946264 19896 raft_consensus.cc:385] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:56.946807 19896 raft_consensus.cc:740] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:56.947453 19896 consensus_queue.cc:260] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:56.948932 19896 ts_tablet_manager.cc:1434] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.005s
I20260928 01:55:56.899600 21279 consensus_queue.cc:1048] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:56.949841 19896 tablet_bootstrap.cc:492] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:56.955572 19896 tablet_bootstrap.cc:654] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:56.979867 20029 tablet_bootstrap.cc:492] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
W20260928 01:55:56.918879 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 117316us
W20260928 01:55:56.981622 19553 leader_election.cc:343] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:56.983161 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6a5cb9b09e4e5a8400bf71dbf99987" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:56.983815 19469 raft_consensus.cc:3060] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:56.987249 20029 ts_tablet_manager.cc:1403] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.167s	user 0.009s	sys 0.006s
I20260928 01:55:56.990455 19896 tablet_bootstrap.cc:492] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:56.990897 19896 ts_tablet_manager.cc:1403] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.004s
I20260928 01:55:56.992125 19471 raft_consensus.cc:1275] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:55:56.994305 21279 consensus_queue.cc:1048] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:57.000982 19469 raft_consensus.cc:2468] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:56.882726 21256 consensus_queue.cc:260] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.006592 19703 leader_election.cc:304] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:57.008154 21246 raft_consensus.cc:2804] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:57.008679 21246 raft_consensus.cc:697] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:57.009508 21246 consensus_queue.cc:237] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:57.010705 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 107648us
I20260928 01:55:57.010761 19896 raft_consensus.cc:359] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.011466 19896 raft_consensus.cc:385] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:57.011714 19896 raft_consensus.cc:740] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:57.014736 19890 tablet_bootstrap.cc:654] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:57.027247 19556 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:57.030179 21245 leader_election.cc:290] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:57.037046 19896 consensus_queue.cc:260] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.038659 21266 raft_consensus.cc:493] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.039085 21266 raft_consensus.cc:515] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.039621 19896 ts_tablet_manager.cc:1434] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.002s
I20260928 01:55:57.041581 21258 raft_consensus.cc:493] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.041316 20029 raft_consensus.cc:359] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.042172 20029 raft_consensus.cc:385] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:57.042450 20029 raft_consensus.cc:740] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:57.042080 21258 raft_consensus.cc:515] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.043135 20029 consensus_queue.cc:260] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.045044 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:57.048151 19409 leader_election.cc:343] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:57.048421 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:57.048730 21258 leader_election.cc:290] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:57.050259 19409 leader_election.cc:343] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:57.051451 21266 leader_election.cc:290] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:57.051031 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 68775.6us
I20260928 01:55:57.065256 21290 consensus_queue.cc:1059] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.010s
W20260928 01:55:57.067669 19553 leader_election.cc:343] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:57.069875 19896 tablet_bootstrap.cc:492] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:57.069216 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 57920.7us
I20260928 01:55:57.072901 19890 tablet_bootstrap.cc:492] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:57.073385 19890 ts_tablet_manager.cc:1403] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.004s
I20260928 01:55:57.073947 21056 consensus_queue.cc:1048] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:57.075652 20029 ts_tablet_manager.cc:1434] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.000s
I20260928 01:55:57.076849 21256 raft_consensus.cc:3060] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:57.055771 21223 raft_consensus.cc:2804] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:57.084643 20029 tablet_bootstrap.cc:492] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:57.081269 19896 tablet_bootstrap.cc:654] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:57.100548 20029 tablet_bootstrap.cc:654] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:57.068461 19613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6a5cb9b09e4e5a8400bf71dbf99987" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:57.105448 19613 raft_consensus.cc:2393] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:57.105484 19890 raft_consensus.cc:359] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.106300 19890 raft_consensus.cc:385] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:57.106479 21223 raft_consensus.cc:697] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:57.106570 19890 raft_consensus.cc:740] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:57.107182 19890 consensus_queue.cc:260] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.107354 21223 consensus_queue.cc:237] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.109392 19890 ts_tablet_manager.cc:1434] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.002s
I20260928 01:55:57.110306 19890 tablet_bootstrap.cc:492] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:57.112988 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 45359.7us
I20260928 01:55:57.125916 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6a5cb9b09e4e5a8400bf71dbf99987" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:57.128772 21056 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.129367 21212 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.129833 21212 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:57.130223 21098 raft_consensus.cc:493] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.130642 21098 raft_consensus.cc:515] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.131884 21212 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:57.132133 21245 raft_consensus.cc:493] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.132534 21098 leader_election.cc:290] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:57.132727 21245 raft_consensus.cc:515] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:57.133652 21056 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:57.137187 21056 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:57.112813 21290 consensus_queue.cc:1243] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer 8373bfae1f384c36b5e4c5ca26b208da log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260928 01:55:57.138438 19890 tablet_bootstrap.cc:654] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:57.140352 21173 consensus_queue.cc:1048] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:57.146158 21205 raft_consensus.cc:3055] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:55:57.146557 21205 raft_consensus.cc:740] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:55:57.147274 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:57.147303 21205 consensus_queue.cc:260] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.147964 19469 raft_consensus.cc:2468] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:57.148402 21205 raft_consensus.cc:3060] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:55:57.157438 19703 leader_election.cc:304] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:57.169322 21245 leader_election.cc:290] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:57.183377 21076 raft_consensus.cc:2804] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:57.183876 21076 raft_consensus.cc:493] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:57.184384 21076 raft_consensus.cc:3060] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.187299 19890 tablet_bootstrap.cc:492] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:57.187755 19890 ts_tablet_manager.cc:1403] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.078s	user 0.003s	sys 0.011s
W20260928 01:55:57.188226 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 52948.5us
I20260928 01:55:57.190618 21258 raft_consensus.cc:493] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.191200 21258 raft_consensus.cc:515] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.195708 21258 leader_election.cc:290] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:57.198791 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:57.204026 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:57.206936 19553 leader_election.cc:343] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:57.208483 19553 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
W20260928 01:55:57.209088 19553 leader_election.cc:343] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:57.210021 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 52722.1us
I20260928 01:55:57.214921 19890 raft_consensus.cc:359] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.215631 19890 raft_consensus.cc:385] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:57.215924 19890 raft_consensus.cc:740] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:57.217006 19890 consensus_queue.cc:260] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.218575 19890 ts_tablet_manager.cc:1434] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.031s	user 0.000s	sys 0.007s
I20260928 01:55:57.219674 19890 tablet_bootstrap.cc:492] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:57.227309 20029 tablet_bootstrap.cc:492] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:57.227650 19890 tablet_bootstrap.cc:654] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:57.228022 20029 ts_tablet_manager.cc:1403] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.144s	user 0.010s	sys 0.012s
I20260928 01:55:57.230527 19412 leader_election.cc:304] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:57.230700 20029 raft_consensus.cc:359] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.231913 20029 raft_consensus.cc:385] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:57.232268 20029 raft_consensus.cc:740] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:57.233043 20029 consensus_queue.cc:260] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.236733 19412 leader_election.cc:304] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:57.240993 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.241856 19619 raft_consensus.cc:2468] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:57.247710 19619 raft_consensus.cc:1275] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:55:57.264012 21258 raft_consensus.cc:2764] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 01:55:57.273406 21258 raft_consensus.cc:2749] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:57.264087 21266 raft_consensus.cc:493] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.276185 21266 raft_consensus.cc:515] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.278743 21266 leader_election.cc:290] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:57.289541 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 52903.3us
I20260928 01:55:57.290979 19412 leader_election.cc:304] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:57.291759 21258 raft_consensus.cc:2804] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:57.292160 21258 raft_consensus.cc:493] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:57.292788 21258 raft_consensus.cc:3060] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.299059 21076 raft_consensus.cc:515] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:57.325423 21076 leader_election.cc:290] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:57.336059 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
W20260928 01:55:57.354838 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 83086.1us
I20260928 01:55:57.358155 20553 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Refusing update from remote peer c17b7f9972364c76893311539b569e0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 341. Preceding OpId from leader: term: 6 index: 342. (index mismatch)
I20260928 01:55:57.360019 21275 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 342, Last known committed idx: 341, Time since last communication: 0.001s
I20260928 01:55:57.287470 19617 raft_consensus.cc:1275] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260928 01:55:57.399619 19617 pending_rounds.cc:85] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0: Aborting all ops after (but not including) 0
I20260928 01:55:57.400038 19617 pending_rounds.cc:107] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260928 01:55:57.400465 19617 raft_consensus.cc:2889] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260928 01:55:57.391302 21257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.005s	sys 0.007s
W20260928 01:55:57.404896 21257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.005s	sys 0.008s
W20260928 01:55:57.441643 19615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.003s	sys 0.027s
W20260928 01:55:57.442143 19615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.003s	sys 0.027s
I20260928 01:55:57.444222 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf1b727e86a43b08bd464647fa529a3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:57.444828 19767 raft_consensus.cc:2468] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:57.447033 19409 leader_election.cc:304] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:57.448737 21266 raft_consensus.cc:2804] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:57.449091 21266 raft_consensus.cc:493] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:57.449438 21266 raft_consensus.cc:3060] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.454243 20029 ts_tablet_manager.cc:1434] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.226s	user 0.002s	sys 0.017s
I20260928 01:55:57.455152 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cacb4a90a54cd3b5b3e7a9310e06ed" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:57.458698 21266 raft_consensus.cc:515] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.459127 20547 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Rejecting Update request from peer 81ebb46a410e43ebaec3ef4dd13a71fc for earlier term 5. Current term is 6. Ops: []
I20260928 01:55:57.455458 20029 tablet_bootstrap.cc:492] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:57.462215 21304 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 342, Last known committed idx: 341, Time since last communication: 0.000s
I20260928 01:55:57.463171 21304 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 5 LEADER]: Stepping down as leader of term 5
I20260928 01:55:57.463622 21304 raft_consensus.cc:740] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 81ebb46a410e43ebaec3ef4dd13a71fc, State: Running, Role: LEADER
I20260928 01:55:57.463706 21279 consensus_queue.cc:1048] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:55:57.464607 21304 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 341, Committed index: 341, Last appended: 5.342, Last appended by leader: 342, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:57.465385 20029 tablet_bootstrap.cc:654] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:57.465780 21304 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 5 FOLLOWER]: Advancing to term 6
I20260928 01:55:57.466713 21327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17b7f9972364c76893311539b569e0f. Latest consensus state: current_term: 6 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:57.467473 21327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:57.468387 21314 consensus_queue.cc:1048] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:57.468726 19890 tablet_bootstrap.cc:492] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:57.469169 19890 ts_tablet_manager.cc:1403] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.250s	user 0.008s	sys 0.012s
I20260928 01:55:57.473045 19890 raft_consensus.cc:359] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.473699 19890 raft_consensus.cc:385] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:57.473958 19890 raft_consensus.cc:740] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:57.474519 19890 consensus_queue.cc:260] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.475122 21317 raft_consensus.cc:493] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.475589 21317 raft_consensus.cc:515] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.476311 19890 ts_tablet_manager.cc:1434] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260928 01:55:57.478726 21317 leader_election.cc:290] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:55:57.474223 19409 leader_election.cc:343] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:57.483397 21266 leader_election.cc:290] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:57.484947 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf1b727e86a43b08bd464647fa529a3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:57.485570 19765 raft_consensus.cc:3060] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.488029 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d70a8be7244c86864187420a4fd5f5" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:57.488710 19469 raft_consensus.cc:2468] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:57.490767 21266 raft_consensus.cc:493] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.491338 21266 raft_consensus.cc:515] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.492105 20029 tablet_bootstrap.cc:492] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:57.492590 20029 ts_tablet_manager.cc:1403] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.037s	user 0.004s	sys 0.008s
I20260928 01:55:57.495520 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:57.496969 19409 leader_election.cc:343] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:57.500758 19703 leader_election.cc:304] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:57.501716 21223 raft_consensus.cc:493] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.502272 21223 raft_consensus.cc:515] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.505147 21223 leader_election.cc:290] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:57.509702 21266 leader_election.cc:290] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:57.510881 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba]
W20260928 01:55:57.510856 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 217788us
I20260928 01:55:57.521593 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:57.522416 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619]
I20260928 01:55:57.523962 19896 tablet_bootstrap.cc:492] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:57.523949 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e]
I20260928 01:55:57.509150 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:57.517412 19765 raft_consensus.cc:2468] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
W20260928 01:55:57.525676 19553 leader_election.cc:343] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:57.527390 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]
I20260928 01:55:57.527889 19617 raft_consensus.cc:3060] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.531224 19890 tablet_bootstrap.cc:492] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:57.530871 21258 raft_consensus.cc:515] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:57.532399 19476 raft_consensus.cc:2393] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:57.535146 21279 raft_consensus.cc:2804] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:57.535594 21279 raft_consensus.cc:493] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:57.536010 21279 raft_consensus.cc:3060] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.545557 19896 ts_tablet_manager.cc:1403] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.476s	user 0.046s	sys 0.099s
I20260928 01:55:57.557515 19890 tablet_bootstrap.cc:654] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:57.558425 19409 leader_election.cc:304] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:57.559535 21319 raft_consensus.cc:493] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.560081 21323 raft_consensus.cc:2804] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:57.559995 21319 raft_consensus.cc:515] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.560609 21323 raft_consensus.cc:697] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:57.561436 21323 consensus_queue.cc:237] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.562008 21319 leader_election.cc:290] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:57.564347 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cfc9ff3344a48b09730dfde79d6cf" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:57.567118 19409 leader_election.cc:343] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:57.572635 20029 raft_consensus.cc:359] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.573395 20029 raft_consensus.cc:385] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:57.573668 20029 raft_consensus.cc:740] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:57.585530 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:57.586191 19469 raft_consensus.cc:3060] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:57.586376 19103 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 22e095aba1cb4fb7be461d625a922751 consensus state has no leader
I20260928 01:55:57.590384 19476 raft_consensus.cc:1217] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1]   Dedup: 1.1->[]
I20260928 01:55:57.592936 19476 raft_consensus.cc:1240] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 01:55:57.597573 19613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d70a8be7244c86864187420a4fd5f5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.598259 19613 raft_consensus.cc:2468] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:57.538719 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2]
I20260928 01:55:57.606380 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85]
I20260928 01:55:57.609793 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]
I20260928 01:55:57.613106 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca]
I20260928 01:55:57.614677 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d70a8be7244c86864187420a4fd5f5" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.615255 19621 raft_consensus.cc:2468] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:57.618669 19896 raft_consensus.cc:359] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.619045 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.619357 19896 raft_consensus.cc:385] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:57.619624 19896 raft_consensus.cc:740] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:57.619642 19618 raft_consensus.cc:2468] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:57.593566 19469 raft_consensus.cc:2468] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:57.622838 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab12ba3e1f542949e3f203dae0fa80e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:57.623476 19472 raft_consensus.cc:3060] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.581845 20029 consensus_queue.cc:260] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.626647 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae]
I20260928 01:55:57.627280 20029 ts_tablet_manager.cc:1434] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.134s	user 0.011s	sys 0.000s
I20260928 01:55:57.628280 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]
I20260928 01:55:57.628813 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53d75604ee3405d83fe9ecaa824ea68" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.629490 19618 raft_consensus.cc:2468] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:57.631106 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.631714 19618 raft_consensus.cc:2468] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:57.632301 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9]
I20260928 01:55:57.634023 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.634109 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa]
W20260928 01:55:57.634148 19179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 51401.1us
I20260928 01:55:57.634755 19618 raft_consensus.cc:2468] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:57.646406 19472 raft_consensus.cc:2468] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:55:57.654016 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.662431 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_a82317fb7790483884cbb5ebcf554128 [id=292d90fe578e4470bced0890a4e646ef]
I20260928 01:55:57.672801 20029 tablet_bootstrap.cc:492] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:57.647852 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d70a8be7244c86864187420a4fd5f5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:57.679963 21279 raft_consensus.cc:515] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.680364 19469 raft_consensus.cc:2468] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:57.648733 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf1b727e86a43b08bd464647fa529a3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:57.682983 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53d75604ee3405d83fe9ecaa824ea68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:57.683632 19473 raft_consensus.cc:2468] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:57.649458 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a73835e2854976b40b31fe752d1b1b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:57.684755 19468 raft_consensus.cc:2393] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:57.685280 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6a5cb9b09e4e5a8400bf71dbf99987" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:57.686039 19473 raft_consensus.cc:2393] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:57.687398 19473 raft_consensus.cc:1217] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1]   Dedup: 1.1->[]
I20260928 01:55:57.687860 19473 raft_consensus.cc:1240] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 01:55:57.689870 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d70a8be7244c86864187420a4fd5f5" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:57.690454 19619 raft_consensus.cc:3060] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.690969 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:57.691529 19473 raft_consensus.cc:2468] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:57.691609 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:57.692420 19767 raft_consensus.cc:2393] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:57.694195 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d70a8be7244c86864187420a4fd5f5" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:57.694743 19469 raft_consensus.cc:3060] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.698228 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:57.698879 19473 raft_consensus.cc:2468] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:55:57.715770 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf1b727e86a43b08bd464647fa529a3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.682044 21279 leader_election.cc:290] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:57.717260 19621 raft_consensus.cc:2468] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:57.732384 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.733132 19612 raft_consensus.cc:2468] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:57.664788 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]
I20260928 01:55:57.745450 21279 raft_consensus.cc:493] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.745965 21279 raft_consensus.cc:515] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.746747 19469 raft_consensus.cc:2468] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:57.748119 19703 leader_election.cc:304] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:57.749456 21078 raft_consensus.cc:2804] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:57.750044 21078 raft_consensus.cc:697] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:57.750852 21078 consensus_queue.cc:237] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.753700 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:57.754387 19473 raft_consensus.cc:2468] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:57.755739 19703 leader_election.cc:304] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:57.756527 21246 raft_consensus.cc:2804] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:57.756850 21246 raft_consensus.cc:493] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:57.757750 19617 raft_consensus.cc:2468] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:57.757154 21246 raft_consensus.cc:3060] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.748145 21279 leader_election.cc:290] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:57.763969 21279 consensus_queue.cc:1048] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:57.772670 19619 raft_consensus.cc:2468] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:57.782958 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.785207 19621 raft_consensus.cc:2468] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:57.784571 21275 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:57.785588 21275 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: LEADER
I20260928 01:55:57.660530 21258 leader_election.cc:290] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:57.787256 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf1b727e86a43b08bd464647fa529a3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:57.787953 19612 raft_consensus.cc:3060] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.788586 21327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:55:57.789392 21327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:55:57.670078 19896 consensus_queue.cc:260] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.792409 19896 ts_tablet_manager.cc:1434] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.246s	user 0.009s	sys 0.000s
W20260928 01:55:57.792939 19104 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:57.795536 19896 tablet_bootstrap.cc:492] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:57.798894 19612 raft_consensus.cc:2468] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:57.800772 21246 raft_consensus.cc:515] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.816954 21314 consensus_queue.cc:1048] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:57.831238 20029 tablet_bootstrap.cc:654] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:57.831215 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:57.832044 19469 raft_consensus.cc:3060] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.836692 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:57.837005 19704 leader_election.cc:304] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:57.845278 19412 leader_election.cc:304] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:57.846040 21314 raft_consensus.cc:2804] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:57.846735 21314 raft_consensus.cc:697] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:57.846603 21246 leader_election.cc:290] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:57.848826 21258 raft_consensus.cc:2764] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 01:55:57.804613 21257 raft_consensus.cc:493] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:57.851397 21257 raft_consensus.cc:515] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.847968 21314 consensus_queue.cc:237] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:57.855041 21257 leader_election.cc:290] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:57.807042 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cacb4a90a54cd3b5b3e7a9310e06ed" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.808737 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:57.858392 19618 raft_consensus.cc:2468] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:57.811661 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cfc9ff3344a48b09730dfde79d6cf" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:55:57.859272 19703 consensus_peers.cc:597] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 158edf7a5d724c88992fecbadd2cedfa. This is attempt 6: this message will repeat every 5th retry.
I20260928 01:55:57.846060 19469 raft_consensus.cc:2468] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:57.859817 19616 raft_consensus.cc:2468] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:57.831539 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:57.861259 19614 raft_consensus.cc:2393] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:55:57.861282 19703 leader_election.cc:304] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:57.862118 21316 raft_consensus.cc:2804] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:57.862355 19619 raft_consensus.cc:2468] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:57.862598 21316 raft_consensus.cc:697] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:55:57.839278 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:57.863166 19617 raft_consensus.cc:3060] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.863670 21316 consensus_queue.cc:237] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:57.878661 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 55658.4us
W20260928 01:55:57.884615 19555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:57.886933 19890 tablet_bootstrap.cc:492] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:57.887390 19890 ts_tablet_manager.cc:1403] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.356s	user 0.014s	sys 0.006s
I20260928 01:55:57.889933 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:57.892678 19553 leader_election.cc:343] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:57.894313 21257 consensus_queue.cc:1048] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:57.896795 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]
I20260928 01:55:57.898821 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a]
I20260928 01:55:57.907562 19412 leader_election.cc:304] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:57.908946 21321 raft_consensus.cc:2764] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 01:55:57.910452 19412 leader_election.cc:304] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:57.911372 21321 raft_consensus.cc:2804] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:57.911931 21321 raft_consensus.cc:493] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:57.912493 21321 raft_consensus.cc:3060] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.947292 19890 raft_consensus.cc:359] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.947983 19890 raft_consensus.cc:385] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:57.945030 19412 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:57.968313 21258 raft_consensus.cc:2804] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:57.968719 19412 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:57.968871 21258 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:57.969497 21323 raft_consensus.cc:2804] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:57.969429 21258 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.970119 21323 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:57.970615 21323 raft_consensus.cc:3060] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:55:57.977370 19412 leader_election.cc:343] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:57.977455 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305]
I20260928 01:55:57.979802 19412 leader_election.cc:304] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:57.984123 21319 raft_consensus.cc:2749] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:57.924152 19896 tablet_bootstrap.cc:654] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:57.948436 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 44212.3us
I20260928 01:55:57.988488 19890 raft_consensus.cc:740] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:57.948578 21257 consensus_queue.cc:1048] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:57.989622 19890 consensus_queue.cc:260] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:57.993399 21173 consensus_queue.cc:1048] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:57.983834 21258 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:58.002169 19890 ts_tablet_manager.cc:1434] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.115s	user 0.004s	sys 0.006s
I20260928 01:55:58.003290 19890 tablet_bootstrap.cc:492] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:58.005584 19556 leader_election.cc:304] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:58.006861 21304 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:58.007516 21304 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:58.011148 21304 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:55:58.012709 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:55:58.018376 21258 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:58.022575 19556 leader_election.cc:304] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:58.023458 21223 raft_consensus.cc:2764] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 01:55:58.024111 21223 raft_consensus.cc:2749] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:58.025743 19556 leader_election.cc:304] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:58.026894 21173 raft_consensus.cc:2804] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:58.027446 21173 raft_consensus.cc:493] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:58.027673 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:58.028136 21173 raft_consensus.cc:3060] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:57.987954 19412 leader_election.cc:304] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:58.035246 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 47365.9us
I20260928 01:55:58.037057 21319 raft_consensus.cc:2804] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 01:55:58.037267 19409 leader_election.cc:343] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:58.037575 21319 raft_consensus.cc:493] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:58.038059 21319 raft_consensus.cc:3060] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.040506 21223 consensus_queue.cc:1048] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:57.956107 19617 raft_consensus.cc:2468] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:55:58.059351 21323 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:58.076990 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 51330.7us
I20260928 01:55:58.077891 19556 leader_election.cc:304] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:58.078796 20029 tablet_bootstrap.cc:492] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:58.078773 21223 raft_consensus.cc:2749] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:58.079250 20029 ts_tablet_manager.cc:1403] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.451s	user 0.011s	sys 0.005s
I20260928 01:55:58.080289 19556 leader_election.cc:304] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:58.080317 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75]
I20260928 01:55:58.081176 21223 raft_consensus.cc:2749] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:58.083453 20029 raft_consensus.cc:359] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:58.084149 20029 raft_consensus.cc:385] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:58.084460 20029 raft_consensus.cc:740] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:58.085073 20029 consensus_queue.cc:260] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:58.075392 21321 raft_consensus.cc:515] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:58.086479 21266 raft_consensus.cc:493] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:58.083974 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3]
I20260928 01:55:58.118192 21266 raft_consensus.cc:515] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.120529 21321 leader_election.cc:290] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:58.122496 21266 leader_election.cc:290] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:58.125337 19556 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:58.126243 21223 raft_consensus.cc:2804] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:58.126492 20029 ts_tablet_manager.cc:1434] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.004s
I20260928 01:55:58.126673 21223 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:58.127159 21223 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.128669 19896 tablet_bootstrap.cc:492] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:58.129225 19896 ts_tablet_manager.cc:1403] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.334s	user 0.012s	sys 0.011s
I20260928 01:55:58.134455 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]
I20260928 01:55:58.099398 21319 raft_consensus.cc:515] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.143069 19896 raft_consensus.cc:359] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.143791 19896 raft_consensus.cc:385] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:58.145666 20029 tablet_bootstrap.cc:492] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:58.158546 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:58.160307 21319 leader_election.cc:290] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:58.160312 21317 consensus_queue.cc:1048] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:58.162066 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53d75604ee3405d83fe9ecaa824ea68" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:58.162675 19765 raft_consensus.cc:3060] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.144080 19896 raft_consensus.cc:740] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:58.168569 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:58.171216 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:58.181376 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921]
W20260928 01:55:58.191001 19409 leader_election.cc:343] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:58.196911 20029 tablet_bootstrap.cc:654] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:58.196976 19409 leader_election.cc:343] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:58.217021 21323 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:58.148567 21256 raft_consensus.cc:493] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:58.218219 21256 raft_consensus.cc:515] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.219316 19765 raft_consensus.cc:2468] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:58.150805 21257 consensus_queue.cc:1048] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.070s
I20260928 01:55:58.223043 21256 leader_election.cc:290] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:58.225301 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375]
I20260928 01:55:58.227723 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]
W20260928 01:55:58.196465 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 71213.2us
I20260928 01:55:58.245217 21327 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:55:58.245884 21327 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:55:58.139250 21223 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:58.249668 21327 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:55:58.258558 20029 tablet_bootstrap.cc:492] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:58.261713 20029 ts_tablet_manager.cc:1403] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.005s
I20260928 01:55:58.253147 19409 leader_election.cc:304] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:58.269033 21323 raft_consensus.cc:2804] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:58.276952 20029 raft_consensus.cc:359] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.277661 20029 raft_consensus.cc:385] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:58.277953 20029 raft_consensus.cc:740] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:55:58.277835 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 63222.4us
I20260928 01:55:58.278723 20029 consensus_queue.cc:260] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.281839 21223 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:58.283561 21323 raft_consensus.cc:697] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
W20260928 01:55:58.291292 19104 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:58.292662 20029 ts_tablet_manager.cc:1434] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260928 01:55:58.250607 19896 consensus_queue.cc:260] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.293685 20029 tablet_bootstrap.cc:492] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:58.255475 19890 tablet_bootstrap.cc:654] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:58.252005 19556 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
I20260928 01:55:58.304116 19556 leader_election.cc:304] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:58.305370 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 53416.8us
I20260928 01:55:58.216615 21173 raft_consensus.cc:515] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:58.319191 19896 ts_tablet_manager.cc:1434] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.190s	user 0.007s	sys 0.005s
I20260928 01:55:58.322912 20029 tablet_bootstrap.cc:654] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:58.323179 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:58.340752 21315 consensus_queue.cc:1048] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:58.347615 20029 tablet_bootstrap.cc:492] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:58.348054 20029 ts_tablet_manager.cc:1403] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.055s	user 0.005s	sys 0.004s
I20260928 01:55:58.362778 20029 raft_consensus.cc:359] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.363497 20029 raft_consensus.cc:385] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:58.363768 20029 raft_consensus.cc:740] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:58.364545 20029 consensus_queue.cc:260] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.365388 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]
I20260928 01:55:58.366853 20029 ts_tablet_manager.cc:1434] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.007s
I20260928 01:55:58.367022 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]
I20260928 01:55:58.306423 19556 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:58.371779 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 65447.5us
I20260928 01:55:58.372792 21361 raft_consensus.cc:2804] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:58.373284 21361 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:58.373757 21361 raft_consensus.cc:3060] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.378887 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a]
I20260928 01:55:58.310510 21363 raft_consensus.cc:2749] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:55:58.370618 19553 leader_election.cc:343] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:58.384402 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:58.389108 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]
I20260928 01:55:58.391332 20029 tablet_bootstrap.cc:492] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:58.391386 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]
I20260928 01:55:58.394528 19896 tablet_bootstrap.cc:492] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:58.293862 21323 consensus_queue.cc:237] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:55:58.418929 21173 leader_election.cc:290] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:58.420907 20029 tablet_bootstrap.cc:654] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:58.427114 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 54618.5us
I20260928 01:55:58.438310 19556 leader_election.cc:304] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:58.470917 21173 raft_consensus.cc:2749] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:58.471285 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513]
I20260928 01:55:58.487275 20029 tablet_bootstrap.cc:492] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:58.487718 20029 ts_tablet_manager.cc:1403] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.097s	user 0.016s	sys 0.008s
I20260928 01:55:58.491533 20029 raft_consensus.cc:359] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:58.494195 21363 consensus_queue.cc:1048] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:58.496907 19890 tablet_bootstrap.cc:492] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:58.497366 19890 ts_tablet_manager.cc:1403] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.494s	user 0.009s	sys 0.009s
I20260928 01:55:58.499112 19412 leader_election.cc:304] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:58.499848 19890 raft_consensus.cc:359] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.500519 19890 raft_consensus.cc:385] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:58.500799 19890 raft_consensus.cc:740] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:58.501008 19412 leader_election.cc:304] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:58.501408 19890 consensus_queue.cc:260] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.502210 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:58.503468 19890 ts_tablet_manager.cc:1434] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260928 01:55:58.503834 19412 leader_election.cc:304] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:58.504424 19890 tablet_bootstrap.cc:492] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:58.509269 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]
I20260928 01:55:58.510192 19890 tablet_bootstrap.cc:654] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:58.457122 21361 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:58.520267 21361 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:58.539705 19102 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.528s (SENT) [suppressed 1 similar messages]
I20260928 01:55:58.554214 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd]
W20260928 01:55:58.554870 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 50709.2us
W20260928 01:55:58.556692 19553 leader_election.cc:343] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:58.502099 21319 raft_consensus.cc:2804] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:58.560948 19412 leader_election.cc:304] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:58.566566 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53d75604ee3405d83fe9ecaa824ea68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:58.559832 21258 raft_consensus.cc:2804] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:58.575695 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:58.576166 21359 raft_consensus.cc:2749] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:58.579499 19896 tablet_bootstrap.cc:654] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:58.577312 21258 raft_consensus.cc:493] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:58.580729 21258 raft_consensus.cc:3060] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.560470 21319 raft_consensus.cc:493] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:58.595137 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:58.595911 19617 raft_consensus.cc:2393] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:58.583106 21359 raft_consensus.cc:2804] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 01:55:58.608091 19179 leader_election.cc:336] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.846s (SENT)
I20260928 01:55:58.584425 21319 raft_consensus.cc:3060] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.596984 21359 raft_consensus.cc:493] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:58.612932 21359 raft_consensus.cc:3060] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.621694 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:58.610234 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]
I20260928 01:55:58.656289 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:58.657510 19617 raft_consensus.cc:2393] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:58.658021 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]
I20260928 01:55:58.659449 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a]
I20260928 01:55:58.666461 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53d75604ee3405d83fe9ecaa824ea68" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:58.667585 19617 raft_consensus.cc:2393] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:58.671753 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:58.672708 21316 raft_consensus.cc:493] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:58.673763 21316 raft_consensus.cc:515] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.665573 20029 raft_consensus.cc:385] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:58.681329 20029 raft_consensus.cc:740] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:58.682391 20029 consensus_queue.cc:260] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:58.685377 19179 leader_election.cc:336] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.923s (SENT)
I20260928 01:55:58.638720 21321 raft_consensus.cc:493] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:58.694577 21316 leader_election.cc:290] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:58.698575 19896 tablet_bootstrap.cc:492] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:58.699064 19896 ts_tablet_manager.cc:1403] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.305s	user 0.006s	sys 0.008s
I20260928 01:55:58.699124 21258 raft_consensus.cc:515] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.691968 20029 ts_tablet_manager.cc:1434] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.204s	user 0.007s	sys 0.004s
I20260928 01:55:58.702047 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53d75604ee3405d83fe9ecaa824ea68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:58.704842 19768 raft_consensus.cc:2393] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:58.704001 20029 tablet_bootstrap.cc:492] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:58.687623 19466 raft_consensus.cc:2393] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:58.707929 21321 raft_consensus.cc:515] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.715366 21321 leader_election.cc:290] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:58.717036 19613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:58.717080 21363 consensus_queue.cc:1048] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:58.721426 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:58.722019 19617 raft_consensus.cc:3060] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.722455 21258 leader_election.cc:290] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:58.728690 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 170065us
I20260928 01:55:58.730764 21359 raft_consensus.cc:515] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.730791 21319 raft_consensus.cc:515] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.733026 19469 raft_consensus.cc:2393] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:58.733897 21319 leader_election.cc:290] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:58.750438 19890 tablet_bootstrap.cc:492] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:58.750911 19890 ts_tablet_manager.cc:1403] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.247s	user 0.023s	sys 0.048s
I20260928 01:55:58.733911 21359 leader_election.cc:290] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:58.756703 21258 consensus_queue.cc:1048] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:55:58.758874 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 219195us
W20260928 01:55:58.760082 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f709eccf4ab5413bbbd8b4746f185db4 (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f709eccf4ab5413bbbd8b4746f185db4 consensus state has no leader
I20260928 01:55:58.761607 19890 raft_consensus.cc:359] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.764462 19890 raft_consensus.cc:385] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:58.765143 19890 raft_consensus.cc:740] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
W20260928 01:55:58.766848 19104 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:58.766741 19890 consensus_queue.cc:260] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.768280 19890 ts_tablet_manager.cc:1434] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260928 01:55:58.769201 19890 tablet_bootstrap.cc:492] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:58.772091 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cfc9ff3344a48b09730dfde79d6cf" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:58.772836 19469 raft_consensus.cc:2393] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:58.774842 19896 raft_consensus.cc:359] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.775523 19896 raft_consensus.cc:385] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:58.775820 19896 raft_consensus.cc:740] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
W20260928 01:55:58.775923 19553 leader_election.cc:343] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:58.776914 19896 consensus_queue.cc:260] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.777349 19890 tablet_bootstrap.cc:654] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:58.778620 19896 ts_tablet_manager.cc:1434] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.000s
I20260928 01:55:58.780551 19896 tablet_bootstrap.cc:492] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:58.794122 20029 tablet_bootstrap.cc:654] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:58.798112 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:55:58.798996 19466 raft_consensus.cc:2393] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:58.810480 19890 tablet_bootstrap.cc:492] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:58.811863 19890 ts_tablet_manager.cc:1403] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.007s
I20260928 01:55:58.821712 19617 raft_consensus.cc:2468] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:58.842832 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]
I20260928 01:55:58.843796 21386 consensus_queue.cc:1048] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:58.844553 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]
I20260928 01:55:58.844007 21385 consensus_queue.cc:1048] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:55:58.845996 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]
I20260928 01:55:58.822188 19613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cfc9ff3344a48b09730dfde79d6cf" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:58.868757 19613 raft_consensus.cc:2468] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:55:58.877326 21386 consensus_queue.cc:1048] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:58.880028 19412 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:58.880904 21359 raft_consensus.cc:2749] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:58.882179 19412 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:55:58.870294 19556 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 64129.4us
I20260928 01:55:58.885648 21359 raft_consensus.cc:2749] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 01:55:58.891528 20447 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.642s (SENT) [suppressed 1 similar messages]
I20260928 01:55:58.895181 19412 leader_election.cc:304] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:58.895967 21359 raft_consensus.cc:2749] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:55:58.899055 19890 raft_consensus.cc:359] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.899818 19890 raft_consensus.cc:385] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:58.900111 19890 raft_consensus.cc:740] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:58.900794 19890 consensus_queue.cc:260] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:58.902366 19890 ts_tablet_manager.cc:1434] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.000s
I20260928 01:55:58.906226 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82d3233e4514813b22121f75d11eebc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:58.910678 21389 log.cc:927] Time spent T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260928 01:55:58.917948 21359 consensus_queue.cc:1048] T fcf1b727e86a43b08bd464647fa529a3 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:58.924564 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:58.925285 19759 raft_consensus.cc:3060] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.908006 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cacb4a90a54cd3b5b3e7a9310e06ed" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:58.935065 19412 leader_election.cc:304] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:55:58.938061 20447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 46647.9us
I20260928 01:55:58.922495 21386 consensus_queue.cc:1048] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260928 01:55:58.942844 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cfc9ff3344a48b09730dfde79d6cf" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:55:58.945200 19757 raft_consensus.cc:3060] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.953282 19890 tablet_bootstrap.cc:492] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:55:58.955741 19703 consensus_peers.cc:597] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ca0b52215454a99b6c5d1956088829a. This is attempt 6: this message will repeat every 5th retry.
I20260928 01:55:58.982575 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82d3233e4514813b22121f75d11eebc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:58.982923 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cfc9ff3344a48b09730dfde79d6cf" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:58.983309 19617 raft_consensus.cc:2468] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:58.983578 19621 raft_consensus.cc:3060] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.984520 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:58.985056 19612 raft_consensus.cc:3060] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.990833 19621 raft_consensus.cc:2468] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:58.992687 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cacb4a90a54cd3b5b3e7a9310e06ed" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:55:58.993321 19615 raft_consensus.cc:3060] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:58.995589 19612 raft_consensus.cc:2468] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:59.001873 19615 raft_consensus.cc:2468] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:58.916630 19896 tablet_bootstrap.cc:654] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:58.949956 19409 leader_election.cc:343] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:55:59.003294 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 53381.4us
W20260928 01:55:59.004587 19409 leader_election.cc:343] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:59.012580 21359 raft_consensus.cc:2804] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:59.013561 21359 raft_consensus.cc:697] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:59.014526 21359 consensus_queue.cc:237] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.017220 19556 leader_election.cc:304] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:59.017735 19890 tablet_bootstrap.cc:654] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:59.019917 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b]
W20260928 01:55:59.018761 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 83797.8us
I20260928 01:55:59.023887 21363 raft_consensus.cc:2749] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 01:55:59.033025 19556 leader_election.cc:343] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:59.033424 19556 leader_election.cc:304] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:59.041625 20029 tablet_bootstrap.cc:492] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:55:59.042095 20029 ts_tablet_manager.cc:1403] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.339s	user 0.012s	sys 0.018s
I20260928 01:55:59.045111 20029 raft_consensus.cc:359] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:59.045790 20029 raft_consensus.cc:385] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:59.046057 20029 raft_consensus.cc:740] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:55:59.046774 20029 consensus_queue.cc:260] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:59.051852 21363 raft_consensus.cc:2749] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:59.053200 21380 raft_consensus.cc:493] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:59.066393 21363 consensus_queue.cc:1048] T bab12ba3e1f542949e3f203dae0fa80e P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:59.053751 21380 raft_consensus.cc:515] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.070120 19556 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:59.080754 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]
I20260928 01:55:59.081238 21363 raft_consensus.cc:2749] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:59.080756 20029 ts_tablet_manager.cc:1434] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.002s
I20260928 01:55:59.082309 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]
I20260928 01:55:59.086390 20029 tablet_bootstrap.cc:492] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:59.094233 21363 raft_consensus.cc:493] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:59.095249 21363 raft_consensus.cc:515] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.098205 21363 leader_election.cc:290] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:59.102397 21385 consensus_queue.cc:1048] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:55:59.104085 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 77317.6us
I20260928 01:55:59.106454 19704 leader_election.cc:304] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:55:59.107688 19759 raft_consensus.cc:2468] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:59.116707 19409 leader_election.cc:304] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:59.120462 21380 leader_election.cc:290] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:59.123656 19896 tablet_bootstrap.cc:492] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:59.124238 19896 ts_tablet_manager.cc:1403] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.344s	user 0.011s	sys 0.010s
I20260928 01:55:59.124975 19757 raft_consensus.cc:2468] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:55:59.125450 21385 raft_consensus.cc:2764] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 01:55:59.127187 21319 raft_consensus.cc:2804] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:59.127660 21319 raft_consensus.cc:697] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:59.128137 19896 raft_consensus.cc:359] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.128796 19896 raft_consensus.cc:385] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:59.129089 19896 raft_consensus.cc:740] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:59.128931 21319 consensus_queue.cc:237] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.129732 19896 consensus_queue.cc:260] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.131358 21385 consensus_queue.cc:1048] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:59.131705 19896 ts_tablet_manager.cc:1434] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.002s
I20260928 01:55:59.157712 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c61408724e4a70b39e5dbdab9a3e8a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:59.168828 19409 leader_election.cc:304] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:55:59.170012 20029 tablet_bootstrap.cc:654] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:59.169994 21319 raft_consensus.cc:2804] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:55:59.170572 21319 raft_consensus.cc:697] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:55:59.171450 21319 consensus_queue.cc:237] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.175058 19890 tablet_bootstrap.cc:492] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:59.175593 19890 ts_tablet_manager.cc:1403] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.223s	user 0.004s	sys 0.010s
I20260928 01:55:59.178638 19890 raft_consensus.cc:359] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.179456 19890 raft_consensus.cc:385] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:59.179786 19890 raft_consensus.cc:740] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:59.181334 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]
W20260928 01:55:59.181777 19553 leader_election.cc:343] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:59.185886 19896 tablet_bootstrap.cc:492] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:55:59.238897 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 170123us
I20260928 01:55:59.239625 19556 leader_election.cc:304] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:59.184157 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233]
W20260928 01:55:59.289032 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 49489.6us
W20260928 01:55:59.292039 19102 leader_election.cc:336] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c17b7f9972364c76893311539b569e0f (127.18.161.61:43775): Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.528s (SENT)
I20260928 01:55:59.292523 19102 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:55:59.309446 21363 raft_consensus.cc:2749] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:59.317634 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 54873.9us
I20260928 01:55:59.319687 19556 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:59.324703 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c61408724e4a70b39e5dbdab9a3e8a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:59.332866 19896 tablet_bootstrap.cc:654] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:59.365135 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e]
I20260928 01:55:59.366732 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765]
I20260928 01:55:59.355939 20029 tablet_bootstrap.cc:492] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
W20260928 01:55:59.372282 19409 leader_election.cc:343] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:59.379060 21388 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:59.379686 21388 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:59.382659 21388 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:59.386294 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:59.387058 19476 raft_consensus.cc:2393] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:59.393833 21316 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:59.394857 21316 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:59.382965 20029 ts_tablet_manager.cc:1403] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.296s	user 0.021s	sys 0.035s
I20260928 01:55:59.319872 21173 consensus_queue.cc:1048] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.080s
I20260928 01:55:59.399555 19890 consensus_queue.cc:260] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.401014 21173 consensus_queue.cc:1048] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:59.413362 21359 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:59.413565 21316 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:59.413913 21359 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.417737 21359 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:55:59.420584 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:55:59.421468 19466 raft_consensus.cc:2393] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:59.320550 21361 raft_consensus.cc:2749] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:55:59.449560 19890 ts_tablet_manager.cc:1434] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.274s	user 0.007s	sys 0.003s
I20260928 01:55:59.450794 19890 tablet_bootstrap.cc:492] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:59.455230 19896 tablet_bootstrap.cc:492] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:55:59.464959 19896 ts_tablet_manager.cc:1403] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.279s	user 0.010s	sys 0.004s
I20260928 01:55:59.465557 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7]
I20260928 01:55:59.467099 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb]
W20260928 01:55:59.472862 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 49184.6us
W20260928 01:55:59.476586 19703 consensus_peers.cc:597] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57a81b9455a340728fea713318e1e77a. This is attempt 6: this message will repeat every 5th retry.
I20260928 01:55:59.485387 19896 raft_consensus.cc:359] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.486119 19896 raft_consensus.cc:385] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:59.486418 19896 raft_consensus.cc:740] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:55:59.487551 19896 consensus_queue.cc:260] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.489074 19896 ts_tablet_manager.cc:1434] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260928 01:55:59.501240 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f]
I20260928 01:55:59.502755 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b]
I20260928 01:55:59.508773 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:55:59.511215 21319 raft_consensus.cc:493] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:59.512180 21319 raft_consensus.cc:515] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.516425 21319 leader_election.cc:290] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:55:59.390995 19104 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:59.312368 21416 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:55:59.536532 21359 consensus_queue.cc:1048] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:55:59.566679 19890 tablet_bootstrap.cc:654] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:59.567451 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3b9ec9f88342c0aa77c0fc92d26205" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:59.568966 19409 leader_election.cc:343] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:59.528434 20029 raft_consensus.cc:359] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.574155 20029 raft_consensus.cc:385] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:59.581568 20029 raft_consensus.cc:740] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:55:59.590705 20447 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c17b7f9972364c76893311539b569e0f (127.18.161.61:43775): Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.642s (SENT)
W20260928 01:55:59.602882 20456 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.642s (SENT)
I20260928 01:55:59.603353 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:55:59.608803 20029 consensus_queue.cc:260] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:55:59.646329 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 325339us
I20260928 01:55:59.652597 20029 ts_tablet_manager.cc:1434] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.245s	user 0.014s	sys 0.017s
I20260928 01:55:59.667281 21426 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260928 01:55:59.676525 20456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 73686.9us
I20260928 01:55:59.679523 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b]
I20260928 01:55:59.683389 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]
I20260928 01:55:59.684993 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]
I20260928 01:55:59.694492 20029 tablet_bootstrap.cc:492] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:55:59.721765 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:59.722534 19619 raft_consensus.cc:2393] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:59.722052 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]
I20260928 01:55:59.726437 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]
I20260928 01:55:59.727977 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d]
I20260928 01:55:59.742162 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:59.743059 19619 raft_consensus.cc:2393] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:55:59.749044 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151]
I20260928 01:55:59.750600 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87]
I20260928 01:55:59.752099 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e]
I20260928 01:55:59.778362 21319 raft_consensus.cc:493] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:59.778872 21319 raft_consensus.cc:515] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.780897 21319 leader_election.cc:290] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:59.793354 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1]
I20260928 01:55:59.793402 19704 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:55:59.794906 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542]
I20260928 01:55:59.796409 21355 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:59.797173 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93]
I20260928 01:55:59.805848 19896 tablet_bootstrap.cc:492] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:55:59.803915 21355 raft_consensus.cc:2749] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:55:59.809636 19701 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 122457us
I20260928 01:55:59.814008 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:59.828346 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 143315us
I20260928 01:55:59.836560 19704 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
W20260928 01:55:59.839257 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 130298us
I20260928 01:55:59.841466 21387 raft_consensus.cc:3060] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:59.855090 19412 leader_election.cc:304] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:59.856719 19890 tablet_bootstrap.cc:492] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:55:59.857241 19890 ts_tablet_manager.cc:1403] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.407s	user 0.016s	sys 0.003s
I20260928 01:55:59.857127 19412 leader_election.cc:304] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:55:59.858741 21319 raft_consensus.cc:2804] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:55:59.859115 21319 raft_consensus.cc:493] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:55:59.859427 21319 raft_consensus.cc:3060] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:55:59.867607 20029 tablet_bootstrap.cc:654] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:55:59.816193 19896 tablet_bootstrap.cc:654] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:55:59.910547 19104 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:55:59.859707 19890 raft_consensus.cc:359] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:55:59.923251 19890 raft_consensus.cc:385] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:55:59.923599 19890 raft_consensus.cc:740] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:55:59.928570 21387 raft_consensus.cc:2749] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:55:59.928505 21422 raft_consensus.cc:493] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:59.929041 21422 raft_consensus.cc:515] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.931151 21422 leader_election.cc:290] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:59.940356 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:55:59.949429 19553 leader_election.cc:343] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:55:59.952411 21316 raft_consensus.cc:493] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:55:59.953039 21316 raft_consensus.cc:515] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.955821 21316 leader_election.cc:290] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:55:59.956986 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]
I20260928 01:55:59.957647 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cacb4a90a54cd3b5b3e7a9310e06ed" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:59.958552 19619 raft_consensus.cc:2393] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:55:59.959389 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f]
I20260928 01:55:59.962285 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c61408724e4a70b39e5dbdab9a3e8a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:55:59.962950 19615 raft_consensus.cc:2468] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:55:59.924328 19890 consensus_queue.cc:260] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:55:59.976058 19105 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 982c3e07bcb94230b93764330914630f consensus state has no leader
I20260928 01:55:59.906556 21319 raft_consensus.cc:515] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:55:59.986260 19890 ts_tablet_manager.cc:1434] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.129s	user 0.006s	sys 0.000s
I20260928 01:55:59.989032 21319 leader_election.cc:290] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:55:59.989336 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cacb4a90a54cd3b5b3e7a9310e06ed" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:55:59.923408 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 65291.9us
I20260928 01:56:00.000510 19890 tablet_bootstrap.cc:492] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:55:59.918939 21432 raft_consensus.cc:2804] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:00.002979 21432 raft_consensus.cc:697] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:00.004060 21432 consensus_queue.cc:237] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.005038 20029 tablet_bootstrap.cc:492] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:00.012532 20029 ts_tablet_manager.cc:1403] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.326s	user 0.020s	sys 0.024s
I20260928 01:56:00.026041 19896 tablet_bootstrap.cc:492] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:00.026531 19896 ts_tablet_manager.cc:1403] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.221s	user 0.010s	sys 0.001s
I20260928 01:56:00.030463 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c61408724e4a70b39e5dbdab9a3e8a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:00.031075 19476 raft_consensus.cc:2468] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:00.064504 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:00.065860 19613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3b9ec9f88342c0aa77c0fc92d26205" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:00.066291 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:00.066556 19613 raft_consensus.cc:2468] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:00.066913 19615 raft_consensus.cc:2468] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:00.062669 20029 raft_consensus.cc:359] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.084832 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]
I20260928 01:56:00.077855 20029 raft_consensus.cc:385] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:00.094349 19896 raft_consensus.cc:359] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:00.095112 19896 raft_consensus.cc:385] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:56:00.099148 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 279551us
I20260928 01:56:00.098629 20029 raft_consensus.cc:740] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:00.120571 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55]
I20260928 01:56:00.111151 20029 consensus_queue.cc:260] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.123246 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]
I20260928 01:56:00.130237 19890 tablet_bootstrap.cc:654] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:00.134611 21422 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:00.135136 21422 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:00.137267 21422 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:00.095402 19896 raft_consensus.cc:740] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:00.146881 19896 consensus_queue.cc:260] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:00.160610 20029 ts_tablet_manager.cc:1434] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.143s	user 0.011s	sys 0.007s
I20260928 01:56:00.170397 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]
I20260928 01:56:00.184808 20029 tablet_bootstrap.cc:492] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:00.190860 20029 tablet_bootstrap.cc:654] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:00.190579 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9]
I20260928 01:56:00.196913 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:00.197540 19469 raft_consensus.cc:2468] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:00.200933 19703 leader_election.cc:304] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:00.204730 21383 raft_consensus.cc:3060] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:00.206187 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82d3233e4514813b22121f75d11eebc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:00.213886 19890 tablet_bootstrap.cc:492] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:00.214381 19890 ts_tablet_manager.cc:1403] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.220s	user 0.009s	sys 0.006s
I20260928 01:56:00.217379 19890 raft_consensus.cc:359] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:00.218688 19890 raft_consensus.cc:385] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:00.218982 19890 raft_consensus.cc:740] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:00.220762 19890 consensus_queue.cc:260] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:00.224628 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:00.235173 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975]
W20260928 01:56:00.254226 19409 leader_election.cc:343] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:00.258276 19890 ts_tablet_manager.cc:1434] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.006s
I20260928 01:56:00.277052 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82d3233e4514813b22121f75d11eebc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:00.277674 19614 raft_consensus.cc:3060] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:00.251784 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f]
W20260928 01:56:00.292230 19409 leader_election.cc:343] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:00.293776 19553 leader_election.cc:343] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:00.254324 19896 ts_tablet_manager.cc:1434] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.228s	user 0.007s	sys 0.002s
I20260928 01:56:00.291752 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6]
I20260928 01:56:00.301182 21443 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:00.301784 21443 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:00.302626 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37]
I20260928 01:56:00.224779 21383 raft_consensus.cc:2749] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:00.312399 21423 raft_consensus.cc:493] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:00.312943 21423 raft_consensus.cc:515] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:00.317310 19890 tablet_bootstrap.cc:492] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:00.317823 21434 consensus_queue.cc:1048] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:00.321677 21423 leader_election.cc:290] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:00.325971 19890 tablet_bootstrap.cc:654] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:00.337751 20029 tablet_bootstrap.cc:492] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:00.338444 20029 ts_tablet_manager.cc:1403] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.154s	user 0.005s	sys 0.007s
I20260928 01:56:00.350407 19412 leader_election.cc:304] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:00.351197 21432 raft_consensus.cc:2804] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:00.351557 21432 raft_consensus.cc:493] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:00.351920 21432 raft_consensus.cc:3060] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:00.359076 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:00.359239 21432 raft_consensus.cc:515] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.348820 19556 leader_election.cc:304] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:00.362031 21443 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:00.362920 21432 leader_election.cc:290] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:00.363693 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:00.375402 21423 raft_consensus.cc:2804] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:00.375955 21423 raft_consensus.cc:493] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:00.376667 21423 raft_consensus.cc:3060] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:00.376955 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749]
I20260928 01:56:00.378384 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4]
I20260928 01:56:00.379652 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417]
I20260928 01:56:00.392468 19412 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:00.393309 21380 raft_consensus.cc:2749] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:00.398521 19614 raft_consensus.cc:2468] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
W20260928 01:56:00.403641 19104 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:00.413142 21380 consensus_queue.cc:1048] T c53d75604ee3405d83fe9ecaa824ea68 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:00.417997 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]
I20260928 01:56:00.419405 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7]
I20260928 01:56:00.421651 19896 tablet_bootstrap.cc:492] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:00.429949 19412 leader_election.cc:304] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:00.430946 21380 raft_consensus.cc:2804] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:00.431378 21380 raft_consensus.cc:493] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:00.431789 21380 raft_consensus.cc:3060] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:00.374015 20029 raft_consensus.cc:359] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.433022 20029 raft_consensus.cc:385] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:00.433333 20029 raft_consensus.cc:740] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:00.434062 20029 consensus_queue.cc:260] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.428035 19896 tablet_bootstrap.cc:654] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:00.438603 19756 raft_consensus.cc:3060] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:00.451269 19556 leader_election.cc:304] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:00.452041 21418 raft_consensus.cc:2804] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:00.452574 21418 raft_consensus.cc:493] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:00.453989 21418 raft_consensus.cc:3060] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:00.461066 19412 leader_election.cc:304] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:00.462126 21432 raft_consensus.cc:2804] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:00.462750 21432 raft_consensus.cc:493] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:00.463335 21432 raft_consensus.cc:3060] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:00.470290 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c61408724e4a70b39e5dbdab9a3e8a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:00.471191 19759 raft_consensus.cc:3060] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:00.479192 21431 raft_consensus.cc:493] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:00.479875 21431 raft_consensus.cc:515] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.483662 21431 leader_election.cc:290] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:00.485678 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]
I20260928 01:56:00.487488 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]
I20260928 01:56:00.495153 21380 raft_consensus.cc:515] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.499707 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:00.502743 19553 leader_election.cc:343] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:00.519518 21448 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:00.520012 21448 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:00.498360 19759 raft_consensus.cc:2468] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
W20260928 01:56:00.523548 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 49117.9us
I20260928 01:56:00.504639 21434 consensus_queue.cc:1048] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:56:00.506222 19409 leader_election.cc:343] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:00.513042 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:00.536726 19472 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:00.540758 19556 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:00.541590 21449 raft_consensus.cc:2804] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:00.542048 21449 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:00.542495 21449 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:00.555519 20029 ts_tablet_manager.cc:1434] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.217s	user 0.007s	sys 0.000s
I20260928 01:56:00.555569 19409 leader_election.cc:304] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:00.556793 20029 tablet_bootstrap.cc:492] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:00.558231 21431 consensus_queue.cc:1048] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:00.534772 19890 tablet_bootstrap.cc:492] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:00.560658 19890 ts_tablet_manager.cc:1403] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.244s	user 0.014s	sys 0.001s
I20260928 01:56:00.562466 21431 raft_consensus.cc:2804] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:00.563156 21431 raft_consensus.cc:697] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:00.564666 21431 consensus_queue.cc:237] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.571805 21423 raft_consensus.cc:515] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.590813 19890 raft_consensus.cc:359] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.592517 21380 leader_election.cc:290] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:00.595286 21432 raft_consensus.cc:515] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.597092 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c61408724e4a70b39e5dbdab9a3e8a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:00.598192 19768 raft_consensus.cc:2393] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:00.604899 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:00.606451 19412 leader_election.cc:304] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:00.609202 21380 raft_consensus.cc:2804] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:00.609532 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3b9ec9f88342c0aa77c0fc92d26205" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:56:00.611073 19409 leader_election.cc:343] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:00.613324 19896 tablet_bootstrap.cc:492] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:00.614086 19896 ts_tablet_manager.cc:1403] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.193s	user 0.014s	sys 0.006s
I20260928 01:56:00.628517 19890 raft_consensus.cc:385] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:00.600060 21423 leader_election.cc:290] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:00.633333 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5]
I20260928 01:56:00.575775 21418 raft_consensus.cc:515] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.638813 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d]
I20260928 01:56:00.642403 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619]
I20260928 01:56:00.522130 21448 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
W20260928 01:56:00.651839 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 98694.4us
I20260928 01:56:00.628916 19890 raft_consensus.cc:740] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:00.660247 19890 consensus_queue.cc:260] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.662650 19890 ts_tablet_manager.cc:1434] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.001s
I20260928 01:56:00.663795 19890 tablet_bootstrap.cc:492] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:00.679105 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]
I20260928 01:56:00.610569 21380 raft_consensus.cc:697] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:00.691295 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:56:00.693449 19553 leader_election.cc:343] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:00.693733 21418 leader_election.cc:290] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:00.696733 21380 consensus_queue.cc:237] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:00.708989 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c61408724e4a70b39e5dbdab9a3e8a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:00.710248 19614 raft_consensus.cc:2393] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:00.732231 21432 leader_election.cc:290] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:00.733566 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]
I20260928 01:56:00.735014 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d]
I20260928 01:56:00.755776 20029 tablet_bootstrap.cc:654] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:00.743819 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:00.760744 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3b9ec9f88342c0aa77c0fc92d26205" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:00.761358 19617 raft_consensus.cc:3060] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:00.760314 19409 leader_election.cc:343] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:00.796622 19617 raft_consensus.cc:2468] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:00.798878 19896 raft_consensus.cc:359] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:00.799592 19896 raft_consensus.cc:385] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:00.799872 19896 raft_consensus.cc:740] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:00.583374 21449 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:00.815443 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:00.816133 19617 raft_consensus.cc:3060] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:00.820814 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b]
I20260928 01:56:00.796062 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:00.823961 19614 raft_consensus.cc:2468] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:00.824859 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]
W20260928 01:56:00.829133 19104 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:00.826385 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]
I20260928 01:56:00.837244 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2]
I20260928 01:56:00.838670 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87]
I20260928 01:56:00.843767 21449 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:00.845050 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:56:00.845876 21457 log.cc:927] Time spent T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260928 01:56:00.847008 19553 leader_election.cc:343] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:00.853964 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:00.854607 19473 raft_consensus.cc:3060] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:00.874573 19896 consensus_queue.cc:260] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:00.860922 21359 consensus_queue.cc:1048] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.067s
I20260928 01:56:00.873924 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c61408724e4a70b39e5dbdab9a3e8a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:00.860286 21432 consensus_queue.cc:1048] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.062s
I20260928 01:56:00.943377 19473 raft_consensus.cc:2468] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:00.956504 19617 raft_consensus.cc:2468] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:00.960127 20029 tablet_bootstrap.cc:492] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:00.960820 20029 ts_tablet_manager.cc:1403] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.404s	user 0.015s	sys 0.001s
I20260928 01:56:00.917963 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02]
I20260928 01:56:00.967756 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14]
I20260928 01:56:00.968057 21319 consensus_queue.cc:1048] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:56:00.978598 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 144345us
I20260928 01:56:00.994283 20029 raft_consensus.cc:359] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.002481 20029 raft_consensus.cc:385] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:01.002799 20029 raft_consensus.cc:740] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:01.011906 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]
I20260928 01:56:01.016548 20029 consensus_queue.cc:260] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.029995 19412 leader_election.cc:304] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:01.036130 21431 consensus_queue.cc:1048] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:01.039633 20029 ts_tablet_manager.cc:1434] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260928 01:56:01.042363 21319 raft_consensus.cc:2804] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:01.043187 21319 raft_consensus.cc:697] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:01.044173 21319 consensus_queue.cc:237] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.056800 20029 tablet_bootstrap.cc:492] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:01.063661 19890 tablet_bootstrap.cc:654] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:56:01.075819 19556 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 45104.3us
W20260928 01:56:01.076828 19556 leader_election.cc:343] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:01.077210 19556 leader_election.cc:304] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:01.048691 21462 log.cc:927] Time spent T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260928 01:56:01.079905 21428 raft_consensus.cc:2749] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:01.081321 19896 ts_tablet_manager.cc:1434] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.466s	user 0.011s	sys 0.007s
I20260928 01:56:01.014550 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]
I20260928 01:56:01.093492 19896 tablet_bootstrap.cc:492] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:01.131601 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b]
I20260928 01:56:01.133246 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]
I20260928 01:56:01.134702 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb]
I20260928 01:56:01.147173 19896 tablet_bootstrap.cc:654] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:56:01.122819 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 45511.6us
I20260928 01:56:01.223133 19556 leader_election.cc:304] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:01.224344 21423 raft_consensus.cc:2749] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:56:01.224291 19556 leader_election.cc:304] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:01.226166 21428 raft_consensus.cc:2804] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:01.226620 21428 raft_consensus.cc:697] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:01.227811 21428 consensus_queue.cc:237] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:01.232076 20456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 68271.7us
I20260928 01:56:01.237494 21289 catalog_manager.cc:692] Loaded metadata for table default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320]
I20260928 01:56:01.245776 19412 leader_election.cc:304] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:01.247861 21465 raft_consensus.cc:2804] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:01.248286 21465 raft_consensus.cc:493] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:01.248634 21465 raft_consensus.cc:3060] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:01.251638 20029 tablet_bootstrap.cc:654] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:01.272262 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:01.272877 19473 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:01.278980 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 66420us
I20260928 01:56:01.290701 21465 raft_consensus.cc:515] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.314401 19412 leader_election.cc:304] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:01.317121 21434 raft_consensus.cc:2804] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:01.318120 21434 raft_consensus.cc:697] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:01.319752 21434 consensus_queue.cc:237] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.332785 19896 tablet_bootstrap.cc:492] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:01.333297 19896 ts_tablet_manager.cc:1403] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.240s	user 0.013s	sys 0.003s
I20260928 01:56:01.354511 20029 tablet_bootstrap.cc:492] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:01.354974 20029 ts_tablet_manager.cc:1403] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.310s	user 0.006s	sys 0.013s
I20260928 01:56:01.360029 19890 tablet_bootstrap.cc:492] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:01.360522 19890 ts_tablet_manager.cc:1403] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.697s	user 0.017s	sys 0.003s
W20260928 01:56:01.364094 19104 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:01.386641 20029 raft_consensus.cc:359] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.387362 20029 raft_consensus.cc:385] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:01.387730 20029 raft_consensus.cc:740] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:01.399930 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:01.400916 19617 raft_consensus.cc:3060] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:01.402711 21319 raft_consensus.cc:493] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:01.403196 21319 raft_consensus.cc:515] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:01.406075 21319 leader_election.cc:290] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:01.407160 19896 raft_consensus.cc:359] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.407877 19896 raft_consensus.cc:385] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:01.408286 19896 raft_consensus.cc:740] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:01.408975 19896 consensus_queue.cc:260] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.417582 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:01.419790 19409 leader_election.cc:343] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:01.422570 21465 leader_election.cc:290] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:01.426335 19473 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:01.364632 19890 raft_consensus.cc:359] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:01.445465 19890 raft_consensus.cc:385] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:01.445811 19890 raft_consensus.cc:740] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:01.447213 19890 consensus_queue.cc:260] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:01.449492 19890 ts_tablet_manager.cc:1434] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.001s
I20260928 01:56:01.450533 19890 tablet_bootstrap.cc:492] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:01.465559 19896 ts_tablet_manager.cc:1434] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.132s	user 0.000s	sys 0.008s
I20260928 01:56:01.479437 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:01.490789 19617 raft_consensus.cc:2468] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:01.492285 20029 consensus_queue.cc:260] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.494366 20029 ts_tablet_manager.cc:1434] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.139s	user 0.008s	sys 0.000s
I20260928 01:56:01.504302 21359 consensus_queue.cc:1048] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:01.512959 19556 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:01.519520 21316 raft_consensus.cc:493] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:01.520578 21479 raft_consensus.cc:2804] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:01.520737 21316 raft_consensus.cc:515] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.521318 21479 raft_consensus.cc:697] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:01.522616 21479 consensus_queue.cc:237] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:01.530236 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82d3233e4514813b22121f75d11eebc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:56:01.531059 19409 leader_election.cc:343] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:01.557464 19412 leader_election.cc:304] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:01.559450 21465 raft_consensus.cc:2804] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:01.560338 21465 raft_consensus.cc:697] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:01.561604 21465 consensus_queue.cc:237] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.567714 19896 tablet_bootstrap.cc:492] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:01.568495 21316 leader_election.cc:290] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:01.529891 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82d3233e4514813b22121f75d11eebc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:01.576828 19614 raft_consensus.cc:2393] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:01.578593 19704 leader_election.cc:304] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:01.535416 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:01.581249 19619 raft_consensus.cc:2468] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:01.581422 21387 raft_consensus.cc:3060] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:01.585083 19412 leader_election.cc:304] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:01.603099 20029 tablet_bootstrap.cc:492] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:01.609516 21359 raft_consensus.cc:2804] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:01.610034 21359 raft_consensus.cc:493] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:01.610494 21359 raft_consensus.cc:3060] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:01.618541 21359 raft_consensus.cc:515] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:01.620350 20029 tablet_bootstrap.cc:654] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:01.631351 21480 raft_consensus.cc:493] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:01.631943 21480 raft_consensus.cc:515] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:01.634768 21480 leader_election.cc:290] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:01.638584 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:01.640080 19553 leader_election.cc:343] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:01.646485 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:01.647184 19619 raft_consensus.cc:3060] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:01.655032 19619 raft_consensus.cc:2468] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:01.655431 19890 tablet_bootstrap.cc:654] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:01.659011 21387 raft_consensus.cc:2749] T a82d3233e4514813b22121f75d11eebc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:01.677700 20029 tablet_bootstrap.cc:492] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:01.678222 20029 ts_tablet_manager.cc:1403] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.000s
I20260928 01:56:01.684852 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:56:01.706073 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 45037.6us
W20260928 01:56:01.719324 19556 leader_election.cc:343] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:01.720160 20029 raft_consensus.cc:359] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.721354 19556 leader_election.cc:304] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:01.723074 20029 raft_consensus.cc:385] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:01.725255 21476 raft_consensus.cc:2749] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:01.724923 20029 raft_consensus.cc:740] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:01.730983 20029 consensus_queue.cc:260] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.732801 20029 ts_tablet_manager.cc:1434] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.001s
W20260928 01:56:01.744469 19104 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:01.745524 19896 tablet_bootstrap.cc:654] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:01.762605 19412 leader_election.cc:304] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:01.791332 21289 tablet_loader.cc:96] loaded metadata for tablet 01cc307b127446958bd4199a1aa60adb (table default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375])
I20260928 01:56:01.800329 21380 raft_consensus.cc:2804] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:01.801072 21380 raft_consensus.cc:697] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:01.802587 21380 consensus_queue.cc:237] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:01.787220 21359 leader_election.cc:290] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:01.828365 19890 tablet_bootstrap.cc:492] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:01.828821 19890 ts_tablet_manager.cc:1403] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.378s	user 0.010s	sys 0.004s
I20260928 01:56:01.832383 19890 raft_consensus.cc:359] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.833052 19890 raft_consensus.cc:385] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:01.833328 19890 raft_consensus.cc:740] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:01.834019 19890 consensus_queue.cc:260] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.840976 20029 tablet_bootstrap.cc:492] T fa3b9ec9f88342c0aa77c0fc92d26205 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:56:01.859431 20447 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c17b7f9972364c76893311539b569e0f (127.18.161.61:43775): Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.640s (SENT)
I20260928 01:56:01.857489 19890 ts_tablet_manager.cc:1434] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
W20260928 01:56:01.874372 20456 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.640s (SENT)
I20260928 01:56:01.874848 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:01.877477 19890 tablet_bootstrap.cc:492] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:01.900947 19896 tablet_bootstrap.cc:492] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:01.903426 19890 tablet_bootstrap.cc:654] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:01.911038 20029 tablet_bootstrap.cc:654] T fa3b9ec9f88342c0aa77c0fc92d26205 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:01.915431 21499 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:01.926433 21432 consensus_queue.cc:1048] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:01.931052 21289 tablet_loader.cc:96] loaded metadata for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6])
I20260928 01:56:01.947400 21380 consensus_queue.cc:1048] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:01.910233 19896 ts_tablet_manager.cc:1403] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.342s	user 0.015s	sys 0.006s
I20260928 01:56:01.965371 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:01.968565 19896 raft_consensus.cc:359] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:01.969278 19896 raft_consensus.cc:385] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:01.969556 19896 raft_consensus.cc:740] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:01.970315 19896 consensus_queue.cc:260] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:01.995952 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 73012.1us
I20260928 01:56:01.933139 21289 tablet_loader.cc:96] loaded metadata for tablet 043ddb5b0b0e4ad0b30d2927d37971fb (table default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9])
I20260928 01:56:02.010269 21289 tablet_loader.cc:96] loaded metadata for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6])
W20260928 01:56:01.977104 19409 leader_election.cc:343] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:02.021296 21465 consensus_queue.cc:1048] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:02.047528 21289 tablet_loader.cc:96] loaded metadata for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7])
I20260928 01:56:02.066787 21289 tablet_loader.cc:96] loaded metadata for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0])
I20260928 01:56:02.088678 19890 tablet_bootstrap.cc:492] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:02.089144 19890 ts_tablet_manager.cc:1403] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.212s	user 0.008s	sys 0.021s
I20260928 01:56:02.091661 19890 raft_consensus.cc:359] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.096966 21465 consensus_queue.cc:1048] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:02.076133 19896 ts_tablet_manager.cc:1434] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.120s	user 0.009s	sys 0.000s
I20260928 01:56:02.116365 19890 raft_consensus.cc:385] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:02.116698 19890 raft_consensus.cc:740] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:02.117357 19890 consensus_queue.cc:260] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.099327 21289 tablet_loader.cc:96] loaded metadata for tablet 0e1ddfab489f4ace921d551c216039bd (table default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f])
I20260928 01:56:02.126307 19890 ts_tablet_manager.cc:1434] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
W20260928 01:56:02.126833 19102 leader_election.cc:336] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c17b7f9972364c76893311539b569e0f (127.18.161.61:43775): Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.846s (SENT)
I20260928 01:56:02.127271 19890 tablet_bootstrap.cc:492] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:02.127254 19102 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:56:02.137221 21507 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:02.139782 19896 tablet_bootstrap.cc:492] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:02.141024 21289 tablet_loader.cc:96] loaded metadata for tablet 10fa56df34ad44d88f1dd700c823d57c (table default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7])
I20260928 01:56:02.142396 21289 tablet_loader.cc:96] loaded metadata for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117])
I20260928 01:56:02.153010 19890 tablet_bootstrap.cc:654] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:02.157369 21465 consensus_queue.cc:1048] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:02.163167 20029 tablet_bootstrap.cc:492] T fa3b9ec9f88342c0aa77c0fc92d26205 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:02.163692 20029 ts_tablet_manager.cc:1403] T fa3b9ec9f88342c0aa77c0fc92d26205 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.323s	user 0.006s	sys 0.008s
I20260928 01:56:02.166205 20029 raft_consensus.cc:359] T fa3b9ec9f88342c0aa77c0fc92d26205 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.167033 21491 raft_consensus.cc:493] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:02.167541 21491 raft_consensus.cc:515] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.169938 21491 leader_election.cc:290] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:02.224771 21289 tablet_loader.cc:96] loaded metadata for tablet 12b836e20d6b43cba8eaa08887afb076 (table default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4])
I20260928 01:56:02.250020 21289 tablet_loader.cc:96] loaded metadata for tablet 13c395a6a87f4927b10973720aa4d868 (table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92])
I20260928 01:56:02.251613 21289 tablet_loader.cc:96] loaded metadata for tablet 1555e557370a4e92915a9c55107b573b (table default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6])
I20260928 01:56:02.272311 19890 tablet_bootstrap.cc:492] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:02.272821 19890 ts_tablet_manager.cc:1403] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.010s
I20260928 01:56:02.278483 19890 raft_consensus.cc:359] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.279386 19890 raft_consensus.cc:385] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:02.279810 19890 raft_consensus.cc:740] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:02.280699 19890 consensus_queue.cc:260] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.283017 19890 ts_tablet_manager.cc:1434] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260928 01:56:02.284088 19890 tablet_bootstrap.cc:492] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:02.220019 19896 tablet_bootstrap.cc:654] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:02.260550 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:02.287374 20029 raft_consensus.cc:385] T fa3b9ec9f88342c0aa77c0fc92d26205 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:02.287693 20029 raft_consensus.cc:740] T fa3b9ec9f88342c0aa77c0fc92d26205 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:02.296895 21289 tablet_loader.cc:96] loaded metadata for tablet 15f48cf74a1b4600b5140bf9cc8446e3 (table default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2])
I20260928 01:56:02.292167 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:02.310739 21289 tablet_loader.cc:96] loaded metadata for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b])
I20260928 01:56:02.317305 21476 raft_consensus.cc:493] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:02.318135 21476 raft_consensus.cc:515] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.314538 21289 tablet_loader.cc:96] loaded metadata for tablet 202f1ead822548a2bbeae4e4d3cf9be8 (table default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975])
I20260928 01:56:02.323333 21289 tablet_loader.cc:96] loaded metadata for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d])
W20260928 01:56:02.334818 19104 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:02.335091 21476 leader_election.cc:290] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:02.344584 21289 tablet_loader.cc:96] loaded metadata for tablet 21906a8380e64d95b9454a57fc01c6f0 (table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a])
I20260928 01:56:02.348598 20029 consensus_queue.cc:260] T fa3b9ec9f88342c0aa77c0fc92d26205 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.351835 21289 tablet_loader.cc:96] loaded metadata for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d])
I20260928 01:56:02.356179 21289 tablet_loader.cc:96] loaded metadata for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5])
I20260928 01:56:02.356947 19890 tablet_bootstrap.cc:654] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:02.362263 21289 tablet_loader.cc:96] loaded metadata for tablet 27a232fc915a46c1a833ec5f6721eece (table default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417])
I20260928 01:56:02.366721 21289 tablet_loader.cc:96] loaded metadata for tablet 29f65b0966c04012bfec3c67a37acc25 (table default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e])
I20260928 01:56:02.368048 21289 tablet_loader.cc:96] loaded metadata for tablet 2c007b068b1d414298cce3fe44a91daa (table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc])
I20260928 01:56:02.371223 21289 tablet_loader.cc:96] loaded metadata for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12])
I20260928 01:56:02.376827 21289 tablet_loader.cc:96] loaded metadata for tablet 36076aa674b9401b9b76fbf066348d06 (table default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a])
I20260928 01:56:02.378859 21289 tablet_loader.cc:96] loaded metadata for tablet 376b5a87b07b4f87a2a502b5fa1b23f8 (table default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7])
I20260928 01:56:02.385881 21289 tablet_loader.cc:96] loaded metadata for tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7 (table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535])
I20260928 01:56:02.389648 21289 tablet_loader.cc:96] loaded metadata for tablet 3f4a1c903a04450684ba38081a75559e (table default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a])
I20260928 01:56:02.390540 20029 ts_tablet_manager.cc:1434] T fa3b9ec9f88342c0aa77c0fc92d26205 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.226s	user 0.006s	sys 0.000s
I20260928 01:56:02.393288 21289 tablet_loader.cc:96] loaded metadata for tablet 416ccc1323fe41b2a7783dc95bba8d84 (table default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d])
W20260928 01:56:02.417115 19409 consensus_peers.cc:597] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:02.417804 19409 leader_election.cc:343] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:02.418645 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:02.427790 19412 leader_election.cc:343] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:02.429040 19412 leader_election.cc:304] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:02.430272 21491 raft_consensus.cc:2749] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:02.436584 21289 tablet_loader.cc:96] loaded metadata for tablet 45d8d07b367b4fafbd7171f8ea7b2a26 (table default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921])
I20260928 01:56:02.446175 21289 tablet_loader.cc:96] loaded metadata for tablet 4c6f4708c641414aa59f01703c86aaf1 (table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8])
I20260928 01:56:02.447508 21289 tablet_loader.cc:96] loaded metadata for tablet 4e6b59144fe14daab98b0965c7f8af02 (table default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2])
I20260928 01:56:02.448887 19890 tablet_bootstrap.cc:492] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:02.449328 19890 ts_tablet_manager.cc:1403] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.165s	user 0.024s	sys 0.009s
I20260928 01:56:02.458803 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:02.462240 21418 raft_consensus.cc:493] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:02.462910 21418 raft_consensus.cc:515] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.466133 21418 leader_election.cc:290] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:02.467895 19890 raft_consensus.cc:359] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.468652 19890 raft_consensus.cc:385] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:02.468931 19890 raft_consensus.cc:740] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:02.469800 19890 consensus_queue.cc:260] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.472082 19890 ts_tablet_manager.cc:1434] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260928 01:56:02.481690 19896 tablet_bootstrap.cc:492] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:02.482517 20029 tablet_bootstrap.cc:492] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:02.483345 19890 tablet_bootstrap.cc:492] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:02.443617 19757 raft_consensus.cc:3060] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:02.508970 19896 ts_tablet_manager.cc:1403] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.369s	user 0.014s	sys 0.000s
I20260928 01:56:02.511615 19896 raft_consensus.cc:359] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:02.530109 20029 tablet_bootstrap.cc:654] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:02.532970 21524 raft_consensus.cc:493] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:02.533703 21524 raft_consensus.cc:515] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.543473 21449 raft_consensus.cc:493] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:02.544123 21449 raft_consensus.cc:515] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.548322 21449 leader_election.cc:290] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:02.566236 19756 raft_consensus.cc:3060] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:02.567672 19556 leader_election.cc:343] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:02.579538 19553 leader_election.cc:343] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:02.579995 19553 leader_election.cc:304] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:02.580979 21449 raft_consensus.cc:2749] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:02.585055 21418 consensus_queue.cc:1048] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:02.592865 19890 tablet_bootstrap.cc:654] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:02.595677 21289 tablet_loader.cc:96] loaded metadata for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88])
I20260928 01:56:02.597059 21289 tablet_loader.cc:96] loaded metadata for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd])
I20260928 01:56:02.598322 21289 tablet_loader.cc:96] loaded metadata for tablet 522245da435b40ae84ae6dc5d19a2e95 (table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed])
I20260928 01:56:02.599435 21289 tablet_loader.cc:96] loaded metadata for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3 (table default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f])
I20260928 01:56:02.600638 21289 tablet_loader.cc:96] loaded metadata for tablet 5374596938d64cafb9621a1932ca1f68 (table default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f])
I20260928 01:56:02.602504 21289 tablet_loader.cc:96] loaded metadata for tablet 53c755f16ea1496eb7fa26fb12e01708 (table default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85])
I20260928 01:56:02.581202 21526 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:02.604650 21526 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:02.631387 21449 consensus_queue.cc:1048] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260928 01:56:02.645934 21494 raft_consensus.cc:493] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:02.646440 21494 raft_consensus.cc:515] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.648180 21526 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:02.650980 21494 leader_election.cc:290] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:02.651983 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:02.652637 19617 raft_consensus.cc:2468] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:02.654424 19704 leader_election.cc:304] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:02.661350 21521 raft_consensus.cc:2804] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:02.661777 21521 raft_consensus.cc:493] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 01:56:02.662199 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 91777.5us
I20260928 01:56:02.662235 21521 raft_consensus.cc:3060] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:02.669982 20029 tablet_bootstrap.cc:492] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:02.670463 20029 ts_tablet_manager.cc:1403] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.242s	user 0.008s	sys 0.004s
I20260928 01:56:02.700723 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:02.713706 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:02.612406 21465 consensus_queue.cc:1048] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:02.616456 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:02.611871 21432 consensus_queue.cc:1048] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260928 01:56:02.629528 21434 raft_consensus.cc:493] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:02.717191 21434 raft_consensus.cc:515] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.719103 19476 raft_consensus.cc:2468] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:02.723600 21434 leader_election.cc:290] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:02.632836 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:02.726038 19896 raft_consensus.cc:385] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:02.726408 19896 raft_consensus.cc:740] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:02.727353 19896 consensus_queue.cc:260] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:02.739715 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:02.749552 19890 tablet_bootstrap.cc:492] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:02.750016 19890 ts_tablet_manager.cc:1403] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.267s	user 0.002s	sys 0.015s
W20260928 01:56:02.751202 19553 leader_election.cc:343] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:02.751690 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:02.752686 21289 tablet_loader.cc:96] loaded metadata for tablet 5442dd0aa28545c8bcf3a0b977c71e98 (table default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b])
W20260928 01:56:02.753115 19553 leader_election.cc:343] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:02.756060 19553 consensus_peers.cc:597] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:02.761140 19556 leader_election.cc:304] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:02.762209 19556 leader_election.cc:343] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:02.762585 19556 leader_election.cc:304] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:02.766523 21418 raft_consensus.cc:2804] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:02.767058 21418 raft_consensus.cc:493] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:02.767551 21418 raft_consensus.cc:3060] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:02.772409 21449 raft_consensus.cc:2749] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:02.799093 19104 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:02.802923 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:02.811434 21289 tablet_loader.cc:96] loaded metadata for tablet 6546cfe6f3a6405fab41a4ebdcffb288 (table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df])
I20260928 01:56:02.821688 21289 tablet_loader.cc:96] loaded metadata for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435])
I20260928 01:56:02.822798 19890 raft_consensus.cc:359] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.823544 19890 raft_consensus.cc:385] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:02.823808 19890 raft_consensus.cc:740] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:02.824539 19890 consensus_queue.cc:260] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.828846 21418 raft_consensus.cc:515] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.830037 21380 raft_consensus.cc:493] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:02.830490 19619 raft_consensus.cc:2393] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:02.830672 21380 raft_consensus.cc:515] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:02.832132 21418 leader_election.cc:290] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:02.834389 21289 tablet_loader.cc:96] loaded metadata for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee])
I20260928 01:56:02.835093 21380 leader_election.cc:290] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:02.835731 21289 tablet_loader.cc:96] loaded metadata for tablet 664b608bb0f54fc5baa10622f7d916c1 (table default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9])
I20260928 01:56:02.838582 21289 tablet_loader.cc:96] loaded metadata for tablet 675e1e1f2630411f8b070d8ca99e8ffb (table default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93])
I20260928 01:56:02.841573 21289 tablet_loader.cc:96] loaded metadata for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331])
I20260928 01:56:02.842737 21289 tablet_loader.cc:96] loaded metadata for tablet 6ea6adefd15a4ea19011419949047e83 (table default.Table_a82317fb7790483884cbb5ebcf554128 [id=292d90fe578e4470bced0890a4e646ef])
I20260928 01:56:02.844012 21289 tablet_loader.cc:96] loaded metadata for tablet 7441c2d1a7fa4dc8a89c6717a80d3efb (table default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233])
I20260928 01:56:02.849047 21289 tablet_loader.cc:96] loaded metadata for tablet 75303ee92aae436ea6c46747a23b69b6 (table default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320])
I20260928 01:56:02.850863 19890 ts_tablet_manager.cc:1434] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.001s
I20260928 01:56:02.851903 19890 tablet_bootstrap.cc:492] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:56:02.855732 19409 leader_election.cc:343] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:02.857810 21432 consensus_queue.cc:1048] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:02.861569 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:02.871088 21289 tablet_loader.cc:96] loaded metadata for tablet 7801c623930d4e4eaf24c5c424b06d26 (table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006])
I20260928 01:56:02.873282 21289 tablet_loader.cc:96] loaded metadata for tablet 7979940c4a2e470bbecc40384edf38c9 (table default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87])
I20260928 01:56:02.878638 21289 tablet_loader.cc:96] loaded metadata for tablet 81c205176cb94d9f861cc140560944d4 (table default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765])
I20260928 01:56:02.879908 21289 tablet_loader.cc:96] loaded metadata for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9])
I20260928 01:56:02.894665 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:56:02.901732 19553 leader_election.cc:343] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:02.903353 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:02.685370 21521 raft_consensus.cc:515] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.909022 21524 leader_election.cc:290] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:02.910375 19764 raft_consensus.cc:1240] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 01:56:02.911502 21521 leader_election.cc:290] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:02.915192 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:56:02.919068 19409 consensus_peers.cc:597] T 9ec3f279423a46c1acb1cbfecf4a608a P 37089d44fdba4b6488b5b5aea28af614 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:02.920631 21428 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:02.921325 21428 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:02.923125 21289 tablet_loader.cc:96] loaded metadata for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780])
I20260928 01:56:02.929837 21428 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:02.931634 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:02.932416 19764 raft_consensus.cc:2468] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:02.933382 21289 tablet_loader.cc:96] loaded metadata for tablet 8b48eacc1cec49baabe2d87bdd06cd5c (table default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd])
I20260928 01:56:02.933917 19553 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:02.935504 19896 ts_tablet_manager.cc:1434] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.426s	user 0.007s	sys 0.000s
I20260928 01:56:02.935487 21476 raft_consensus.cc:2804] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:02.936007 21476 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:02.936537 21476 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:02.936442 21289 tablet_loader.cc:96] loaded metadata for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4])
I20260928 01:56:02.940164 21289 tablet_loader.cc:96] loaded metadata for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca])
I20260928 01:56:02.941756 21289 tablet_loader.cc:96] loaded metadata for tablet 8df69eb3a37445ed8a2be0ef3bf32cdb (table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624])
W20260928 01:56:02.942382 19409 leader_election.cc:343] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:02.943032 21289 tablet_loader.cc:96] loaded metadata for tablet 8e39fce4f0a149a898de678d73052f52 (table default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55])
W20260928 01:56:02.943372 19409 consensus_peers.cc:597] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:02.944275 21432 consensus_queue.cc:1059] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:02.947481 21289 tablet_loader.cc:96] loaded metadata for tablet 9690a224bb004152ba65d525cc10bd9f (table default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5])
I20260928 01:56:02.947333 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:02.947949 19473 raft_consensus.cc:3060] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:02.948756 21289 tablet_loader.cc:96] loaded metadata for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7])
I20260928 01:56:02.950794 21289 tablet_loader.cc:96] loaded metadata for tablet 99e806ba248746d2bde39a2eb76b17df (table default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542])
I20260928 01:56:02.952891 21289 tablet_loader.cc:96] loaded metadata for tablet 9a9c2db89fb8467d91c6bd01985d8b40 (table default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3])
I20260928 01:56:02.954991 21289 tablet_loader.cc:96] loaded metadata for tablet 9ec3f279423a46c1acb1cbfecf4a608a (table default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b])
I20260928 01:56:02.955077 19890 tablet_bootstrap.cc:654] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:02.956235 21289 tablet_loader.cc:96] loaded metadata for tablet 9f80b652a19a41968d1bfbaaf020b721 (table default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1])
I20260928 01:56:02.956300 19473 raft_consensus.cc:2468] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:02.957399 21289 tablet_loader.cc:96] loaded metadata for tablet a01b795606604960bc7cafab4ff6f3d0 (table default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae])
I20260928 01:56:02.958362 21289 tablet_loader.cc:96] loaded metadata for tablet a12bafcc09ef4342bff89b0475f721af (table default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b])
I20260928 01:56:02.959308 21289 tablet_loader.cc:96] loaded metadata for tablet a1710b95678440b1bff8a92080d43272 (table default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d])
I20260928 01:56:02.960531 21289 tablet_loader.cc:96] loaded metadata for tablet a23b494afa1f45988d447519356d2b03 (table default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305])
I20260928 01:56:02.965807 21289 tablet_loader.cc:96] loaded metadata for tablet a735102c576640b69323cacb50393a42 (table default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e])
I20260928 01:56:02.967131 21289 tablet_loader.cc:96] loaded metadata for tablet a82d3233e4514813b22121f75d11eebc (table default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151])
I20260928 01:56:02.967162 21380 raft_consensus.cc:3055] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:02.967682 21380 raft_consensus.cc:740] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:02.970883 20029 raft_consensus.cc:359] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.971748 20029 raft_consensus.cc:385] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:02.972108 20029 raft_consensus.cc:740] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:02.972920 20029 consensus_queue.cc:260] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:02.979723 21289 tablet_loader.cc:96] loaded metadata for tablet b4b520e89c364692af1aedde2a59c3da (table default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca])
I20260928 01:56:02.981050 21289 tablet_loader.cc:96] loaded metadata for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5])
I20260928 01:56:02.982952 21289 tablet_loader.cc:96] loaded metadata for tablet b8cacb4a90a54cd3b5b3e7a9310e06ed (table default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d])
I20260928 01:56:03.007872 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:03.008831 19476 raft_consensus.cc:2468] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:03.009938 19556 leader_election.cc:304] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:03.011823 21449 raft_consensus.cc:2804] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:03.012526 21449 raft_consensus.cc:697] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:03.012997 21428 consensus_queue.cc:1048] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:03.013815 21449 consensus_queue.cc:237] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.017740 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:03.018455 19617 raft_consensus.cc:2468] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:03.018939 21289 tablet_loader.cc:96] loaded metadata for tablet ba89039dcfa848159112caa76802b5f1 (table default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749])
I20260928 01:56:03.020289 21289 tablet_loader.cc:96] loaded metadata for tablet bab12ba3e1f542949e3f203dae0fa80e (table default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb])
W20260928 01:56:03.021235 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 77220.7us
I20260928 01:56:03.028656 21289 tablet_loader.cc:96] loaded metadata for tablet c2597de2c4304074977db5a3c0426814 (table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e])
I20260928 01:56:03.028301 21476 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:03.030587 19896 tablet_bootstrap.cc:492] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:03.032357 21289 tablet_loader.cc:96] loaded metadata for tablet c53d75604ee3405d83fe9ecaa824ea68 (table default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513])
I20260928 01:56:03.032099 21418 raft_consensus.cc:493] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:03.033613 21289 tablet_loader.cc:96] loaded metadata for tablet c74a4a00552c4a14a871a59465524f1c (table default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a])
I20260928 01:56:03.032991 21418 raft_consensus.cc:515] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.035601 21289 tablet_loader.cc:96] loaded metadata for tablet c8fd6b965d22477aaee9bafccb2069b1 (table default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02])
I20260928 01:56:03.037642 21418 leader_election.cc:290] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:03.046787 21476 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:03.047883 21289 tablet_loader.cc:96] loaded metadata for tablet c9f3e966ab0d46d187fb9daa356b16fc (table default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b])
I20260928 01:56:03.054670 21289 tablet_loader.cc:96] loaded metadata for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e])
I20260928 01:56:03.058465 21289 tablet_loader.cc:96] loaded metadata for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305])
I20260928 01:56:03.059687 21289 tablet_loader.cc:96] loaded metadata for tablet d114d5ba862044b4b88eee27395db7e3 (table default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb])
I20260928 01:56:03.067747 21289 tablet_loader.cc:96] loaded metadata for tablet d7774406b22547d29d9d42c969cf0874 (table default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa])
I20260928 01:56:03.075865 21476 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:03.076566 21476 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:03.014794 21380 consensus_queue.cc:260] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.084474 21476 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:03.084870 21380 raft_consensus.cc:3060] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:03.088284 19890 tablet_bootstrap.cc:492] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:03.088795 19890 ts_tablet_manager.cc:1403] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.237s	user 0.016s	sys 0.003s
I20260928 01:56:03.098651 21289 tablet_loader.cc:96] loaded metadata for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4])
I20260928 01:56:03.100749 21289 tablet_loader.cc:96] loaded metadata for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e])
I20260928 01:56:03.102085 21289 tablet_loader.cc:96] loaded metadata for tablet e6206afe245740b1819069a48e8b548e (table default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37])
I20260928 01:56:03.103350 21289 tablet_loader.cc:96] loaded metadata for tablet e8f6ce7612d4463ebe95e07557bca4e7 (table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67])
I20260928 01:56:03.105126 19890 raft_consensus.cc:359] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.105824 19890 raft_consensus.cc:385] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:03.106097 19890 raft_consensus.cc:740] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:03.108357 19890 consensus_queue.cc:260] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.044005 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:03.111258 19890 ts_tablet_manager.cc:1434] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260928 01:56:03.046805 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:03.085399 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:03.112426 19763 raft_consensus.cc:2468] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
W20260928 01:56:03.112691 19553 leader_election.cc:343] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:03.113032 20029 ts_tablet_manager.cc:1434] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.442s	user 0.007s	sys 0.003s
I20260928 01:56:03.113653 19764 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:03.113963 19553 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:03.114791 21476 raft_consensus.cc:2804] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:03.115240 21476 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:03.115679 21476 raft_consensus.cc:3060] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:03.126345 21524 raft_consensus.cc:493] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:03.127367 19764 raft_consensus.cc:2468] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:03.126726 21289 tablet_loader.cc:96] loaded metadata for tablet e927cd8a991f46278c2bb663cee7f753 (table default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75])
I20260928 01:56:03.141127 19553 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:03.142164 21479 raft_consensus.cc:2804] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:03.142865 21479 raft_consensus.cc:697] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:03.144284 21289 tablet_loader.cc:96] loaded metadata for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba])
I20260928 01:56:03.145205 19412 leader_election.cc:304] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:03.146270 21434 raft_consensus.cc:2749] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:03.148518 21289 tablet_loader.cc:96] loaded metadata for tablet eb014699060e4a6caf4caaf33c31710a (table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f])
I20260928 01:56:03.148514 21479 consensus_queue.cc:237] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:03.150492 21289 tablet_loader.cc:96] loaded metadata for tablet ef752c3b4b22490ab42292f61278da52 (table default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619])
I20260928 01:56:03.153326 21418 raft_consensus.cc:493] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:03.153834 21418 raft_consensus.cc:515] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.155833 21418 leader_election.cc:290] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:03.158439 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:03.164403 21530 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:03.164986 21530 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:03.166584 19765 raft_consensus.cc:3060] T fa3b9ec9f88342c0aa77c0fc92d26205 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:03.167253 21530 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:03.190276 21289 tablet_loader.cc:96] loaded metadata for tablet f7b78eb499d6418f8877bf3b59bbbec2 (table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d])
I20260928 01:56:03.127018 21524 raft_consensus.cc:515] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.192042 19763 raft_consensus.cc:2468] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
W20260928 01:56:03.128338 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 52115.6us
I20260928 01:56:03.195214 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:03.197585 21289 tablet_loader.cc:96] loaded metadata for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9])
I20260928 01:56:03.197592 19553 leader_election.cc:304] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:03.195845 19614 raft_consensus.cc:2468] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:03.199290 19704 leader_election.cc:304] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:03.200918 21428 raft_consensus.cc:2804] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:03.201363 21428 raft_consensus.cc:493] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:03.201692 21428 raft_consensus.cc:3060] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:03.202517 21289 tablet_loader.cc:96] loaded metadata for tablet fa3b9ec9f88342c0aa77c0fc92d26205 (table default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87])
I20260928 01:56:03.205195 21494 raft_consensus.cc:2804] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:03.205613 21494 raft_consensus.cc:493] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:03.206017 21494 raft_consensus.cc:3060] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:03.205345 21289 tablet_loader.cc:96] loaded metadata for tablet fb159b3aad31479f80683b0d80549cc3 (table default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b])
W20260928 01:56:03.207358 19104 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:03.209244 21289 tablet_loader.cc:96] loaded metadata for tablet fc428ccbf88e4d5cbae197cb67e9a0a5 (table default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14])
I20260928 01:56:03.211688 21289 tablet_loader.cc:96] loaded metadata for tablet fcf1b727e86a43b08bd464647fa529a3 (table default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619])
I20260928 01:56:03.220556 19890 tablet_bootstrap.cc:492] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:56:03.252507 21289 catalog_manager.cc:1525] Time spent T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: Loading table and tablet metadata into memory: real 6.388s	user 0.440s	sys 0.081s
I20260928 01:56:03.252660 19196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:03.253187 21289 catalog_manager.cc:1533] Initializing Kudu cluster ID...
W20260928 01:56:03.253770 19196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 12) took 5004 ms (client timeout 642 ms). Trace:
W20260928 01:56:03.254420 19196 rpcz_store.cc:269] 0928 01:55:58.249448 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:58.249749 (+   301us) service_pool.cc:224] Handling call
0928 01:56:03.253687 (+5003938us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:03.255807 19201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:03.223416 20029 tablet_bootstrap.cc:492] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:56:03.256747 19201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 16) took 619 ms (client timeout 730 ms). Trace:
W20260928 01:56:03.257228 19201 rpcz_store.cc:269] 0928 01:56:02.636980 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:02.637217 (+   237us) service_pool.cc:224] Handling call
0928 01:56:03.256546 (+619329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:03.258369 19199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:56:03.259377 19199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 372) took 5248 ms (client timeout 528 ms). Trace:
W20260928 01:56:03.259779 19199 rpcz_store.cc:269] 0928 01:55:58.011393 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:58.011712 (+   319us) service_pool.cc:224] Handling call
0928 01:56:03.259156 (+5247444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:03.261828 19200 raft_consensus.cc:1240] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 6 LEADER]: Rejecting Update request from peer 81ebb46a410e43ebaec3ef4dd13a71fc for earlier term 5. Current term is 6. Ops: []
I20260928 01:56:03.262573 19200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33278 (request call id 371) took 5864 ms. Trace:
I20260928 01:56:03.263005 19200 rpcz_store.cc:276] 0928 01:55:57.398449 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:57.398615 (+   166us) service_pool.cc:224] Handling call
0928 01:56:03.261513 (+5862898us) raft_consensus.cc:1471] Updating replica for 0 ops
0928 01:56:03.262283 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:56:03.262486 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:03.265586 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:56:03.267258 19202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 373) took 4503 ms (client timeout 528 ms). Trace:
I20260928 01:56:03.267305 21524 leader_election.cc:290] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:03.267668 19202 rpcz_store.cc:269] 0928 01:55:58.763699 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:58.763893 (+   194us) service_pool.cc:224] Handling call
0928 01:56:03.267104 (+4503211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:03.268800 19203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:56:03.269743 19203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 374) took 2907 ms (client timeout 846 ms). Trace:
W20260928 01:56:03.270164 19203 rpcz_store.cc:269] 0928 01:56:00.362787 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:00.363585 (+   798us) service_pool.cc:224] Handling call
0928 01:56:03.269669 (+2906084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:03.275642 21545 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:03.276474 21545 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:03.278654 21476 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:03.280812 21545 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:03.281781 21476 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:03.285354 21428 raft_consensus.cc:515] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.287353 21428 leader_election.cc:290] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:03.294690 19194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:03.299226 20547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:03.300935 20547 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81ebb46a410e43ebaec3ef4dd13a71fc for term 7 because replica has last-logged OpId of term: 6 index: 342, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 342.
W20260928 01:56:03.306651 19194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33278 (request call id 375) took 2024 ms (client timeout 846 ms). Trace:
W20260928 01:56:03.307276 19194 rpcz_store.cc:269] 0928 01:56:01.282000 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:01.282944 (+   944us) service_pool.cc:224] Handling call
0928 01:56:03.306550 (+2023606us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:03.308780 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:56:03.309749 19197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 15) took 2089 ms (client timeout 640 ms). Trace:
I20260928 01:56:03.311462 19195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:56:03.312500 19195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 14) took 2688 ms (client timeout 640 ms). Trace:
W20260928 01:56:03.312939 19195 rpcz_store.cc:269] 0928 01:56:00.624166 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:00.624513 (+   347us) service_pool.cc:224] Handling call
0928 01:56:03.312409 (+2687896us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:03.313884 19198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:56:03.310114 19197 rpcz_store.cc:269] 0928 01:56:01.220169 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:01.220562 (+   393us) service_pool.cc:224] Handling call
0928 01:56:03.309676 (+2089114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 01:56:03.314960 19198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 13) took 4366 ms (client timeout 642 ms). Trace:
W20260928 01:56:03.315305 19198 rpcz_store.cc:269] 0928 01:55:58.948152 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:58.948462 (+   310us) service_pool.cc:224] Handling call
0928 01:56:03.314888 (+4366426us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:03.316154 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:03.317873 19102 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:56:03.325030 21545 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:03.325884 19890 tablet_bootstrap.cc:654] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:03.366007 21289 catalog_manager.cc:1308] Loaded cluster ID: 726a03a5ce124d548da65567db2a283d
I20260928 01:56:03.369138 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:03.369841 19763 raft_consensus.cc:3060] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:03.372558 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:03.376948 21544 raft_consensus.cc:493] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:03.377504 21544 raft_consensus.cc:515] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.379755 21544 leader_election.cc:290] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:03.382200 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:03.383709 19553 leader_election.cc:343] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:03.385637 19763 raft_consensus.cc:2468] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:03.408236 19553 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:03.410282 21428 raft_consensus.cc:2804] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:03.410828 21428 raft_consensus.cc:697] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:03.412492 19896 tablet_bootstrap.cc:700] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614: Time spent opening tablet: real 0.141s	user 0.003s	sys 0.000s
I20260928 01:56:03.413318 19896 tablet_bootstrap.cc:654] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:03.411702 21428 consensus_queue.cc:237] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:03.432708 20029 tablet_bootstrap.cc:654] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:03.442775 19890 tablet_bootstrap.cc:492] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:03.443202 19890 ts_tablet_manager.cc:1403] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.238s	user 0.021s	sys 0.025s
I20260928 01:56:03.446589 19890 raft_consensus.cc:359] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.447275 19890 raft_consensus.cc:385] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:03.447566 19890 raft_consensus.cc:740] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:03.448288 19890 consensus_queue.cc:260] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.450398 19890 ts_tablet_manager.cc:1434] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260928 01:56:03.451304 19890 tablet_bootstrap.cc:492] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:03.472805 19890 tablet_bootstrap.cc:654] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:03.482587 21494 raft_consensus.cc:515] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.490720 21289 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:56:03.493476 20029 tablet_bootstrap.cc:492] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:03.494634 20029 ts_tablet_manager.cc:1403] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.271s	user 0.013s	sys 0.000s
I20260928 01:56:03.508533 19764 raft_consensus.cc:2393] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:03.520413 21494 leader_election.cc:290] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:03.527985 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:03.528786 19614 raft_consensus.cc:2393] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
W20260928 01:56:03.537808 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 373430us
I20260928 01:56:03.548658 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:03.549584 19764 raft_consensus.cc:2393] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 2: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:03.574046 19890 tablet_bootstrap.cc:492] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:03.574507 19890 ts_tablet_manager.cc:1403] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.008s
I20260928 01:56:03.579337 19890 raft_consensus.cc:359] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.580300 19890 raft_consensus.cc:385] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:03.580632 19890 raft_consensus.cc:740] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:03.584184 19890 consensus_queue.cc:260] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:03.585592 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 440358us
I20260928 01:56:03.585776 19890 ts_tablet_manager.cc:1434] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260928 01:56:03.522467 20029 raft_consensus.cc:359] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.597225 20029 raft_consensus.cc:385] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:03.597500 20029 raft_consensus.cc:740] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:03.626207 19890 tablet_bootstrap.cc:492] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:03.598387 20029 consensus_queue.cc:260] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.641993 20029 ts_tablet_manager.cc:1434] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.143s	user 0.003s	sys 0.003s
I20260928 01:56:03.643301 20029 tablet_bootstrap.cc:492] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:03.648176 19890 tablet_bootstrap.cc:654] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:03.653105 21289 catalog_manager.cc:1553] Loading token signing keys...
I20260928 01:56:03.673434 21289 catalog_manager.cc:6230] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: Loaded TSK: 0
I20260928 01:56:03.674520 21289 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 01:56:03.693506 21428 raft_consensus.cc:493] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:03.694268 21428 raft_consensus.cc:515] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.696861 21428 leader_election.cc:290] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:03.698508 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:03.700315 19553 leader_election.cc:343] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:03.701753 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 114992us
I20260928 01:56:03.714881 19890 tablet_bootstrap.cc:492] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:03.715344 19890 ts_tablet_manager.cc:1403] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.009s
I20260928 01:56:03.717803 19890 raft_consensus.cc:359] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.720871 20029 tablet_bootstrap.cc:654] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:03.718425 19890 raft_consensus.cc:385] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:03.771925 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:03.774847 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:03.776014 19476 raft_consensus.cc:2410] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260928 01:56:03.777266 19103 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2156dae74ee748cd845b6dea1d3b8ea8 consensus state has no leader
I20260928 01:56:03.790925 20029 tablet_bootstrap.cc:492] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:03.798071 20029 ts_tablet_manager.cc:1403] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.002s
I20260928 01:56:03.746376 19890 raft_consensus.cc:740] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:03.820228 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:03.841965 21524 raft_consensus.cc:493] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:03.842435 21524 raft_consensus.cc:515] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.845660 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:03.846342 19614 raft_consensus.cc:2468] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:03.849581 19704 leader_election.cc:304] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:03.850351 21494 raft_consensus.cc:2804] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:03.850759 21494 raft_consensus.cc:493] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:03.851083 21494 raft_consensus.cc:3060] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:03.860785 21524 leader_election.cc:290] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:03.866125 19412 leader_election.cc:304] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:03.867277 21432 raft_consensus.cc:2804] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:03.867637 21432 raft_consensus.cc:493] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:03.867980 21432 raft_consensus.cc:3060] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:03.840606 20029 raft_consensus.cc:359] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.868983 20029 raft_consensus.cc:385] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:03.871824 21494 raft_consensus.cc:515] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.875346 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:03.875864 19614 raft_consensus.cc:3060] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:03.876598 21432 raft_consensus.cc:515] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:03.882491 19614 raft_consensus.cc:2468] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:03.883870 19704 leader_election.cc:304] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:03.884958 21524 raft_consensus.cc:2804] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:03.885447 21524 raft_consensus.cc:697] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:03.886274 21524 consensus_queue.cc:237] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.871441 20029 raft_consensus.cc:740] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:03.891043 20029 consensus_queue.cc:260] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:03.898693 20029 ts_tablet_manager.cc:1434] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.003s
I20260928 01:56:03.899711 20029 tablet_bootstrap.cc:492] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:56:03.904603 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 159487us
I20260928 01:56:03.906715 21380 consensus_queue.cc:1048] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:03.902616 21494 leader_election.cc:290] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:03.921962 19896 tablet_bootstrap.cc:492] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:03.922536 19896 ts_tablet_manager.cc:1403] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.892s	user 0.018s	sys 0.011s
I20260928 01:56:03.927698 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:03.941318 20029 tablet_bootstrap.cc:654] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:03.958272 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:03.991400 21432 leader_election.cc:290] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:03.997674 19890 consensus_queue.cc:260] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.000566 19890 ts_tablet_manager.cc:1434] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.285s	user 0.010s	sys 0.003s
I20260928 01:56:04.017793 19896 raft_consensus.cc:359] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.018530 19896 raft_consensus.cc:385] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:04.018798 19896 raft_consensus.cc:740] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:04.019451 19896 consensus_queue.cc:260] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.040901 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:04.041795 19621 raft_consensus.cc:3060] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:04.011188 21524 raft_consensus.cc:493] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:04.047991 21524 raft_consensus.cc:515] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.050280 21524 leader_election.cc:290] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:04.055025 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:04.058266 20029 tablet_bootstrap.cc:492] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:04.058743 20029 ts_tablet_manager.cc:1403] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.159s	user 0.016s	sys 0.016s
I20260928 01:56:04.061859 20029 raft_consensus.cc:359] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.062747 20029 raft_consensus.cc:385] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:04.063047 20029 raft_consensus.cc:740] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:04.063820 20029 consensus_queue.cc:260] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.066002 20029 ts_tablet_manager.cc:1434] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260928 01:56:04.070541 19621 raft_consensus.cc:2468] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:04.082389 19763 raft_consensus.cc:1275] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:56:04.084968 20029 tablet_bootstrap.cc:492] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:04.094300 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:04.094282 19190 catalog_manager.cc:5838] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:04.097801 19190 catalog_manager.cc:5838] T a82d3233e4514813b22121f75d11eebc P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:04.073140 19890 tablet_bootstrap.cc:492] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:04.076992 21544 raft_consensus.cc:493] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:04.111824 19896 ts_tablet_manager.cc:1434] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.189s	user 0.007s	sys 0.002s
I20260928 01:56:04.099833 19190 catalog_manager.cc:5838] T fa3b9ec9f88342c0aa77c0fc92d26205 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:04.112983 19896 tablet_bootstrap.cc:492] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:04.113554 19190 catalog_manager.cc:5838] T b8cacb4a90a54cd3b5b3e7a9310e06ed P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
W20260928 01:56:04.116362 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 45148.7us
W20260928 01:56:04.117394 20456 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.730s (SENT)
I20260928 01:56:04.117871 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:04.084143 21428 consensus_queue.cc:1048] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:04.111807 21544 raft_consensus.cc:515] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.128127 21544 leader_election.cc:290] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:04.145773 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:04.148314 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:04.150379 19466 raft_consensus.cc:2468] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:04.152742 21568 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:04.162585 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:04.163720 19616 raft_consensus.cc:2468] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:04.170217 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:04.174243 20029 tablet_bootstrap.cc:654] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:04.190397 19890 tablet_bootstrap.cc:654] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:56:04.191463 19553 leader_election.cc:343] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:04.194046 19553 consensus_peers.cc:597] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:04.197711 20029 tablet_bootstrap.cc:492] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:04.198148 20029 ts_tablet_manager.cc:1403] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.113s	user 0.006s	sys 0.005s
W20260928 01:56:04.198091 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 53007us
I20260928 01:56:04.201471 19703 leader_election.cc:304] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:04.206151 21492 raft_consensus.cc:2749] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:04.206209 19703 leader_election.cc:304] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:04.207273 21492 raft_consensus.cc:2749] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:04.209124 20029 raft_consensus.cc:359] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:04.209794 20029 raft_consensus.cc:385] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:04.210054 20029 raft_consensus.cc:740] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:56:04.218325 19409 leader_election.cc:343] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:04.221820 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:04.222541 19473 raft_consensus.cc:2468] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:04.225514 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:04.226125 19473 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:04.241384 19765 raft_consensus.cc:3060] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:04.252035 19704 leader_election.cc:304] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:04.210717 20029 consensus_queue.cc:260] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:04.259274 21566 raft_consensus.cc:2804] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:04.264964 21566 raft_consensus.cc:493] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:04.265352 21566 raft_consensus.cc:3060] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:04.265509 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:04.266208 19466 raft_consensus.cc:2468] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:04.267127 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:04.267719 19476 raft_consensus.cc:2468] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
W20260928 01:56:04.271147 19703 leader_election.cc:343] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:04.274221 21566 raft_consensus.cc:515] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.276551 21566 leader_election.cc:290] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:04.293270 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:04.294157 19616 raft_consensus.cc:3060] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:04.304867 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet 57a81b9455a340728fea713318e1e77a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:04.310003 19890 tablet_bootstrap.cc:492] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:04.310570 19890 ts_tablet_manager.cc:1403] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.238s	user 0.012s	sys 0.000s
I20260928 01:56:04.313269 19890 raft_consensus.cc:359] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.313971 19890 raft_consensus.cc:385] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:04.314239 19890 raft_consensus.cc:740] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:04.321360 20029 ts_tablet_manager.cc:1434] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.002s
I20260928 01:56:04.330610 20029 tablet_bootstrap.cc:492] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:04.339036 19896 tablet_bootstrap.cc:654] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:04.352748 19890 consensus_queue.cc:260] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.354275 19890 ts_tablet_manager.cc:1434] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260928 01:56:04.357358 19616 raft_consensus.cc:2468] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:04.372255 20029 tablet_bootstrap.cc:654] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:56:04.324608 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 52197.4us
I20260928 01:56:04.373508 19704 leader_election.cc:304] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:04.381641 21524 raft_consensus.cc:2804] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:04.382154 21524 raft_consensus.cc:697] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:04.383224 21524 consensus_queue.cc:237] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.393355 19890 tablet_bootstrap.cc:492] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:04.323176 21583 tablet_replica.cc:333] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:04.409543 21583 raft_consensus.cc:2243] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:56:04.420392 19814 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:04.429208 21583 raft_consensus.cc:2272] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:04.433662 21589 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:04.434454 21589 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:04.437654 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:04.439173 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:04.440830 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:56:04.445397 21583 ts_tablet_manager.cc:1916] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:04.446887 19890 tablet_bootstrap.cc:654] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:04.462057 21590 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:04.477402 19473 raft_consensus.cc:2468] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:04.480787 19522 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:04.490262 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:04.490821 19469 raft_consensus.cc:3060] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:04.493466 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:04.494650 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:04.497659 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:04.499253 19470 raft_consensus.cc:1275] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:56:04.501297 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:04.502008 19466 raft_consensus.cc:3060] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:04.437942 21589 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:04.530448 19469 raft_consensus.cc:2468] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:04.531363 19466 raft_consensus.cc:2468] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:04.532431 19475 raft_consensus.cc:1275] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260928 01:56:04.546499 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 93393.3us
I20260928 01:56:04.558103 21476 raft_consensus.cc:493] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:04.558633 21476 raft_consensus.cc:515] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.560737 21476 leader_election.cc:290] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:04.562973 20029 tablet_bootstrap.cc:492] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:04.563419 20029 ts_tablet_manager.cc:1403] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.233s	user 0.005s	sys 0.008s
I20260928 01:56:04.566066 20029 raft_consensus.cc:359] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.566722 20029 raft_consensus.cc:385] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:04.566977 20029 raft_consensus.cc:740] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:04.567564 20029 consensus_queue.cc:260] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.576192 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:04.582393 19764 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:04.584036 20029 ts_tablet_manager.cc:1434] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.004s
I20260928 01:56:04.585439 20029 tablet_bootstrap.cc:492] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:04.597667 19556 leader_election.cc:304] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:04.599258 21544 raft_consensus.cc:2764] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 01:56:04.604668 19763 raft_consensus.cc:1275] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260928 01:56:04.610219 19553 leader_election.cc:343] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:04.611552 21428 consensus_queue.cc:1048] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:04.620615 19896 tablet_bootstrap.cc:492] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:04.621301 19896 ts_tablet_manager.cc:1403] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.509s	user 0.011s	sys 0.003s
W20260928 01:56:04.621189 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 73247.1us
W20260928 01:56:04.622337 19703 leader_election.cc:343] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:04.622897 19703 leader_election.cc:304] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:04.623715 21579 raft_consensus.cc:2749] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:56:04.635798 20029 tablet_bootstrap.cc:654] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:56:04.643867 19703 leader_election.cc:343] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:04.644898 19703 leader_election.cc:343] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:04.646525 21583 ts_tablet_manager.cc:1929] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:04.648766 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:04.651515 21583 log.cc:1199] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/57a81b9455a340728fea713318e1e77a
I20260928 01:56:04.649513 19466 raft_consensus.cc:3060] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:04.662562 21583 ts_tablet_manager.cc:1950] T 57a81b9455a340728fea713318e1e77a P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:04.665335 19456 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c61408724e4a70b39e5dbdab9a3e8a with delete_type TABLET_DATA_DELETED (replaced by tablet 8df69eb3a37445ed8a2be0ef3bf32cdb) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:04.691298 19896 raft_consensus.cc:359] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.692011 19896 raft_consensus.cc:385] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:04.692615 19896 raft_consensus.cc:740] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:04.695989 21598 tablet_replica.cc:333] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:04.711441 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 57a81b9455a340728fea713318e1e77a (table default.Table_a3ed770c6c6f410ba1b6c0db32c665bc [id=49662aab8c5046d2a1f6b7d363da8ada]) successfully deleted
I20260928 01:56:04.693333 19896 consensus_queue.cc:260] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.713627 19896 ts_tablet_manager.cc:1434] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.000s
I20260928 01:56:04.714607 19896 tablet_bootstrap.cc:492] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:04.709110 19412 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:04.728587 21552 raft_consensus.cc:2749] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:04.620886 19890 tablet_bootstrap.cc:492] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:04.743546 19890 ts_tablet_manager.cc:1403] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.351s	user 0.011s	sys 0.002s
I20260928 01:56:04.746088 19890 raft_consensus.cc:359] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.746757 19890 raft_consensus.cc:385] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:04.747020 19890 raft_consensus.cc:740] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
W20260928 01:56:04.752764 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 63999.7us
W20260928 01:56:04.757222 19556 leader_election.cc:343] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:04.757652 19556 leader_election.cc:304] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:04.758735 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 113858us
I20260928 01:56:04.763108 19466 raft_consensus.cc:2468] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:04.764775 19412 leader_election.cc:304] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:04.767148 21465 raft_consensus.cc:2804] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:04.767618 21465 raft_consensus.cc:697] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:04.767874 19896 tablet_bootstrap.cc:654] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:04.768589 21465 consensus_queue.cc:237] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:04.776847 21544 raft_consensus.cc:2749] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:04.786509 19556 leader_election.cc:343] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:04.792510 19556 leader_election.cc:304] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:04.794271 21600 raft_consensus.cc:2749] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:04.747617 19890 consensus_queue.cc:260] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.797001 19890 ts_tablet_manager.cc:1434] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.000s
I20260928 01:56:04.798072 19890 tablet_bootstrap.cc:492] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:56:04.825038 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 65173.7us
I20260928 01:56:04.842310 21580 raft_consensus.cc:493] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:04.842859 21580 raft_consensus.cc:515] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:04.845018 21580 leader_election.cc:290] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:04.855212 19613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:04.876828 21579 consensus_queue.cc:1048] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:04.954731 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:04.955570 19464 raft_consensus.cc:2393] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:04.965371 21598 raft_consensus.cc:2243] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:56:04.966531 21598 raft_consensus.cc:2272] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 01:56:04.975512 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 202682us
W20260928 01:56:04.988389 19703 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 53360.9us
I20260928 01:56:04.990665 20029 tablet_bootstrap.cc:492] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:04.990671 19896 tablet_bootstrap.cc:492] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:04.991207 19896 ts_tablet_manager.cc:1403] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.277s	user 0.014s	sys 0.006s
I20260928 01:56:04.995206 21598 ts_tablet_manager.cc:1916] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:05.002245 20029 ts_tablet_manager.cc:1403] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.417s	user 0.012s	sys 0.007s
I20260928 01:56:05.005086 19896 raft_consensus.cc:359] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.005817 19896 raft_consensus.cc:385] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:05.006138 19896 raft_consensus.cc:740] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:05.006788 19896 consensus_queue.cc:260] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.009109 19896 ts_tablet_manager.cc:1434] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260928 01:56:05.028481 19890 tablet_bootstrap.cc:654] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:05.035157 19896 tablet_bootstrap.cc:492] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:56:05.037308 19556 leader_election.cc:343] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:05.037772 19556 leader_election.cc:304] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:05.040132 21600 raft_consensus.cc:493] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:05.040613 21600 raft_consensus.cc:515] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.042884 21600 leader_election.cc:290] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:05.043645 21600 raft_consensus.cc:2749] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:05.049562 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36076aa674b9401b9b76fbf066348d06" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:05.049600 21600 consensus_queue.cc:1048] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:56:05.052120 19553 leader_election.cc:343] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:05.073061 19896 tablet_bootstrap.cc:654] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:56:05.075783 21615 log.cc:927] Time spent T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260928 01:56:05.079449 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:05.084038 20029 raft_consensus.cc:359] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.085125 20029 raft_consensus.cc:385] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:05.085418 20029 raft_consensus.cc:740] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:05.086165 20029 consensus_queue.cc:260] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:05.098816 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 56951.2us
I20260928 01:56:05.107173 21476 consensus_queue.cc:1048] T 75303ee92aae436ea6c46747a23b69b6 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:05.109712 19556 leader_election.cc:304] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:05.143079 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 68918.6us
I20260928 01:56:05.144059 19703 leader_election.cc:304] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:05.146378 20029 ts_tablet_manager.cc:1434] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.128s	user 0.006s	sys 0.000s
I20260928 01:56:05.147430 20029 tablet_bootstrap.cc:492] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:05.147979 21612 raft_consensus.cc:3060] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:05.148661 21617 raft_consensus.cc:2804] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:05.148908 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36076aa674b9401b9b76fbf066348d06" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:05.149667 21617 raft_consensus.cc:697] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:05.153915 21617 consensus_queue.cc:237] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:05.160696 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 51058.8us
W20260928 01:56:05.165378 19191 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 273) took 997 ms (client timeout 1000 ms). Trace:
W20260928 01:56:05.165835 19191 rpcz_store.cc:269] 0928 01:56:04.168334 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:04.168470 (+   136us) service_pool.cc:224] Handling call
0928 01:56:05.165266 (+996796us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
W20260928 01:56:05.186267 19556 leader_election.cc:343] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:05.193706 19556 leader_election.cc:304] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:05.188944 21600 consensus_queue.cc:1048] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:05.199014 21600 raft_consensus.cc:2749] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:05.204807 19743 tablet_service.cc:1511] Processing CreateTablet for tablet d114d5ba862044b4b88eee27395db7e3 (DEFAULT_TABLE table=default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.206166 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d114d5ba862044b4b88eee27395db7e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.209672 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 9690a224bb004152ba65d525cc10bd9f (DEFAULT_TABLE table=default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.210945 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9690a224bb004152ba65d525cc10bd9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.220862 19748 tablet_service.cc:1511] Processing CreateTablet for tablet eb014699060e4a6caf4caaf33c31710a (DEFAULT_TABLE table=default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.222234 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb014699060e4a6caf4caaf33c31710a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.222172 21612 raft_consensus.cc:2749] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:05.222710 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3 (DEFAULT_TABLE table=default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.223826 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:56:05.231566 19556 leader_election.cc:343] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:05.232048 19556 leader_election.cc:304] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:05.233203 21428 raft_consensus.cc:2749] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:05.237564 19744 tablet_service.cc:1511] Processing CreateTablet for tablet e43bec2c4274497ea73872d0db233eac (DEFAULT_TABLE table=default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.238705 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e43bec2c4274497ea73872d0db233eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.242256 19746 tablet_service.cc:1511] Processing CreateTablet for tablet a1710b95678440b1bff8a92080d43272 (DEFAULT_TABLE table=default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.243428 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1710b95678440b1bff8a92080d43272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.245069 19742 tablet_service.cc:1511] Processing CreateTablet for tablet e6206afe245740b1819069a48e8b548e (DEFAULT_TABLE table=default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.246389 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6206afe245740b1819069a48e8b548e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.254942 19890 tablet_bootstrap.cc:492] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:05.255398 19890 ts_tablet_manager.cc:1403] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.458s	user 0.002s	sys 0.009s
I20260928 01:56:05.259783 19890 raft_consensus.cc:359] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.260689 19890 raft_consensus.cc:385] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:05.260972 19890 raft_consensus.cc:740] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:05.271148 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 01cc307b127446958bd4199a1aa60adb (DEFAULT_TABLE table=default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 01:56:05.271544 19104 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0d5018f065824614a42f93afd49f770e consensus state has no leader
I20260928 01:56:05.272341 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01cc307b127446958bd4199a1aa60adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.278680 19444 tablet_service.cc:1511] Processing CreateTablet for tablet 9690a224bb004152ba65d525cc10bd9f (DEFAULT_TABLE table=default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.279719 20029 tablet_bootstrap.cc:654] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:05.281000 19454 tablet_service.cc:1511] Processing CreateTablet for tablet e6206afe245740b1819069a48e8b548e (DEFAULT_TABLE table=default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.281154 19450 tablet_service.cc:1511] Processing CreateTablet for tablet eb014699060e4a6caf4caaf33c31710a (DEFAULT_TABLE table=default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.283052 19441 tablet_service.cc:1511] Processing CreateTablet for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3 (DEFAULT_TABLE table=default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.286142 19446 tablet_service.cc:1511] Processing CreateTablet for tablet e43bec2c4274497ea73872d0db233eac (DEFAULT_TABLE table=default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.280094 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9690a224bb004152ba65d525cc10bd9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.307487 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.306021 19456 tablet_service.cc:1511] Processing CreateTablet for tablet d114d5ba862044b4b88eee27395db7e3 (DEFAULT_TABLE table=default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.310760 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6206afe245740b1819069a48e8b548e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.321702 19476 raft_consensus.cc:3060] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:05.320399 19446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e43bec2c4274497ea73872d0db233eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.323822 19442 tablet_service.cc:1511] Processing CreateTablet for tablet a1710b95678440b1bff8a92080d43272 (DEFAULT_TABLE table=default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.329619 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d114d5ba862044b4b88eee27395db7e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.330876 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb014699060e4a6caf4caaf33c31710a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.339462 19442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1710b95678440b1bff8a92080d43272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.356994 19890 consensus_queue.cc:260] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.375257 19896 tablet_bootstrap.cc:492] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:05.375850 19896 ts_tablet_manager.cc:1403] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.341s	user 0.030s	sys 0.011s
I20260928 01:56:05.393512 19890 ts_tablet_manager.cc:1434] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.103s	user 0.004s	sys 0.002s
I20260928 01:56:05.398488 19896 raft_consensus.cc:359] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.400734 19896 raft_consensus.cc:385] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:05.406157 19890 tablet_bootstrap.cc:492] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:05.409550 19896 raft_consensus.cc:740] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:05.435176 19590 tablet_service.cc:1511] Processing CreateTablet for tablet 9690a224bb004152ba65d525cc10bd9f (DEFAULT_TABLE table=default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.435441 19594 tablet_service.cc:1511] Processing CreateTablet for tablet d114d5ba862044b4b88eee27395db7e3 (DEFAULT_TABLE table=default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.436776 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9690a224bb004152ba65d525cc10bd9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.437084 19600 tablet_service.cc:1511] Processing CreateTablet for tablet e43bec2c4274497ea73872d0db233eac (DEFAULT_TABLE table=default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.437300 19596 tablet_service.cc:1511] Processing CreateTablet for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3 (DEFAULT_TABLE table=default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.438127 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e43bec2c4274497ea73872d0db233eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.439100 19598 tablet_service.cc:1511] Processing CreateTablet for tablet a1710b95678440b1bff8a92080d43272 (DEFAULT_TABLE table=default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.440140 19598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1710b95678440b1bff8a92080d43272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.441255 19592 tablet_service.cc:1511] Processing CreateTablet for tablet eb014699060e4a6caf4caaf33c31710a (DEFAULT_TABLE table=default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.442371 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb014699060e4a6caf4caaf33c31710a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.444506 19596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.445117 19594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d114d5ba862044b4b88eee27395db7e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.460245 19599 tablet_service.cc:1511] Processing CreateTablet for tablet e6206afe245740b1819069a48e8b548e (DEFAULT_TABLE table=default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.461465 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6206afe245740b1819069a48e8b548e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.463173 19591 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea6adefd15a4ea19011419949047e83 (DEFAULT_TABLE table=default.Table_a82317fb7790483884cbb5ebcf554128 [id=292d90fe578e4470bced0890a4e646ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.465060 19595 tablet_service.cc:1511] Processing CreateTablet for tablet 01cc307b127446958bd4199a1aa60adb (DEFAULT_TABLE table=default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.469431 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea6adefd15a4ea19011419949047e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.472659 19595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01cc307b127446958bd4199a1aa60adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.487989 19890 tablet_bootstrap.cc:654] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:05.543159 21465 raft_consensus.cc:493] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:05.548954 21465 raft_consensus.cc:515] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.550982 21465 leader_election.cc:290] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:05.560163 21552 raft_consensus.cc:493] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:05.560561 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:05.560705 21552 raft_consensus.cc:515] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.562768 21552 leader_election.cc:290] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:05.566231 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:05.572897 19409 leader_election.cc:343] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:05.573134 20029 tablet_bootstrap.cc:492] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:05.573652 20029 ts_tablet_manager.cc:1403] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.426s	user 0.020s	sys 0.030s
I20260928 01:56:05.545171 21598 ts_tablet_manager.cc:1929] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:05.586289 21598 log.cc:1199] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:05.587229 19896 consensus_queue.cc:260] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.588672 21598 ts_tablet_manager.cc:1950] T 58c61408724e4a70b39e5dbdab9a3e8a P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
W20260928 01:56:05.590857 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 324803us
I20260928 01:56:05.598690 20029 raft_consensus.cc:359] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.599516 20029 raft_consensus.cc:385] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:05.599812 20029 raft_consensus.cc:740] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:05.600726 20029 consensus_queue.cc:260] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.602881 20029 ts_tablet_manager.cc:1434] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260928 01:56:05.622287 20029 tablet_bootstrap.cc:492] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:05.625197 19896 ts_tablet_manager.cc:1434] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.249s	user 0.008s	sys 0.002s
I20260928 01:56:05.642856 21636 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:05.645290 19190 catalog_manager.cc:5838] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.646603 21636 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:05.650018 20029 tablet_bootstrap.cc:654] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:05.656273 21636 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:05.657560 19190 catalog_manager.cc:5838] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:05.662375 19190 catalog_manager.cc:5838] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.663666 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:05.665102 19190 catalog_manager.cc:5838] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:05.658241 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 344 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:05.670312 19441 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea6adefd15a4ea19011419949047e83 (DEFAULT_TABLE table=default.Table_a82317fb7790483884cbb5ebcf554128 [id=292d90fe578e4470bced0890a4e646ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.667974 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]). Expected version 1 got 0
I20260928 01:56:05.671416 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea6adefd15a4ea19011419949047e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.671403 19190 catalog_manager.cc:5838] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:05.672665 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:56:05.673264 19443 tablet_service.cc:1511] Processing CreateTablet for tablet 01cc307b127446958bd4199a1aa60adb (DEFAULT_TABLE table=default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.673406 19190 catalog_manager.cc:5838] T c9f3e966ab0d46d187fb9daa356b16fc P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.674655 19443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01cc307b127446958bd4199a1aa60adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.675311 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:05.676241 19190 catalog_manager.cc:5838] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.676972 19450 tablet_service.cc:1511] Processing CreateTablet for tablet a12bafcc09ef4342bff89b0475f721af (DEFAULT_TABLE table=default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.677119 19447 tablet_service.cc:1511] Processing CreateTablet for tablet 53c755f16ea1496eb7fa26fb12e01708 (DEFAULT_TABLE table=default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.678470 19445 tablet_service.cc:1511] Processing CreateTablet for tablet b4b520e89c364692af1aedde2a59c3da (DEFAULT_TABLE table=default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.678742 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 58c61408724e4a70b39e5dbdab9a3e8a (table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]) successfully deleted
I20260928 01:56:05.680811 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12bafcc09ef4342bff89b0475f721af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.685112 19447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c755f16ea1496eb7fa26fb12e01708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.678287 19190 catalog_manager.cc:5838] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:05.687783 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
I20260928 01:56:05.688328 19896 tablet_bootstrap.cc:492] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:05.688724 19190 catalog_manager.cc:5838] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.689838 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b520e89c364692af1aedde2a59c3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.693058 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:05.694864 19190 catalog_manager.cc:5838] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:05.697744 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:05.699399 19190 catalog_manager.cc:5838] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.702008 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
W20260928 01:56:05.703960 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 93690us
I20260928 01:56:05.703552 19190 catalog_manager.cc:5838] T 675e1e1f2630411f8b070d8ca99e8ffb P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.706884 21633 raft_consensus.cc:493] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:05.707374 21633 raft_consensus.cc:515] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.709729 21633 leader_election.cc:290] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:05.707832 19190 catalog_manager.cc:5838] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.711599 19190 catalog_manager.cc:5838] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 2, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:05.716044 19190 catalog_manager.cc:5838] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.719214 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:05.720484 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:05.721843 19190 catalog_manager.cc:5838] T c53d75604ee3405d83fe9ecaa824ea68 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } }
I20260928 01:56:05.724367 19190 catalog_manager.cc:5838] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 2, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 2 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } }
I20260928 01:56:05.727223 19190 catalog_manager.cc:5838] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:05.730528 19190 catalog_manager.cc:5838] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
W20260928 01:56:05.739302 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 147452us
I20260928 01:56:05.742010 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:05.754966 19190 catalog_manager.cc:5838] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.763948 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:05.766085 19190 catalog_manager.cc:5838] T fcf1b727e86a43b08bd464647fa529a3 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.770531 19190 catalog_manager.cc:5838] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.775635 19190 catalog_manager.cc:5838] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:05.779807 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
I20260928 01:56:05.780296 19896 tablet_bootstrap.cc:654] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:05.781773 19190 catalog_manager.cc:5838] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.782724 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:05.783336 19476 raft_consensus.cc:2468] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:05.760470 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:05.767421 21476 raft_consensus.cc:493] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:05.796020 19616 raft_consensus.cc:2468] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:05.796586 21476 raft_consensus.cc:515] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.807310 21476 leader_election.cc:290] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:05.824582 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 58262.3us
I20260928 01:56:05.835464 19613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:05.835299 19190 catalog_manager.cc:5838] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:05.836272 19613 raft_consensus.cc:2468] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:05.836638 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
I20260928 01:56:05.837337 19190 catalog_manager.cc:5838] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:05.843964 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:05.850371 21643 raft_consensus.cc:493] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:05.850920 21643 raft_consensus.cc:515] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.853040 21643 leader_election.cc:290] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:05.856252 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 44348.1us
I20260928 01:56:05.857633 19890 tablet_bootstrap.cc:492] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:05.858208 19890 ts_tablet_manager.cc:1403] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.463s	user 0.015s	sys 0.001s
I20260928 01:56:05.861032 19890 raft_consensus.cc:359] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.866758 19412 leader_election.cc:304] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:05.873198 19890 raft_consensus.cc:385] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:05.874095 19890 raft_consensus.cc:740] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:05.877110 19890 consensus_queue.cc:260] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:05.868736 19553 leader_election.cc:343] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:05.878051 20029 tablet_bootstrap.cc:492] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:05.878499 20029 ts_tablet_manager.cc:1403] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.258s	user 0.014s	sys 0.039s
I20260928 01:56:05.879848 19594 tablet_service.cc:1511] Processing CreateTablet for tablet a12bafcc09ef4342bff89b0475f721af (DEFAULT_TABLE table=default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.881192 19594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12bafcc09ef4342bff89b0475f721af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.883500 21632 consensus_queue.cc:1048] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:05.893944 19590 tablet_service.cc:1511] Processing CreateTablet for tablet b4b520e89c364692af1aedde2a59c3da (DEFAULT_TABLE table=default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.894109 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea6adefd15a4ea19011419949047e83 (DEFAULT_TABLE table=default.Table_a82317fb7790483884cbb5ebcf554128 [id=292d90fe578e4470bced0890a4e646ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.895184 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea6adefd15a4ea19011419949047e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.895795 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b520e89c364692af1aedde2a59c3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.902015 19598 tablet_service.cc:1511] Processing CreateTablet for tablet 53c755f16ea1496eb7fa26fb12e01708 (DEFAULT_TABLE table=default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.903753 19598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c755f16ea1496eb7fa26fb12e01708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.909660 19739 tablet_service.cc:1511] Processing CreateTablet for tablet a12bafcc09ef4342bff89b0475f721af (DEFAULT_TABLE table=default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.910837 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12bafcc09ef4342bff89b0475f721af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.917626 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:05.918581 19763 raft_consensus.cc:2393] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
W20260928 01:56:05.937186 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 70520.4us
I20260928 01:56:05.938993 19744 tablet_service.cc:1511] Processing CreateTablet for tablet b4b520e89c364692af1aedde2a59c3da (DEFAULT_TABLE table=default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.940160 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b520e89c364692af1aedde2a59c3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.943202 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:05.943924 19476 raft_consensus.cc:2468] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:05.944638 21428 raft_consensus.cc:493] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:05.945078 21428 raft_consensus.cc:515] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.947006 21428 leader_election.cc:290] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:05.947472 21428 raft_consensus.cc:493] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:05.950110 21428 raft_consensus.cc:515] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:05.950703 19890 ts_tablet_manager.cc:1434] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.000s
I20260928 01:56:05.951678 19890 tablet_bootstrap.cc:492] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:05.956349 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:05.959271 21428 leader_election.cc:290] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:05.966056 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 83872.1us
I20260928 01:56:05.952869 21432 raft_consensus.cc:2749] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:05.989715 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 53c755f16ea1496eb7fa26fb12e01708 (DEFAULT_TABLE table=default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:05.990885 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c755f16ea1496eb7fa26fb12e01708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:05.996743 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7979940c4a2e470bbecc40384edf38c9" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:05.997905 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:05.923746 20029 raft_consensus.cc:359] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:06.002298 20029 raft_consensus.cc:385] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:06.002599 20029 raft_consensus.cc:740] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:56:06.002696 19553 leader_election.cc:343] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:06.004464 19896 tablet_bootstrap.cc:492] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:06.005185 19896 ts_tablet_manager.cc:1403] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.317s	user 0.033s	sys 0.034s
W20260928 01:56:06.005097 19553 leader_election.cc:343] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:05.838726 19190 catalog_manager.cc:5838] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:06.010793 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:06.011930 19190 catalog_manager.cc:5838] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:06.013831 19190 catalog_manager.cc:5838] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:06.016389 19890 tablet_bootstrap.cc:654] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:06.016732 19896 raft_consensus.cc:359] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.017467 19896 raft_consensus.cc:385] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:06.017737 19896 raft_consensus.cc:740] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:06.020557 19896 consensus_queue.cc:260] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.026058 19896 ts_tablet_manager.cc:1434] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
W20260928 01:56:06.035003 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 76625.8us
I20260928 01:56:06.041581 19896 tablet_bootstrap.cc:492] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:06.041513 19412 leader_election.cc:304] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:06.042388 21551 raft_consensus.cc:2804] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:06.042905 21551 raft_consensus.cc:493] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:06.043382 21551 raft_consensus.cc:3060] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:06.051366 19896 tablet_bootstrap.cc:654] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:06.083105 21648 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:06.084426 21648 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:06.003297 20029 consensus_queue.cc:260] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:06.086659 20029 ts_tablet_manager.cc:1434] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.208s	user 0.007s	sys 0.000s
I20260928 01:56:06.087698 20029 tablet_bootstrap.cc:492] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:06.088784 21595 raft_consensus.cc:493] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:06.089473 21595 raft_consensus.cc:515] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:06.093160 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:06.097719 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:06.098254 21648 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:06.098793 19556 leader_election.cc:304] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:06.099584 21476 raft_consensus.cc:2804] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:06.100107 21476 raft_consensus.cc:493] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:06.100484 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:56:06.100693 21476 raft_consensus.cc:3060] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:06.105859 21595 leader_election.cc:290] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:06.108508 19556 leader_election.cc:343] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:06.109007 19556 leader_election.cc:304] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:06.112522 21428 raft_consensus.cc:2749] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:06.112550 19703 leader_election.cc:304] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:06.114276 21650 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:06.117933 21595 raft_consensus.cc:2804] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:06.118337 21595 raft_consensus.cc:493] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:06.118662 21595 raft_consensus.cc:3060] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:06.147013 21641 consensus_queue.cc:1048] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:06.161098 19814 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:06.165779 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:06.169795 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7979940c4a2e470bbecc40384edf38c9" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:56:06.173928 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 65460.6us
W20260928 01:56:06.175040 19409 consensus_peers.cc:597] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:06.188563 19190 catalog_manager.cc:5838] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:06.190524 19190 catalog_manager.cc:5838] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
W20260928 01:56:06.203142 19556 leader_election.cc:343] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:06.203572 19556 leader_election.cc:304] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:06.205374 21643 raft_consensus.cc:2749] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:06.205492 19556 leader_election.cc:343] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:06.205996 19556 leader_election.cc:304] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:06.211761 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:06.224484 19190 catalog_manager.cc:5838] T c8fd6b965d22477aaee9bafccb2069b1 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:06.230261 19890 tablet_bootstrap.cc:492] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:06.230748 19890 ts_tablet_manager.cc:1403] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.279s	user 0.004s	sys 0.007s
I20260928 01:56:06.233513 19890 raft_consensus.cc:359] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.180070 21551 raft_consensus.cc:515] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.238888 21476 raft_consensus.cc:515] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.254241 21612 consensus_queue.cc:1048] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:06.256575 21641 raft_consensus.cc:2749] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:06.257673 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 52202.6us
I20260928 01:56:06.258417 19896 tablet_bootstrap.cc:492] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:06.258862 19896 ts_tablet_manager.cc:1403] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.217s	user 0.029s	sys 0.030s
I20260928 01:56:06.266255 21633 raft_consensus.cc:493] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:06.266804 21633 raft_consensus.cc:515] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.268975 21633 leader_election.cc:290] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:06.273464 19896 raft_consensus.cc:359] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.274227 19896 raft_consensus.cc:385] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:06.274513 19896 raft_consensus.cc:740] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:06.275213 19896 consensus_queue.cc:260] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.277463 19896 ts_tablet_manager.cc:1434] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260928 01:56:06.282656 20029 tablet_bootstrap.cc:654] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:06.284909 19190 catalog_manager.cc:5838] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:06.287346 21551 leader_election.cc:290] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:06.287536 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:06.288331 21595 raft_consensus.cc:515] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.291069 21595 leader_election.cc:290] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:06.294051 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:06.294131 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:06.294852 19765 raft_consensus.cc:3060] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:06.302368 19765 raft_consensus.cc:2468] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:06.309286 19757 raft_consensus.cc:2393] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
W20260928 01:56:06.323959 20456 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.669s (SENT) [suppressed 4 similar messages]
I20260928 01:56:06.328896 21476 leader_election.cc:290] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:06.234189 19890 raft_consensus.cc:385] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:06.329794 19890 raft_consensus.cc:740] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:06.330461 19890 consensus_queue.cc:260] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.333931 19896 tablet_bootstrap.cc:492] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:06.333156 21612 consensus_queue.cc:1048] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:06.339699 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:06.339872 19613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:06.340358 19619 raft_consensus.cc:3060] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:06.340730 19613 raft_consensus.cc:2393] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:06.347422 19409 leader_election.cc:304] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:06.348454 21551 raft_consensus.cc:2804] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:06.349143 19896 tablet_bootstrap.cc:654] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:06.349604 21551 raft_consensus.cc:697] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:06.351269 19890 ts_tablet_manager.cc:1434] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.000s
I20260928 01:56:06.350991 21551 consensus_queue.cc:237] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.352411 19890 tablet_bootstrap.cc:492] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:06.352968 19190 catalog_manager.cc:5838] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:06.354354 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:06.370116 19896 tablet_bootstrap.cc:492] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:06.370572 19896 ts_tablet_manager.cc:1403] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.001s
I20260928 01:56:06.375573 19619 raft_consensus.cc:2468] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:06.385623 21647 consensus_queue.cc:1048] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:06.393744 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:06.395272 20029 tablet_bootstrap.cc:492] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:06.395902 20029 ts_tablet_manager.cc:1403] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.308s	user 0.011s	sys 0.000s
W20260928 01:56:06.396373 20456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 72440.2us
W20260928 01:56:06.400553 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 69454.9us
I20260928 01:56:06.402697 19896 raft_consensus.cc:359] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.411422 19896 raft_consensus.cc:385] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:06.411864 19896 raft_consensus.cc:740] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:06.415200 19896 consensus_queue.cc:260] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.418503 19896 ts_tablet_manager.cc:1434] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260928 01:56:06.419832 19896 tablet_bootstrap.cc:492] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:06.422309 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:06.422977 21428 consensus_queue.cc:1048] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:06.423560 19616 raft_consensus.cc:2393] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:06.426610 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:06.427377 19615 raft_consensus.cc:3060] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:06.435426 19890 tablet_bootstrap.cc:654] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:06.442238 19615 raft_consensus.cc:2468] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:06.466566 19476 raft_consensus.cc:2468] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:06.466811 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:06.473788 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:06.474437 19475 raft_consensus.cc:3060] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:06.356242 19190 catalog_manager.cc:5838] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:06.477029 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
I20260928 01:56:06.478052 19190 catalog_manager.cc:5838] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:06.479516 19190 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
I20260928 01:56:06.459095 20029 raft_consensus.cc:359] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:06.488529 20029 raft_consensus.cc:385] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:06.488898 19896 tablet_bootstrap.cc:654] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:06.491528 20029 raft_consensus.cc:740] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:06.507961 19890 tablet_bootstrap.cc:492] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:06.508477 19890 ts_tablet_manager.cc:1403] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.156s	user 0.006s	sys 0.008s
I20260928 01:56:06.500276 20029 consensus_queue.cc:260] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:06.511466 19890 raft_consensus.cc:359] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.519181 19475 raft_consensus.cc:2468] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:06.494848 19704 leader_election.cc:304] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:06.523595 21661 raft_consensus.cc:3060] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:06.512127 19890 raft_consensus.cc:385] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:06.526994 19890 raft_consensus.cc:740] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:06.527714 19890 consensus_queue.cc:260] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.532330 21661 raft_consensus.cc:2749] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:06.537055 19890 ts_tablet_manager.cc:1434] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260928 01:56:06.538918 19890 tablet_bootstrap.cc:492] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:06.541745 19703 leader_election.cc:304] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:06.552814 19890 tablet_bootstrap.cc:654] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:06.559544 20029 ts_tablet_manager.cc:1434] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.163s	user 0.010s	sys 0.000s
I20260928 01:56:06.560815 20029 tablet_bootstrap.cc:492] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:06.526473 19896 tablet_bootstrap.cc:492] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:06.572089 19522 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:06.594331 19896 ts_tablet_manager.cc:1403] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.175s	user 0.011s	sys 0.000s
I20260928 01:56:06.596921 19896 raft_consensus.cc:359] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.597608 19896 raft_consensus.cc:385] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:06.597863 19896 raft_consensus.cc:740] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:06.598754 19896 consensus_queue.cc:260] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.601364 19896 ts_tablet_manager.cc:1434] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260928 01:56:06.602357 19896 tablet_bootstrap.cc:492] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:06.610509 21633 raft_consensus.cc:2749] T 15f48cf74a1b4600b5140bf9cc8446e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:06.612686 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 71034.5us
I20260928 01:56:06.621062 19896 tablet_bootstrap.cc:654] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:56:06.622601 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 81695.4us
I20260928 01:56:06.632547 19896 tablet_bootstrap.cc:492] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:06.621121 19703 leader_election.cc:304] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:06.632989 19896 ts_tablet_manager.cc:1403] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.002s
I20260928 01:56:06.635380 21655 raft_consensus.cc:2804] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:06.635871 21655 raft_consensus.cc:697] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:06.636446 19896 raft_consensus.cc:359] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.637216 19896 raft_consensus.cc:385] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:06.636718 21655 consensus_queue.cc:237] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.637462 19896 raft_consensus.cc:740] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:06.638224 19896 consensus_queue.cc:260] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.643551 20029 tablet_bootstrap.cc:654] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:06.689035 19896 ts_tablet_manager.cc:1434] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.056s	user 0.017s	sys 0.032s
W20260928 01:56:06.691428 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 50386.1us
W20260928 01:56:06.691924 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 56787.4us
I20260928 01:56:06.725481 19896 tablet_bootstrap.cc:492] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:06.731101 19896 tablet_bootstrap.cc:654] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:06.773226 19896 tablet_bootstrap.cc:492] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:06.773728 19896 ts_tablet_manager.cc:1403] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.004s
I20260928 01:56:06.791633 19896 raft_consensus.cc:359] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.792419 19896 raft_consensus.cc:385] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:06.792709 19896 raft_consensus.cc:740] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:06.800813 19896 consensus_queue.cc:260] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.801517 19765 raft_consensus.cc:3060] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:06.812362 19896 ts_tablet_manager.cc:1434] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.003s
I20260928 01:56:06.813741 19896 tablet_bootstrap.cc:492] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:06.814021 20029 tablet_bootstrap.cc:492] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:06.814502 20029 ts_tablet_manager.cc:1403] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.254s	user 0.015s	sys 0.000s
I20260928 01:56:06.830103 21551 raft_consensus.cc:493] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:06.830741 21551 raft_consensus.cc:515] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.836237 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:06.837863 19409 leader_election.cc:343] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:06.843869 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 97195.6us
I20260928 01:56:06.858114 21645 raft_consensus.cc:493] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:06.858891 21635 raft_consensus.cc:493] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:06.858717 21645 raft_consensus.cc:515] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.859395 21635 raft_consensus.cc:515] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.861990 21635 leader_election.cc:290] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:06.864771 21645 leader_election.cc:290] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:06.873910 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:06.875262 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7979940c4a2e470bbecc40384edf38c9" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:06.888695 20029 raft_consensus.cc:359] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.889472 20029 raft_consensus.cc:385] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:06.889760 20029 raft_consensus.cc:740] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:06.890550 20029 consensus_queue.cc:260] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:06.900421 19409 leader_election.cc:343] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:06.901497 19409 leader_election.cc:343] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:06.909735 21551 leader_election.cc:290] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:06.925231 19896 tablet_bootstrap.cc:654] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:06.964654 21645 raft_consensus.cc:493] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:06.965229 21645 raft_consensus.cc:515] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:06.967624 21645 leader_election.cc:290] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:06.971418 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:06.971998 19764 raft_consensus.cc:2468] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:06.973726 19409 leader_election.cc:304] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:06.974699 21647 raft_consensus.cc:2804] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:06.975119 21647 raft_consensus.cc:493] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:06.975498 21647 raft_consensus.cc:3060] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:06.976257 20029 ts_tablet_manager.cc:1434] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.161s	user 0.008s	sys 0.000s
I20260928 01:56:06.977438 20029 tablet_bootstrap.cc:492] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:06.996553 19890 tablet_bootstrap.cc:492] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:06.997238 19890 ts_tablet_manager.cc:1403] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.459s	user 0.011s	sys 0.000s
I20260928 01:56:07.001649 19896 tablet_bootstrap.cc:492] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:07.002159 19896 ts_tablet_manager.cc:1403] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.189s	user 0.013s	sys 0.002s
I20260928 01:56:07.004674 19896 raft_consensus.cc:359] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:07.005458 19896 raft_consensus.cc:385] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.005733 19896 raft_consensus.cc:740] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.006856 19896 consensus_queue.cc:260] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:07.010282 19896 ts_tablet_manager.cc:1434] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260928 01:56:07.011269 19896 tablet_bootstrap.cc:492] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:07.010855 21647 raft_consensus.cc:515] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.028494 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:07.029125 19764 raft_consensus.cc:3060] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:07.034099 19890 raft_consensus.cc:359] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.035248 19890 raft_consensus.cc:385] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.035589 19890 raft_consensus.cc:740] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.036317 19890 consensus_queue.cc:260] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.038122 19890 ts_tablet_manager.cc:1434] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260928 01:56:07.039516 19764 raft_consensus.cc:2468] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:07.043187 19409 leader_election.cc:304] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:07.044266 21645 raft_consensus.cc:2804] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:07.044790 21645 raft_consensus.cc:697] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:07.045822 21645 consensus_queue.cc:237] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.046985 19896 tablet_bootstrap.cc:654] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.062119 19890 tablet_bootstrap.cc:492] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:07.063045 19896 tablet_bootstrap.cc:492] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:07.063473 19896 ts_tablet_manager.cc:1403] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.003s
I20260928 01:56:07.064010 21647 leader_election.cc:290] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:07.067207 20456 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.669s (SENT)
I20260928 01:56:07.067664 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:07.071420 21680 raft_consensus.cc:493] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:07.072038 21680 raft_consensus.cc:515] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.074998 21680 leader_election.cc:290] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:07.075171 19896 raft_consensus.cc:359] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.075840 19896 raft_consensus.cc:385] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.076110 19896 raft_consensus.cc:740] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.076797 19896 consensus_queue.cc:260] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.078842 19896 ts_tablet_manager.cc:1434] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260928 01:56:07.079754 19896 tablet_bootstrap.cc:492] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:07.102025 19896 tablet_bootstrap.cc:654] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:56:07.109802 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 48805.6us
I20260928 01:56:07.114669 21551 raft_consensus.cc:493] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.116775 21551 raft_consensus.cc:515] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.120913 21551 leader_election.cc:290] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:07.121667 21691 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:07.129905 19896 tablet_bootstrap.cc:492] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:07.144187 19896 ts_tablet_manager.cc:1403] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.003s
I20260928 01:56:07.146731 19896 raft_consensus.cc:359] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.147401 19896 raft_consensus.cc:385] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.147681 19896 raft_consensus.cc:740] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.143674 21645 raft_consensus.cc:493] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.148715 21645 raft_consensus.cc:515] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.151513 21645 leader_election.cc:290] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:07.154093 19896 consensus_queue.cc:260] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.161325 19896 ts_tablet_manager.cc:1434] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260928 01:56:07.171499 19896 tablet_bootstrap.cc:492] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:07.177148 19896 tablet_bootstrap.cc:654] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.210134 19896 tablet_bootstrap.cc:492] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:07.214588 19896 ts_tablet_manager.cc:1403] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.012s
I20260928 01:56:07.221462 19896 raft_consensus.cc:359] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.222131 19896 raft_consensus.cc:385] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.224385 19896 raft_consensus.cc:740] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.225172 19896 consensus_queue.cc:260] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.237551 19896 ts_tablet_manager.cc:1434] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.003s
I20260928 01:56:07.238720 19896 tablet_bootstrap.cc:492] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:56:07.244936 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 486494us
I20260928 01:56:07.245898 19556 leader_election.cc:304] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:07.264982 19896 tablet_bootstrap.cc:654] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.268324 21645 raft_consensus.cc:493] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.269034 21645 raft_consensus.cc:515] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.271405 21645 leader_election.cc:290] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:07.300379 20029 tablet_bootstrap.cc:654] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.308887 19191 catalog_manager.cc:5838] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } }
I20260928 01:56:07.311053 19191 catalog_manager.cc:5838] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 2, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 2 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:07.313486 19191 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]). Expected version 1 got 0
I20260928 01:56:07.316963 19191 catalog_manager.cc:5838] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:07.340574 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:07.343007 19191 catalog_manager.cc:5838] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:07.348758 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:07.370049 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:07.374629 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c61408724e4a70b39e5dbdab9a3e8a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:07.375258 19765 raft_consensus.cc:2468] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
W20260928 01:56:07.378440 19409 leader_election.cc:343] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:07.379629 19409 leader_election.cc:343] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:07.383253 19409 leader_election.cc:343] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:07.411144 19896 tablet_bootstrap.cc:492] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:07.411592 19896 ts_tablet_manager.cc:1403] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.173s	user 0.019s	sys 0.040s
I20260928 01:56:07.414608 19896 raft_consensus.cc:359] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.415359 19896 raft_consensus.cc:385] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:56:07.416311 19191 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 274) took 1898 ms (client timeout 1000 ms). Trace:
I20260928 01:56:07.419170 19896 raft_consensus.cc:740] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.421978 20029 tablet_bootstrap.cc:492] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:07.422433 20029 ts_tablet_manager.cc:1403] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.445s	user 0.010s	sys 0.000s
W20260928 01:56:07.417455 19191 rpcz_store.cc:269] 0928 01:56:05.517439 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:05.517575 (+   136us) service_pool.cc:224] Handling call
0928 01:56:07.416234 (+1898659us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:07.347173 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:07.347704 (+   531us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:07.347735 (+    31us) write_op.cc:435] Acquired schema lock
0928 01:56:07.347750 (+    15us) tablet.cc:662] Decoding operations
0928 01:56:07.348385 (+   635us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:07.348441 (+    56us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:07.348473 (+    32us) tablet.cc:685] Acquiring locks for 4 operations
0928 01:56:07.348871 (+   398us) tablet.cc:701] Row locks acquired
0928 01:56:07.348903 (+    32us) write_op.cc:260] PREPARE: finished
0928 01:56:07.349089 (+   186us) write_op.cc:270] Start()
0928 01:56:07.349202 (+   113us) write_op.cc:276] Timestamp: P: 1790560567349025 usec, L: 0
0928 01:56:07.349224 (+    22us) op_driver.cc:348] REPLICATION: starting
0928 01:56:07.349912 (+   688us) log.cc:844] Serialized 1662 byte log entry
0928 01:56:07.364872 (+ 14960us) op_driver.cc:464] REPLICATION: finished
0928 01:56:07.367750 (+  2878us) write_op.cc:301] APPLY: starting
0928 01:56:07.367808 (+    58us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:07.367955 (+   147us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:07.368058 (+   103us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:07.368481 (+   423us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:07.368630 (+   149us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0928 01:56:07.368682 (+    52us) write_op.cc:312] APPLY: finished
0928 01:56:07.368881 (+   199us) log.cc:844] Serialized 41 byte log entry
0928 01:56:07.369535 (+   654us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:07.369611 (+    76us) write_op.cc:454] Released schema lock
0928 01:56:07.369651 (+    40us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:07.369886 (+   235us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:07.369910 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":2707,"apply.run_cpu_time_us":1629,"apply.run_wall_time_us":2120,"num_ops":4,"prepare.queue_time_us":161,"prepare.run_cpu_time_us":3211,"prepare.run_wall_time_us":11502,"raft.queue_time_us":131,"raft.run_cpu_time_us":1002,"raft.run_wall_time_us":1013,"replication_time_us":15501}]]}
I20260928 01:56:07.428469 19890 tablet_bootstrap.cc:700] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0: Time spent opening tablet: real 0.197s	user 0.004s	sys 0.000s
I20260928 01:56:07.420583 19896 consensus_queue.cc:260] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.434396 19896 ts_tablet_manager.cc:1434] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.004s
I20260928 01:56:07.437672 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:07.438484 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:07.440594 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
I20260928 01:56:07.442350 19896 tablet_bootstrap.cc:492] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:07.448146 19896 tablet_bootstrap.cc:654] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.451686 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]). Expected version 1 got 0
I20260928 01:56:07.452569 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:56:07.453966 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:07.454836 21428 raft_consensus.cc:2804] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:07.456391 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:07.459434 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:07.462668 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:07.464726 19896 tablet_bootstrap.cc:492] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:07.465216 19896 ts_tablet_manager.cc:1403] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260928 01:56:07.465381 21645 raft_consensus.cc:493] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.465906 21645 raft_consensus.cc:515] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:07.468582 19896 raft_consensus.cc:359] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.470573 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:07.469324 21551 raft_consensus.cc:493] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.471089 19896 raft_consensus.cc:385] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.471367 19896 raft_consensus.cc:740] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.471279 21551 raft_consensus.cc:515] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.472072 19896 consensus_queue.cc:260] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.473673 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:07.473834 21551 leader_election.cc:290] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:07.474491 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:07.476032 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
I20260928 01:56:07.477033 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
I20260928 01:56:07.478386 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:07.478543 21428 raft_consensus.cc:697] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:07.480587 19193 catalog_manager.cc:5838] T 75303ee92aae436ea6c46747a23b69b6 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:07.479517 21428 consensus_queue.cc:237] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.484586 19896 ts_tablet_manager.cc:1434] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260928 01:56:07.485627 19896 tablet_bootstrap.cc:492] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:07.493325 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:07.495102 19896 tablet_bootstrap.cc:654] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.496106 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
W20260928 01:56:07.496095 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 250305us
I20260928 01:56:07.504233 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:07.505501 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
I20260928 01:56:07.507575 20029 raft_consensus.cc:359] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.508304 20029 raft_consensus.cc:385] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.508603 20029 raft_consensus.cc:740] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:56:07.512661 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 63179.6us
I20260928 01:56:07.521106 19896 tablet_bootstrap.cc:492] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:07.521628 19896 ts_tablet_manager.cc:1403] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.000s
I20260928 01:56:07.524180 19896 raft_consensus.cc:359] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:07.525128 19896 raft_consensus.cc:385] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.525301 19890 tablet_bootstrap.cc:654] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.525480 19896 raft_consensus.cc:740] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.529819 19896 consensus_queue.cc:260] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:07.530813 21679 raft_consensus.cc:493] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.531482 21679 raft_consensus.cc:515] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.534010 19896 ts_tablet_manager.cc:1434] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260928 01:56:07.535081 19896 tablet_bootstrap.cc:492] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:07.538616 21679 leader_election.cc:290] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:07.541090 19896 tablet_bootstrap.cc:654] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.541960 21645 leader_election.cc:290] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:07.558322 19896 tablet_bootstrap.cc:492] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:07.558871 19896 ts_tablet_manager.cc:1403] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.002s
I20260928 01:56:07.564640 19896 raft_consensus.cc:359] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.566216 19896 raft_consensus.cc:385] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.566905 19896 raft_consensus.cc:740] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.567487 21705 raft_consensus.cc:493] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.568742 21705 raft_consensus.cc:515] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.571745 19896 consensus_queue.cc:260] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.574426 21705 leader_election.cc:290] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:07.509383 20029 consensus_queue.cc:260] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.576246 19896 ts_tablet_manager.cc:1434] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.001s
I20260928 01:56:07.581137 19896 tablet_bootstrap.cc:492] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:07.586838 19896 tablet_bootstrap.cc:654] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.595875 20029 ts_tablet_manager.cc:1434] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.173s	user 0.007s	sys 0.000s
I20260928 01:56:07.600364 19896 tablet_bootstrap.cc:492] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:07.600891 19896 ts_tablet_manager.cc:1403] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.010s
I20260928 01:56:07.603426 19896 raft_consensus.cc:359] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.604308 19896 raft_consensus.cc:385] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.604636 19896 raft_consensus.cc:740] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.605458 19896 consensus_queue.cc:260] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.608194 19896 ts_tablet_manager.cc:1434] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260928 01:56:07.609246 19896 tablet_bootstrap.cc:492] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:07.617911 21633 raft_consensus.cc:493] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.618619 21633 raft_consensus.cc:515] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.621662 21633 leader_election.cc:290] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:07.624951 19553 leader_election.cc:304] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:07.634462 19890 tablet_bootstrap.cc:492] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:07.635088 19890 ts_tablet_manager.cc:1403] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.573s	user 0.012s	sys 0.000s
W20260928 01:56:07.638696 19103 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2156dae74ee748cd845b6dea1d3b8ea8 consensus state has no leader
I20260928 01:56:07.640524 21680 raft_consensus.cc:2804] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:07.641091 21680 raft_consensus.cc:493] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:07.641549 21680 raft_consensus.cc:3060] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:07.658480 21680 raft_consensus.cc:515] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:07.663906 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 48477.1us
I20260928 01:56:07.668351 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:07.671200 20029 tablet_bootstrap.cc:492] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:07.671808 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36076aa674b9401b9b76fbf066348d06" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:07.675740 21714 raft_consensus.cc:493] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.676498 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:07.676368 21714 raft_consensus.cc:515] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.680833 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:07.659607 21682 raft_consensus.cc:493] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.684834 21679 raft_consensus.cc:493] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:07.685201 21682 raft_consensus.cc:515] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.685408 21679 raft_consensus.cc:515] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.661320 19890 raft_consensus.cc:359] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:07.686456 19890 raft_consensus.cc:385] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.690239 21679 leader_election.cc:290] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:07.692133 21682 leader_election.cc:290] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:07.691994 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.693351 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.693985 19616 raft_consensus.cc:2468] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:07.701121 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.701908 19618 raft_consensus.cc:2468] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:07.703305 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.704257 19617 raft_consensus.cc:2468] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:07.704603 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7979940c4a2e470bbecc40384edf38c9" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.705363 19618 raft_consensus.cc:2468] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:07.707757 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.708547 19618 raft_consensus.cc:2468] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:07.686828 19890 raft_consensus.cc:740] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.711477 19890 consensus_queue.cc:260] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:07.714445 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:07.714486 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.715143 19618 raft_consensus.cc:3060] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:07.715301 19621 raft_consensus.cc:2468] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:07.717203 21714 leader_election.cc:290] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:07.723932 21680 leader_election.cc:290] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:07.727054 19890 ts_tablet_manager.cc:1434] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.000s
I20260928 01:56:07.736159 19890 tablet_bootstrap.cc:492] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:07.731187 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.736748 19616 raft_consensus.cc:2468] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:07.730249 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.737906 19619 raft_consensus.cc:2468] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:07.745635 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.746323 19616 raft_consensus.cc:2468] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:07.747960 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.748581 19617 raft_consensus.cc:2468] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:07.749918 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:07.750872 19471 raft_consensus.cc:2410] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260928 01:56:07.760988 19553 leader_election.cc:343] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:07.762949 19814 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:07.765466 19618 raft_consensus.cc:2468] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:07.773115 19890 tablet_bootstrap.cc:654] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.795707 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:07.719465 21645 raft_consensus.cc:493] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.806864 19896 tablet_bootstrap.cc:654] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.812031 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:07.812659 19475 raft_consensus.cc:2468] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:07.813248 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:07.813868 19476 raft_consensus.cc:2468] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:07.816686 19704 leader_election.cc:304] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:07.804356 21645 raft_consensus.cc:515] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.817767 21612 raft_consensus.cc:2804] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:07.817925 19704 leader_election.cc:304] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:07.818159 21612 raft_consensus.cc:493] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:07.818549 21612 raft_consensus.cc:3060] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:07.820977 21655 raft_consensus.cc:2749] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260928 01:56:07.806910 21702 log.cc:927] Time spent T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260928 01:56:07.841157 20029 tablet_bootstrap.cc:654] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.841755 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c61408724e4a70b39e5dbdab9a3e8a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:07.842363 19756 raft_consensus.cc:3060] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:07.849465 19756 raft_consensus.cc:2468] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:07.857920 21633 consensus_queue.cc:1048] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:07.876467 21680 raft_consensus.cc:493] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.877322 21680 raft_consensus.cc:515] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.879683 21680 leader_election.cc:290] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:07.885529 19890 tablet_bootstrap.cc:492] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:07.886154 19890 ts_tablet_manager.cc:1403] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.150s	user 0.008s	sys 0.003s
I20260928 01:56:07.888805 19890 raft_consensus.cc:359] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.889559 19890 raft_consensus.cc:385] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.889883 19890 raft_consensus.cc:740] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.891213 21645 leader_election.cc:290] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:07.891842 19896 tablet_bootstrap.cc:492] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:07.891947 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:07.892315 19896 ts_tablet_manager.cc:1403] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.283s	user 0.013s	sys 0.003s
I20260928 01:56:07.892565 19470 raft_consensus.cc:2468] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:07.904289 19896 raft_consensus.cc:359] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:07.905378 19896 raft_consensus.cc:385] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.905643 19896 raft_consensus.cc:740] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.906394 19896 consensus_queue.cc:260] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:07.908075 21645 raft_consensus.cc:493] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.908545 21645 raft_consensus.cc:515] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.908710 21704 consensus_queue.cc:1048] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:07.910795 21645 leader_election.cc:290] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:07.911993 19409 leader_election.cc:343] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:07.912559 19896 ts_tablet_manager.cc:1434] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260928 01:56:07.913494 19896 tablet_bootstrap.cc:492] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:56:07.913764 19409 leader_election.cc:343] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:07.914438 19409 leader_election.cc:343] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:07.925601 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897503329be649e38473561cea1fdaf1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:07.928006 21612 raft_consensus.cc:515] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.936408 21704 raft_consensus.cc:493] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.936993 21704 raft_consensus.cc:515] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:07.939112 21704 leader_election.cc:290] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:07.940956 21645 raft_consensus.cc:493] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:07.941046 19890 consensus_queue.cc:260] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.941459 21645 raft_consensus.cc:515] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.942775 19890 ts_tablet_manager.cc:1434] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.000s
I20260928 01:56:07.943593 21645 leader_election.cc:290] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:07.943840 19890 tablet_bootstrap.cc:492] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:07.944671 19412 leader_election.cc:304] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:07.946533 21716 raft_consensus.cc:2804] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:07.946893 21716 raft_consensus.cc:493] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:07.947218 21716 raft_consensus.cc:3060] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:07.951162 20029 tablet_bootstrap.cc:492] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:07.951612 20029 ts_tablet_manager.cc:1403] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.281s	user 0.010s	sys 0.000s
I20260928 01:56:07.955382 21716 raft_consensus.cc:515] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.957206 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36076aa674b9401b9b76fbf066348d06" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.957508 21716 leader_election.cc:290] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:07.957830 19617 raft_consensus.cc:2468] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:07.961081 19412 leader_election.cc:304] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:07.964278 19553 leader_election.cc:343] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: 57a81b9455a340728fea713318e1e77a
W20260928 01:56:07.965451 19553 leader_election.cc:343] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:07.967157 19896 tablet_bootstrap.cc:654] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:07.969399 20029 raft_consensus.cc:359] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.970065 20029 raft_consensus.cc:385] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:07.970100 21704 raft_consensus.cc:2804] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:07.970336 20029 raft_consensus.cc:740] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:07.970489 21704 raft_consensus.cc:493] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:07.970788 21704 raft_consensus.cc:3060] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:07.970985 20029 consensus_queue.cc:260] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:07.976862 19412 leader_election.cc:304] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:07.978143 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:07.983938 21612 leader_election.cc:290] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:07.992450 21645 raft_consensus.cc:2804] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:07.992954 21645 raft_consensus.cc:493] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:07.993387 21645 raft_consensus.cc:3060] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.000239 20029 ts_tablet_manager.cc:1434] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260928 01:56:08.001783 19412 leader_election.cc:304] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:08.002630 21647 raft_consensus.cc:2804] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:08.002988 21647 raft_consensus.cc:493] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:08.003297 21647 raft_consensus.cc:3060] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.003993 21551 raft_consensus.cc:493] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:08.004452 21551 raft_consensus.cc:515] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:08.006290 21551 leader_election.cc:290] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:08.007992 20029 tablet_bootstrap.cc:492] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:08.008102 19522 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:08.014732 20029 tablet_bootstrap.cc:654] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:08.018620 21647 raft_consensus.cc:515] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:08.025030 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 52174.8us
I20260928 01:56:08.030158 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:08.030681 19617 raft_consensus.cc:3060] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.030725 19896 tablet_bootstrap.cc:492] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:08.031178 19896 ts_tablet_manager.cc:1403] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.118s	user 0.005s	sys 0.005s
I20260928 01:56:08.033695 19896 raft_consensus.cc:359] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.034582 19896 raft_consensus.cc:385] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:08.034322 21704 raft_consensus.cc:515] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.034857 19896 raft_consensus.cc:740] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
W20260928 01:56:08.035270 19411 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 47659.5us
I20260928 01:56:08.037349 21647 leader_election.cc:290] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:08.035449 19896 consensus_queue.cc:260] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.046509 19896 ts_tablet_manager.cc:1434] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260928 01:56:08.046401 19412 leader_election.cc:304] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:08.047309 21551 raft_consensus.cc:2804] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:08.047727 21551 raft_consensus.cc:493] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:08.048142 21551 raft_consensus.cc:3060] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.047490 19896 tablet_bootstrap.cc:492] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:08.061307 21645 raft_consensus.cc:515] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.063585 21645 leader_election.cc:290] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:08.070305 19553 leader_election.cc:304] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:08.071794 21679 raft_consensus.cc:2804] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:08.082911 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:08.086650 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
I20260928 01:56:08.088938 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:08.064747 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:08.090221 19473 raft_consensus.cc:2393] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:08.072805 19412 leader_election.cc:304] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:08.091810 21647 raft_consensus.cc:2804] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:08.091912 19412 leader_election.cc:304] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:08.092263 21647 raft_consensus.cc:493] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:08.072273 21679 raft_consensus.cc:697] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:08.092922 21647 raft_consensus.cc:3060] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.093186 21716 raft_consensus.cc:2804] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:08.093532 21716 raft_consensus.cc:493] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:08.093860 21716 raft_consensus.cc:3060] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.076540 21704 leader_election.cc:290] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:08.096733 19412 leader_election.cc:304] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:08.099129 21717 raft_consensus.cc:2804] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:08.099488 21717 raft_consensus.cc:493] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:08.099817 21717 raft_consensus.cc:3060] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.105279 21679 consensus_queue.cc:237] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.106891 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522245da435b40ae84ae6dc5d19a2e95" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:08.107081 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:08.108253 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:08.108343 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:08.108034 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:08.111855 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7441c2d1a7fa4dc8a89c6717a80d3efb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:08.112277 21716 raft_consensus.cc:515] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:08.125046 19617 raft_consensus.cc:2468] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:08.129099 19704 leader_election.cc:304] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:08.133273 21612 raft_consensus.cc:2804] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:08.134311 21716 leader_election.cc:290] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:08.135001 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7979940c4a2e470bbecc40384edf38c9" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:08.133867 21612 raft_consensus.cc:697] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:08.136075 21612 consensus_queue.cc:237] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.139590 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:08.114281 19896 tablet_bootstrap.cc:654] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:08.114108 21717 raft_consensus.cc:515] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:08.152225 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 157577us
I20260928 01:56:08.131228 20029 tablet_bootstrap.cc:492] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:08.156759 20029 ts_tablet_manager.cc:1403] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.149s	user 0.014s	sys 0.004s
I20260928 01:56:08.159648 21595 consensus_queue.cc:1048] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:56:08.174714 19556 leader_election.cc:343] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:08.159356 20029 raft_consensus.cc:359] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.179816 20029 raft_consensus.cc:385] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:08.180136 20029 raft_consensus.cc:740] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:08.186424 20029 consensus_queue.cc:260] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.055747 21551 raft_consensus.cc:515] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.151440 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897503329be649e38473561cea1fdaf1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:08.189633 19473 raft_consensus.cc:2468] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:08.194226 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]). Expected version 1 got 0
I20260928 01:56:08.196229 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:08.200069 21551 leader_election.cc:290] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:08.204226 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 131880us
I20260928 01:56:08.209533 21717 leader_election.cc:290] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:08.213433 21647 raft_consensus.cc:515] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.215919 19556 leader_election.cc:304] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:08.216867 21647 leader_election.cc:290] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:08.217900 19553 leader_election.cc:343] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.219439 21612 raft_consensus.cc:493] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:08.219970 21612 raft_consensus.cc:515] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:08.225281 19409 leader_election.cc:343] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.225921 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:08.226385 19409 leader_election.cc:343] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.226863 19617 raft_consensus.cc:2468] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
W20260928 01:56:08.227046 19409 leader_election.cc:343] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.207967 20029 ts_tablet_manager.cc:1434] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.003s
I20260928 01:56:08.231663 19704 leader_election.cc:304] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:08.233301 21633 raft_consensus.cc:2804] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:08.233860 21633 raft_consensus.cc:493] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:08.236840 21633 raft_consensus.cc:3060] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.242132 21612 leader_election.cc:290] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:08.242298 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:08.243041 19470 raft_consensus.cc:2393] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
W20260928 01:56:08.248325 19409 leader_election.cc:343] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:08.249029 19409 leader_election.cc:343] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.231841 20029 tablet_bootstrap.cc:492] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:08.267233 21679 raft_consensus.cc:2804] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:08.271276 19896 tablet_bootstrap.cc:492] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:08.271760 19896 ts_tablet_manager.cc:1403] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.224s	user 0.007s	sys 0.009s
W20260928 01:56:08.249604 19409 leader_election.cc:343] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.285125 21679 raft_consensus.cc:493] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:08.292142 21679 raft_consensus.cc:3060] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.293592 21735 tablet.cc:1751] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
W20260928 01:56:08.300593 19409 leader_election.cc:343] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:08.301656 19409 leader_election.cc:343] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.306034 21647 consensus_queue.cc:1048] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:08.313270 19896 raft_consensus.cc:359] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:08.302155 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 86309.9us
I20260928 01:56:08.317780 19896 raft_consensus.cc:385] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:08.320624 19896 raft_consensus.cc:740] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:08.320746 19556 leader_election.cc:304] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:08.311980 19409 leader_election.cc:343] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.322067 21643 raft_consensus.cc:2804] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:08.322631 21643 raft_consensus.cc:493] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:08.323194 21643 raft_consensus.cc:3060] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.325083 20029 tablet_bootstrap.cc:654] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:08.326144 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:08.327407 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:08.331321 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:08.337564 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:08.339888 19896 consensus_queue.cc:260] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:08.352989 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:08.353967 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:56:08.354168 19896 ts_tablet_manager.cc:1434] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.004s
I20260928 01:56:08.355149 19896 tablet_bootstrap.cc:492] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:08.355033 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:08.308152 21733 tablet.cc:1751] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
W20260928 01:56:08.382407 19409 leader_election.cc:343] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:08.383160 19409 leader_election.cc:343] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:08.376374 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 55712.3us
I20260928 01:56:08.346470 21633 raft_consensus.cc:515] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:08.391908 19556 leader_election.cc:343] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 57a81b9455a340728fea713318e1e77a
I20260928 01:56:08.392510 19556 leader_election.cc:304] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:08.394356 21727 raft_consensus.cc:2749] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:08.426043 21633 leader_election.cc:290] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:08.426563 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:08.427148 19617 raft_consensus.cc:3060] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.427277 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:08.428009 19475 raft_consensus.cc:2393] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:08.429687 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:08.435829 19617 raft_consensus.cc:2468] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:08.437153 19704 leader_election.cc:304] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:08.453397 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:08.456193 20029 tablet_bootstrap.cc:492] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:08.456645 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:08.456805 20029 ts_tablet_manager.cc:1403] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.225s	user 0.029s	sys 0.022s
I20260928 01:56:08.458107 19896 tablet_bootstrap.cc:654] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:08.458531 21633 raft_consensus.cc:2804] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:08.459084 21633 raft_consensus.cc:697] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
W20260928 01:56:08.459376 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 75569.3us
I20260928 01:56:08.459430 20029 raft_consensus.cc:359] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.460165 20029 raft_consensus.cc:385] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:56:08.460405 19409 leader_election.cc:343] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.460559 20029 raft_consensus.cc:740] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:08.461135 21633 consensus_queue.cc:237] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.462260 20029 consensus_queue.cc:260] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:08.464574 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 72709.2us
W20260928 01:56:08.465339 19556 leader_election.cc:343] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:08.466741 20029 ts_tablet_manager.cc:1434] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260928 01:56:08.468881 20029 tablet_bootstrap.cc:492] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:08.476969 19762 raft_consensus.cc:1275] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:08.478884 21677 consensus_queue.cc:1048] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:08.480154 20029 tablet_bootstrap.cc:654] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:08.501272 20029 tablet_bootstrap.cc:492] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:08.502723 20029 ts_tablet_manager.cc:1403] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.006s
I20260928 01:56:08.506975 20029 raft_consensus.cc:359] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.508924 20029 raft_consensus.cc:385] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:08.509307 20029 raft_consensus.cc:740] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:08.510447 20029 consensus_queue.cc:260] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.515619 20029 ts_tablet_manager.cc:1434] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260928 01:56:08.516922 20029 tablet_bootstrap.cc:492] T 897503329be649e38473561cea1fdaf1 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:56:08.521922 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 55758.7us
I20260928 01:56:08.531528 20029 tablet_bootstrap.cc:654] T 897503329be649e38473561cea1fdaf1 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:08.549271 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
I20260928 01:56:08.550194 20029 tablet_bootstrap.cc:492] T 897503329be649e38473561cea1fdaf1 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:08.550668 20029 ts_tablet_manager.cc:1403] T 897503329be649e38473561cea1fdaf1 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.001s
I20260928 01:56:08.564697 21643 raft_consensus.cc:515] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.570842 20029 raft_consensus.cc:359] T 897503329be649e38473561cea1fdaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.571537 20029 raft_consensus.cc:385] T 897503329be649e38473561cea1fdaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:08.571794 20029 raft_consensus.cc:740] T 897503329be649e38473561cea1fdaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:08.572461 20029 consensus_queue.cc:260] T 897503329be649e38473561cea1fdaf1 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.583033 19556 leader_election.cc:304] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:08.583994 21679 raft_consensus.cc:515] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.587113 19412 leader_election.cc:304] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:08.588421 19412 leader_election.cc:343] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.588802 19412 leader_election.cc:304] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:08.591099 21704 raft_consensus.cc:2804] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:08.591586 21704 raft_consensus.cc:493] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:08.592044 21704 raft_consensus.cc:3060] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.598847 21717 consensus_queue.cc:1048] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:08.600621 21717 raft_consensus.cc:2749] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:08.600821 21679 leader_election.cc:290] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:08.584594 21677 raft_consensus.cc:2804] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:08.601508 21677 raft_consensus.cc:493] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:08.602104 21677 raft_consensus.cc:3060] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.591778 21643 leader_election.cc:290] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:08.598279 21733 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:57616 (request call id 12) took 1057 ms. Trace:
I20260928 01:56:08.620985 19473 raft_consensus.cc:1275] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:08.605114 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:08.643442 20029 ts_tablet_manager.cc:1434] T 897503329be649e38473561cea1fdaf1 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.092s	user 0.010s	sys 0.000s
I20260928 01:56:08.644510 20029 tablet_bootstrap.cc:492] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:08.644364 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:56:08.645377 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 49682.8us
I20260928 01:56:08.616822 21733 rpcz_store.cc:276] 0928 01:56:07.540496 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:07.554301 (+ 13805us) service_pool.cc:224] Handling call
0928 01:56:08.598112 (+1043811us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:07.556052 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:07.556508 (+   456us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:07.556553 (+    45us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:07.556616 (+    63us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:07.556751 (+   135us) alter_schema_op.cc:128] START. Timestamp: 1790560567556672
0928 01:56:07.556785 (+    34us) op_driver.cc:348] REPLICATION: starting
0928 01:56:07.557363 (+   578us) log.cc:844] Serialized 173 byte log entry
0928 01:56:08.224800 (+667437us) op_driver.cc:464] REPLICATION: finished
0928 01:56:08.307497 (+ 82697us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:08.440505 (+133008us) log.cc:844] Serialized 5 byte log entry
0928 01:56:08.596589 (+156084us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:08.597743 (+  1154us) log.cc:844] Serialized 14 byte log entry
0928 01:56:08.597875 (+   132us) alter_schema_op.cc:73] Released schema lock
0928 01:56:08.597920 (+    45us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":77011,"prepare.queue_time_us":396,"prepare.run_cpu_time_us":7596,"prepare.run_wall_time_us":23999,"replication_time_us":667855,"thread_start_us":103636,"threads_started":2,"wal-append.queue_time_us":20919}]]}
I20260928 01:56:08.649088 21716 raft_consensus.cc:493] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:08.649590 21716 raft_consensus.cc:515] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.652478 21716 leader_election.cc:290] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:08.674507 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
I20260928 01:56:08.675827 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:08.677306 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:08.677896 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
W20260928 01:56:08.680649 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 102833us
I20260928 01:56:08.655186 21595 raft_consensus.cc:493] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:08.690956 21595 raft_consensus.cc:515] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.693397 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b795606604960bc7cafab4ff6f3d0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:08.695990 21595 leader_election.cc:290] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:08.659410 21679 raft_consensus.cc:493] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:08.702669 21679 raft_consensus.cc:515] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.701054 21704 raft_consensus.cc:515] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:08.664573 19553 leader_election.cc:343] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.669778 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7441c2d1a7fa4dc8a89c6717a80d3efb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:08.707587 19617 raft_consensus.cc:2468] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:08.672617 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522245da435b40ae84ae6dc5d19a2e95" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:08.709556 19553 leader_election.cc:343] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:08.712169 19409 leader_election.cc:343] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.714488 21679 leader_election.cc:290] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:08.659253 21677 raft_consensus.cc:515] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.742717 21612 raft_consensus.cc:493] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:08.723618 19890 tablet_bootstrap.cc:654] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:08.747146 21677 leader_election.cc:290] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:08.753566 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897503329be649e38473561cea1fdaf1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:08.754487 19763 raft_consensus.cc:3060] T 897503329be649e38473561cea1fdaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.743448 21612 raft_consensus.cc:515] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.757336 21704 leader_election.cc:290] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:08.759431 21612 leader_election.cc:290] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:08.760609 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7441c2d1a7fa4dc8a89c6717a80d3efb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:08.761471 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36076aa674b9401b9b76fbf066348d06" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:08.762210 19475 raft_consensus.cc:2393] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:08.765750 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7979940c4a2e470bbecc40384edf38c9" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:08.766889 19471 raft_consensus.cc:2393] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:08.770219 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:08.763368 20029 tablet_bootstrap.cc:654] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:08.772727 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:08.774077 19616 raft_consensus.cc:2393] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:08.775877 19896 tablet_bootstrap.cc:492] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:08.776482 19896 ts_tablet_manager.cc:1403] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.422s	user 0.010s	sys 0.002s
I20260928 01:56:08.778726 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36076aa674b9401b9b76fbf066348d06" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:08.779316 19615 raft_consensus.cc:2468] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:08.780305 19896 raft_consensus.cc:359] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.781001 19896 raft_consensus.cc:385] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:08.781282 19896 raft_consensus.cc:740] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
W20260928 01:56:08.781438 19553 leader_election.cc:343] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.783309 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
W20260928 01:56:08.784346 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 71394.5us
I20260928 01:56:08.786598 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:08.788700 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7979940c4a2e470bbecc40384edf38c9" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:08.790163 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7979940c4a2e470bbecc40384edf38c9" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:08.790529 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:08.789816 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:08.791481 19616 raft_consensus.cc:2393] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:08.791589 19617 raft_consensus.cc:3060] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.798723 21750 tablet.cc:1751] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:08.789544 19615 raft_consensus.cc:2468] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:08.802078 19617 raft_consensus.cc:2468] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:08.813144 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
I20260928 01:56:08.818652 19890 tablet_bootstrap.cc:492] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:08.819243 19890 ts_tablet_manager.cc:1403] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.876s	user 0.012s	sys 0.008s
I20260928 01:56:08.820518 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
W20260928 01:56:08.821961 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 47654.2us
I20260928 01:56:08.828434 21645 raft_consensus.cc:493] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:08.829090 19896 consensus_queue.cc:260] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.829352 21645 raft_consensus.cc:515] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:08.831346 19896 ts_tablet_manager.cc:1434] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260928 01:56:08.832397 19896 tablet_bootstrap.cc:492] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:08.842710 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:08.843459 19621 raft_consensus.cc:3060] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.856766 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36076aa674b9401b9b76fbf066348d06" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:08.857597 19759 raft_consensus.cc:3060] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.858518 19763 raft_consensus.cc:2468] T 897503329be649e38473561cea1fdaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:08.859495 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:08.865162 21645 leader_election.cc:290] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:08.871492 19409 leader_election.cc:343] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:08.878350 19756 raft_consensus.cc:1275] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:08.879571 19553 leader_election.cc:304] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:08.880623 21682 raft_consensus.cc:2804] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:08.881681 21682 raft_consensus.cc:697] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:08.883001 21682 consensus_queue.cc:237] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.890239 21677 consensus_queue.cc:1048] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:08.894860 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:08.895437 19615 raft_consensus.cc:3060] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.903640 19615 raft_consensus.cc:2468] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:08.907261 19890 raft_consensus.cc:359] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:08.911311 19191 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:08.914333 19191 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]). Expected version 1 got 0
I20260928 01:56:08.916098 19191 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:08.943013 19896 tablet_bootstrap.cc:654] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:08.956830 19890 raft_consensus.cc:385] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:08.957270 19890 raft_consensus.cc:740] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:08.919153 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:08.958039 19617 raft_consensus.cc:2393] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:08.919811 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:08.930838 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36076aa674b9401b9b76fbf066348d06" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:08.959412 19614 raft_consensus.cc:3060] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:08.931813 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b795606604960bc7cafab4ff6f3d0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:08.912843 19621 raft_consensus.cc:2468] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
W20260928 01:56:08.968518 21757 log.cc:927] Time spent T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260928 01:56:08.969218 19615 raft_consensus.cc:2393] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:08.976506 19814 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:08.985378 19759 raft_consensus.cc:2468] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:08.968132 19614 raft_consensus.cc:2468] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:08.992925 19409 leader_election.cc:304] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:56:08.993299 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 152312us
I20260928 01:56:08.994093 19704 leader_election.cc:304] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:09.000442 19890 consensus_queue.cc:260] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.005940 21716 raft_consensus.cc:2804] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:09.007575 21716 raft_consensus.cc:697] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:09.007706 21747 raft_consensus.cc:2764] T 36076aa674b9401b9b76fbf066348d06 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 01:56:09.008582 21716 consensus_queue.cc:237] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.016876 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:09.027081 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:09.027899 19471 raft_consensus.cc:2393] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:09.028141 19890 ts_tablet_manager.cc:1434] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.206s	user 0.002s	sys 0.005s
I20260928 01:56:09.029456 19890 tablet_bootstrap.cc:492] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:09.030550 19704 leader_election.cc:304] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:09.031877 21747 raft_consensus.cc:2804] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:09.032292 21747 raft_consensus.cc:493] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:09.032618 21747 raft_consensus.cc:3060] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:09.034174 20029 tablet_bootstrap.cc:492] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:09.034173 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:09.034667 20029 ts_tablet_manager.cc:1403] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.390s	user 0.007s	sys 0.014s
I20260928 01:56:09.034932 19473 raft_consensus.cc:2393] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
W20260928 01:56:09.061094 19191 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 2018f8b52f974554924f9ecfbd5a0f51 consensus state has no leader
I20260928 01:56:09.043700 21747 raft_consensus.cc:515] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.067514 21747 leader_election.cc:290] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:09.078225 19191 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 11a7c70dba4e4b3b97104b5d65704b9d consensus state has no leader
W20260928 01:56:09.082631 19191 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 275) took 1415 ms (client timeout 1000 ms). Trace:
W20260928 01:56:09.100193 19179 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2018f8b52f974554924f9ecfbd5a0f51 consensus state has no leader
W20260928 01:56:09.101874 19191 rpcz_store.cc:269] 0928 01:56:07.666928 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:07.667065 (+   137us) service_pool.cc:224] Handling call
0928 01:56:09.082520 (+1415455us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":17}
I20260928 01:56:09.107019 19890 tablet_bootstrap.cc:654] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:09.142133 19896 tablet_bootstrap.cc:492] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:09.142617 19896 ts_tablet_manager.cc:1403] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.310s	user 0.010s	sys 0.005s
I20260928 01:56:09.143209 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
I20260928 01:56:09.144263 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:09.145795 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:09.162590 19896 raft_consensus.cc:359] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:09.163329 19896 raft_consensus.cc:385] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:09.163627 19896 raft_consensus.cc:740] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:09.164733 19896 consensus_queue.cc:260] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:09.167560 19896 ts_tablet_manager.cc:1434] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260928 01:56:09.168538 19896 tablet_bootstrap.cc:492] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:56:09.171614 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 50586.6us
I20260928 01:56:09.172498 19412 leader_election.cc:304] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:09.173362 21647 raft_consensus.cc:2804] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:09.173735 21647 raft_consensus.cc:493] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:09.174054 21647 raft_consensus.cc:3060] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:09.180729 21762 log.cc:927] Time spent T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260928 01:56:09.181783 21647 raft_consensus.cc:515] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:09.188884 19412 leader_election.cc:343] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:09.189442 19412 leader_election.cc:304] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:09.190227 21704 raft_consensus.cc:2749] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:09.190577 19412 leader_election.cc:343] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:09.191098 19412 leader_election.cc:304] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:09.191833 21704 raft_consensus.cc:2749] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:09.192261 19412 leader_election.cc:304] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:09.193081 21704 raft_consensus.cc:2749] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 01:56:09.193397 19412 leader_election.cc:343] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:09.214967 19890 tablet_bootstrap.cc:492] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:09.215538 19890 ts_tablet_manager.cc:1403] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.186s	user 0.005s	sys 0.016s
I20260928 01:56:09.215438 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7979940c4a2e470bbecc40384edf38c9" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:09.216061 19615 raft_consensus.cc:3060] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:09.216653 21682 raft_consensus.cc:493] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:09.217085 21682 raft_consensus.cc:515] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.218991 21682 leader_election.cc:290] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:09.223095 19615 raft_consensus.cc:2468] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:09.225442 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]). Expected version 1 got 0
I20260928 01:56:09.227370 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:56:09.227174 19890 raft_consensus.cc:359] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:09.228014 19890 raft_consensus.cc:385] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:09.228365 19890 raft_consensus.cc:740] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:09.228389 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:09.229166 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:09.234138 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:09.234812 19412 leader_election.cc:304] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:09.236418 21766 raft_consensus.cc:2749] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:09.184001 21647 leader_election.cc:290] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:09.241604 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 48231.6us
I20260928 01:56:09.254614 19412 leader_election.cc:304] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:09.256050 19412 leader_election.cc:304] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:09.256721 21647 raft_consensus.cc:2749] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:56:09.260040 20029 raft_consensus.cc:359] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.261866 20029 raft_consensus.cc:385] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:09.262246 20029 raft_consensus.cc:740] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:09.263105 20029 consensus_queue.cc:260] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.275259 21647 raft_consensus.cc:2749] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:56:09.275691 19412 leader_election.cc:304] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:09.276443 21647 raft_consensus.cc:2804] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:09.277004 21766 consensus_queue.cc:1048] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:09.277788 19412 leader_election.cc:304] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:09.279599 21645 raft_consensus.cc:2804] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:09.281066 21645 raft_consensus.cc:697] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:09.282001 21645 consensus_queue.cc:237] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.279390 21647 raft_consensus.cc:697] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:09.286345 21647 consensus_queue.cc:237] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.287600 19896 tablet_bootstrap.cc:654] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:09.293143 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:09.292865 19890 consensus_queue.cc:260] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:09.305958 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
I20260928 01:56:09.315210 19890 ts_tablet_manager.cc:1434] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.001s
I20260928 01:56:09.316427 19890 tablet_bootstrap.cc:492] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:09.319566 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:09.327781 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:09.328641 21595 raft_consensus.cc:493] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:56:09.329367 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 114241us
I20260928 01:56:09.329284 21595 raft_consensus.cc:515] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.333106 19412 leader_election.cc:304] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:09.334033 21647 raft_consensus.cc:2749] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 01:56:09.335217 19412 leader_election.cc:343] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:09.335700 19412 leader_election.cc:304] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:09.336664 21647 raft_consensus.cc:2749] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:09.337879 19412 leader_election.cc:304] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:09.338250 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
I20260928 01:56:09.339038 19192 catalog_manager.cc:5838] T 15f48cf74a1b4600b5140bf9cc8446e3 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:09.341006 21647 raft_consensus.cc:2804] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:09.341009 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:09.341624 21647 raft_consensus.cc:697] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:09.342710 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:09.343905 21647 consensus_queue.cc:237] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:09.347728 19412 leader_election.cc:304] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:09.348603 21645 raft_consensus.cc:2749] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:56:09.351433 19896 tablet_bootstrap.cc:492] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:09.351919 19896 ts_tablet_manager.cc:1403] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.184s	user 0.006s	sys 0.004s
I20260928 01:56:09.354444 19896 raft_consensus.cc:359] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:09.355122 19896 raft_consensus.cc:385] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:09.355377 19896 raft_consensus.cc:740] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:09.369661 21727 consensus_queue.cc:1048] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:09.374972 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:09.376089 19556 leader_election.cc:304] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:09.377211 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7441c2d1a7fa4dc8a89c6717a80d3efb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:09.377883 19473 raft_consensus.cc:2393] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
W20260928 01:56:09.383617 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 299160us
W20260928 01:56:09.387209 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 56977.4us
I20260928 01:56:09.395864 21595 leader_election.cc:290] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:09.398725 21727 raft_consensus.cc:2749] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:56:09.387862 19192 catalog_manager.cc:5838] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:09.401686 19556 leader_election.cc:304] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:09.402418 21727 raft_consensus.cc:2749] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:56:09.403564 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
I20260928 01:56:09.405333 21777 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:09.406464 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:09.407414 19890 tablet_bootstrap.cc:654] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:09.405846 21777 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:09.420929 19192 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
I20260928 01:56:09.430318 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:09.430413 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:09.434814 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:56:09.432000 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7441c2d1a7fa4dc8a89c6717a80d3efb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:09.437549 19763 raft_consensus.cc:3060] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:09.444986 21781 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:09.448715 21781 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:09.453613 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 348 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:09.455726 21777 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:09.456238 21781 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:09.459189 19763 raft_consensus.cc:2468] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:09.460634 21777 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260928 01:56:09.456997 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 55392us
I20260928 01:56:09.471457 19556 leader_election.cc:304] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:09.472147 21727 raft_consensus.cc:3060] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:09.479446 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:09.481305 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7979940c4a2e470bbecc40384edf38c9" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:09.482034 19474 raft_consensus.cc:2393] T 7979940c4a2e470bbecc40384edf38c9 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:09.482545 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897503329be649e38473561cea1fdaf1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:09.483069 19473 raft_consensus.cc:3060] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:09.494345 19473 raft_consensus.cc:2468] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
W20260928 01:56:09.508641 19104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 73904.6us
I20260928 01:56:09.509410 19522 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:09.512727 19704 leader_election.cc:304] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:09.513818 21633 raft_consensus.cc:2804] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:09.514288 21633 raft_consensus.cc:697] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:09.515762 21633 consensus_queue.cc:237] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.519866 21647 raft_consensus.cc:493] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:09.520378 21647 raft_consensus.cc:515] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.522405 21647 leader_election.cc:290] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:09.526736 20029 ts_tablet_manager.cc:1434] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.492s	user 0.005s	sys 0.015s
I20260928 01:56:09.528153 20029 tablet_bootstrap.cc:492] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:09.540521 19896 consensus_queue.cc:260] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:09.542075 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 70700.3us
I20260928 01:56:09.544963 19896 ts_tablet_manager.cc:1434] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.193s	user 0.007s	sys 0.001s
I20260928 01:56:09.564699 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:09.568152 21775 consensus_queue.cc:1048] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:09.567375 19186 catalog_manager.cc:5838] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 2, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 2 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:09.572665 19186 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:09.578214 19896 tablet_bootstrap.cc:492] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:09.578583 19186 catalog_manager.cc:5838] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:09.580793 19186 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:09.587981 21727 raft_consensus.cc:2749] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:09.588672 19186 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:09.589382 19186 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:09.615625 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:09.616461 19612 raft_consensus.cc:2393] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:09.643659 21645 raft_consensus.cc:493] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:09.644135 21645 raft_consensus.cc:515] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.646668 21645 leader_election.cc:290] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:09.654707 19412 leader_election.cc:343] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:09.655277 19412 leader_election.cc:304] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:09.656442 21647 raft_consensus.cc:2749] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:09.681936 19896 tablet_bootstrap.cc:654] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:09.682029 19890 tablet_bootstrap.cc:492] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:09.682596 19890 ts_tablet_manager.cc:1403] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.366s	user 0.006s	sys 0.005s
I20260928 01:56:09.686589 19890 raft_consensus.cc:359] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.697805 19890 raft_consensus.cc:385] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:09.699095 19890 raft_consensus.cc:740] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:09.700991 19890 consensus_queue.cc:260] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:09.712325 19890 ts_tablet_manager.cc:1434] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260928 01:56:09.713418 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:09.714201 19473 raft_consensus.cc:2468] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:09.720719 19890 tablet_bootstrap.cc:492] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:56:09.737166 19105 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0669f9f51b05479aa9715e06d4c42423 consensus state has no leader
I20260928 01:56:09.772876 19890 tablet_bootstrap.cc:654] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:09.776682 19896 tablet_bootstrap.cc:492] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:09.777253 19896 ts_tablet_manager.cc:1403] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.199s	user 0.017s	sys 0.001s
I20260928 01:56:09.779887 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:09.780772 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:09.783089 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
I20260928 01:56:09.790019 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]). Expected version 1 got 0
I20260928 01:56:09.790915 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:56:09.798084 20029 tablet_bootstrap.cc:654] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:09.800557 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:09.802573 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:09.803052 19704 leader_election.cc:304] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:09.804759 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:09.805298 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:09.807152 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:09.808410 21595 raft_consensus.cc:3060] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:09.823941 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:09.825498 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:09.830545 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
I20260928 01:56:09.837587 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
I20260928 01:56:09.839010 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
W20260928 01:56:09.840518 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 71888.4us
I20260928 01:56:09.779798 19896 raft_consensus.cc:359] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:09.852702 19896 raft_consensus.cc:385] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:09.853022 19896 raft_consensus.cc:740] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:09.853663 19896 consensus_queue.cc:260] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:09.859862 21655 consensus_queue.cc:1048] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:09.863438 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:09.872028 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
I20260928 01:56:09.874002 21756 consensus_queue.cc:1048] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:09.874894 21595 raft_consensus.cc:2749] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:09.876868 19703 consensus_peers.cc:597] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 158edf7a5d724c88992fecbadd2cedfa. This is attempt 11: this message will repeat every 5th retry.
I20260928 01:56:09.881098 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:09.884641 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
I20260928 01:56:09.939574 21775 consensus_queue.cc:1048] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:09.886024 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7441c2d1a7fa4dc8a89c6717a80d3efb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:09.963510 19896 ts_tablet_manager.cc:1434] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.186s	user 0.005s	sys 0.000s
I20260928 01:56:09.979565 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
I20260928 01:56:09.981573 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:09.988579 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:09.992305 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]). Expected version 1 got 0
I20260928 01:56:09.995414 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:56:09.996477 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:09.997694 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:10.001859 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:10.002398 19896 tablet_bootstrap.cc:492] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:10.002923 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
W20260928 01:56:10.006172 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 55369.8us
I20260928 01:56:10.006666 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
I20260928 01:56:10.009474 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:10.010375 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:10.012073 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
I20260928 01:56:10.014031 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:10.016959 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:10.021085 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:10.023566 19187 catalog_manager.cc:5838] T 043ddb5b0b0e4ad0b30d2927d37971fb P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:10.029206 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
I20260928 01:56:10.030740 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:10.034935 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
I20260928 01:56:10.036507 21647 raft_consensus.cc:493] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:10.037155 21647 raft_consensus.cc:515] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:10.040689 20029 tablet_bootstrap.cc:492] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:10.041174 20029 ts_tablet_manager.cc:1403] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.513s	user 0.014s	sys 0.003s
I20260928 01:56:10.041020 21647 leader_election.cc:290] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:10.045600 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 49061.2us
I20260928 01:56:10.047583 19409 leader_election.cc:304] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:10.048383 21765 raft_consensus.cc:2804] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:10.049054 21765 raft_consensus.cc:697] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:10.050447 21765 consensus_queue.cc:237] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:10.130848 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:10.207253 19180 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 11a7c70dba4e4b3b97104b5d65704b9d consensus state has no leader
W20260928 01:56:10.228855 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 197378us
W20260928 01:56:10.318994 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 57944us
I20260928 01:56:10.223668 20029 raft_consensus.cc:359] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:10.323320 20029 raft_consensus.cc:385] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:10.342490 20029 raft_consensus.cc:740] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:10.413206 19614 raft_consensus.cc:2468] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
W20260928 01:56:10.425029 21800 log.cc:927] Time spent T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614: Append to log took a long time: real 0.146s	user 0.003s	sys 0.000s
I20260928 01:56:10.357112 21647 raft_consensus.cc:493] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:10.442555 19896 tablet_bootstrap.cc:654] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:10.401641 21765 raft_consensus.cc:493] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:10.343683 20029 consensus_queue.cc:260] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:10.505659 21765 raft_consensus.cc:515] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:10.440268 21647 raft_consensus.cc:515] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:10.519758 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b836e20d6b43cba8eaa08887afb076" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:10.553995 20029 ts_tablet_manager.cc:1434] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.512s	user 0.016s	sys 0.002s
I20260928 01:56:10.267666 19613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b836e20d6b43cba8eaa08887afb076" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:10.604625 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb014699060e4a6caf4caaf33c31710a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:10.633735 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:10.556100 20029 ts_tablet_manager.cc:1467] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da: Tablet startup took 514ms
W20260928 01:56:10.684320 20029 ts_tablet_manager.cc:1469] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da: Trace:
0928 01:55:44.403236 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.404612 (+  1376us) service_pool.cc:224] Handling call
0928 01:55:44.502139 (+ 97527us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:44.502223 (+    84us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:44.547707 (+ 45484us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.737263 (+189556us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:44.787259 (+ 49996us) inbound_call.cc:177] Queueing success response
0928 01:56:09.527672 (+24740413us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0928 01:56:10.041492 (+513820us) ts_tablet_manager.cc:1435] Starting tablet replica
0928 01:56:10.042861 (+  1369us) tablet_replica.cc:261] Starting instrumentation
0928 01:56:10.043406 (+   545us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":177273,"raft.queue_time_us":1556,"raft.run_cpu_time_us":669,"raft.run_wall_time_us":676,"tablet-open.queue_time_us":24740475}
I20260928 01:56:10.704949 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb014699060e4a6caf4caaf33c31710a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:10.732659 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 51082.2us
I20260928 01:56:10.738418 20029 tablet_bootstrap.cc:492] T 522245da435b40ae84ae6dc5d19a2e95 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:10.744418 21804 raft_consensus.cc:493] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:10.746946 21804 raft_consensus.cc:515] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:10.849174 19553 leader_election.cc:343] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:10.862277 19768 raft_consensus.cc:3060] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:10.886294 19890 tablet_bootstrap.cc:492] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
W20260928 01:56:10.915956 20456 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.622s (SENT)
I20260928 01:56:10.918171 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:10.953922 19896 tablet_bootstrap.cc:492] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:10.954646 19896 ts_tablet_manager.cc:1403] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.952s	user 0.020s	sys 0.006s
I20260928 01:56:10.973412 21814 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:10.976378 19890 ts_tablet_manager.cc:1403] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 1.168s	user 0.020s	sys 0.004s
W20260928 01:56:11.005944 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 51454.4us
W20260928 01:56:10.997833 20456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 82098.4us
I20260928 01:56:11.025789 19522 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:10.962890 21804 leader_election.cc:290] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:10.917989 21765 leader_election.cc:290] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:11.044816 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:11.029145 21806 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:11.046389 21806 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:11.065333 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9690a224bb004152ba65d525cc10bd9f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:11.024711 21647 leader_election.cc:290] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:11.090466 21806 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:11.100132 20029 tablet_bootstrap.cc:654] T 522245da435b40ae84ae6dc5d19a2e95 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:11.115998 19896 raft_consensus.cc:359] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:11.126752 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 72496.4us
I20260928 01:56:11.163800 19890 raft_consensus.cc:359] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:11.164992 19890 raft_consensus.cc:385] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:11.165356 19890 raft_consensus.cc:740] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:11.166278 20029 tablet_bootstrap.cc:492] T 522245da435b40ae84ae6dc5d19a2e95 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:11.166749 20029 ts_tablet_manager.cc:1403] T 522245da435b40ae84ae6dc5d19a2e95 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.429s	user 0.010s	sys 0.007s
I20260928 01:56:11.177606 20029 raft_consensus.cc:359] T 522245da435b40ae84ae6dc5d19a2e95 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:11.178326 20029 raft_consensus.cc:385] T 522245da435b40ae84ae6dc5d19a2e95 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:11.178722 20029 raft_consensus.cc:740] T 522245da435b40ae84ae6dc5d19a2e95 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:11.179567 20029 consensus_queue.cc:260] T 522245da435b40ae84ae6dc5d19a2e95 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:11.185772 20029 ts_tablet_manager.cc:1434] T 522245da435b40ae84ae6dc5d19a2e95 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260928 01:56:11.186872 20029 tablet_bootstrap.cc:492] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:56:11.129964 19409 leader_election.cc:343] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:11.192430 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 62524.3us
I20260928 01:56:11.195326 19896 raft_consensus.cc:385] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:11.195801 19896 raft_consensus.cc:740] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:11.196806 19896 consensus_queue.cc:260] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:11.211076 19409 leader_election.cc:343] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:11.232687 19890 consensus_queue.cc:260] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:11.263100 19890 ts_tablet_manager.cc:1434] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.262s	user 0.009s	sys 0.000s
W20260928 01:56:11.264689 19409 consensus_peers.cc:597] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:11.279716 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
W20260928 01:56:11.281741 19180 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 11a7c70dba4e4b3b97104b5d65704b9d consensus state has no leader
I20260928 01:56:11.289306 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
W20260928 01:56:11.298346 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 98709.7us
W20260928 01:56:11.267352 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 61881.8us
I20260928 01:56:11.312642 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:11.316566 19412 leader_election.cc:304] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:11.317309 21765 raft_consensus.cc:2749] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:11.317808 19191 catalog_manager.cc:5838] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:11.276615 19896 ts_tablet_manager.cc:1434] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.321s	user 0.009s	sys 0.000s
I20260928 01:56:11.326726 19896 tablet_bootstrap.cc:492] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
W20260928 01:56:11.328339 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 63798us
I20260928 01:56:11.328923 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:56:11.329598 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:11.333597 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:11.306402 21803 raft_consensus.cc:493] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:11.336942 21803 raft_consensus.cc:515] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:11.338922 21803 leader_election.cc:290] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:11.340550 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:11.343827 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:11.347464 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
I20260928 01:56:11.352717 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:11.354704 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:11.365317 19890 tablet_bootstrap.cc:492] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:11.372536 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
W20260928 01:56:11.368584 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 67700.7us
I20260928 01:56:11.373907 19191 catalog_manager.cc:5838] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:11.375969 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
W20260928 01:56:11.376565 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 51680.6us
W20260928 01:56:11.377370 19412 leader_election.cc:343] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:11.377827 19412 leader_election.cc:304] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:11.378665 21765 raft_consensus.cc:2749] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:11.386246 21806 consensus_queue.cc:1048] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:56:11.397464 19412 leader_election.cc:343] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:11.397927 19412 leader_election.cc:304] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:11.399246 21647 raft_consensus.cc:2749] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:11.400305 20029 tablet_bootstrap.cc:654] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:11.404083 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b795606604960bc7cafab4ff6f3d0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:11.431387 19814 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:11.437023 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:11.442761 21647 consensus_queue.cc:1048] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:56:11.447880 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 70192us
W20260928 01:56:11.457572 19409 leader_election.cc:343] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:11.462352 19409 leader_election.cc:343] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:11.463238 21805 consensus_queue.cc:1048] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:56:11.311800 19556 consensus_peers.cc:597] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58c61408724e4a70b39e5dbdab9a3e8a. This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:11.466831 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 155255us
I20260928 01:56:11.468504 19556 leader_election.cc:304] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:11.469254 21803 raft_consensus.cc:2804] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:11.469482 21679 raft_consensus.cc:493] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:11.469615 21803 raft_consensus.cc:493] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:11.469952 21803 raft_consensus.cc:3060] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:11.469954 21679 raft_consensus.cc:515] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:11.472102 21679 leader_election.cc:290] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:11.439553 19191 catalog_manager.cc:5838] T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:11.481355 21679 raft_consensus.cc:493] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:11.481925 21679 raft_consensus.cc:515] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:11.484056 21679 leader_election.cc:290] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:11.485282 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:11.501760 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522245da435b40ae84ae6dc5d19a2e95" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:11.505487 19759 raft_consensus.cc:2468] T 522245da435b40ae84ae6dc5d19a2e95 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
W20260928 01:56:11.513186 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 45523.9us
I20260928 01:56:11.513324 21805 consensus_queue.cc:1048] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:56:11.514607 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 49672us
I20260928 01:56:11.515429 21647 consensus_queue.cc:1048] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:11.523440 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
I20260928 01:56:11.524555 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:11.545584 21806 raft_consensus.cc:493] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:11.546219 21806 raft_consensus.cc:515] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:11.550364 20029 tablet_bootstrap.cc:492] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:11.550958 20029 ts_tablet_manager.cc:1403] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.364s	user 0.012s	sys 0.009s
I20260928 01:56:11.553659 19191 catalog_manager.cc:5838] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:11.561434 19191 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
W20260928 01:56:11.577718 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 62489.1us
I20260928 01:56:11.579867 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:11.392043 19896 tablet_bootstrap.cc:654] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:56:11.583307 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 101247us
I20260928 01:56:11.584887 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05925303152462e8ca25cd15f3bedff" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:11.593600 21682 consensus_queue.cc:1048] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:56:11.598551 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 88260.7us
I20260928 01:56:11.574437 21806 leader_election.cc:290] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:11.623286 19553 leader_election.cc:343] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:11.634538 21803 raft_consensus.cc:515] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:11.638665 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 65799.1us
W20260928 01:56:11.642270 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 107844us
I20260928 01:56:11.673663 19890 tablet_bootstrap.cc:654] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:11.733436 21647 raft_consensus.cc:493] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
W20260928 01:56:11.709416 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 56014.1us
I20260928 01:56:11.758808 21820 consensus_queue.cc:1048] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:11.669824 20029 raft_consensus.cc:359] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:11.776612 20029 raft_consensus.cc:385] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:11.776997 20029 raft_consensus.cc:740] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:11.778038 20029 consensus_queue.cc:260] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:11.780747 21647 raft_consensus.cc:515] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:11.782913 21647 leader_election.cc:290] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:11.796993 21682 consensus_queue.cc:1048] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:11.797688 21822 consensus_queue.cc:1048] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:11.801396 21805 raft_consensus.cc:493] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:11.802047 21805 raft_consensus.cc:515] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:11.806859 21805 leader_election.cc:290] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:11.842191 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 45628.4us
I20260928 01:56:11.846045 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:11.849586 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9690a224bb004152ba65d525cc10bd9f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:11.726222 21803 leader_election.cc:290] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:11.738559 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 113874us
I20260928 01:56:11.856582 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:11.860140 19896 tablet_bootstrap.cc:492] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:11.860791 19896 ts_tablet_manager.cc:1403] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.534s	user 0.010s	sys 0.004s
I20260928 01:56:11.868651 19553 leader_election.cc:304] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:11.869403 21808 raft_consensus.cc:2804] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:11.870040 21808 raft_consensus.cc:493] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:11.871235 21808 raft_consensus.cc:3060] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:11.876019 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05925303152462e8ca25cd15f3bedff" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:11.878254 19411 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 111351us
I20260928 01:56:11.889149 21682 raft_consensus.cc:493] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:11.889843 21682 raft_consensus.cc:515] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:11.892081 19605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:11.893762 21682 leader_election.cc:290] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:11.895610 19102 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 consensus state has no leader
W20260928 01:56:11.909071 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 64227.9us
I20260928 01:56:11.919098 20029 ts_tablet_manager.cc:1434] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.368s	user 0.006s	sys 0.001s
I20260928 01:56:11.920244 20029 tablet_bootstrap.cc:492] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:56:11.927083 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 115223us
I20260928 01:56:11.959204 19184 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
W20260928 01:56:11.960785 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 92234.9us
I20260928 01:56:11.966068 19184 catalog_manager.cc:5838] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
W20260928 01:56:11.967869 19553 leader_election.cc:343] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: 57a81b9455a340728fea713318e1e77a
I20260928 01:56:11.970513 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:11.979452 21805 raft_consensus.cc:493] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:11.980222 21805 raft_consensus.cc:515] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:11.982682 21805 leader_election.cc:290] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:11.987375 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287060a8d054b15b2252dcf280ca8c2" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:11.983431 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 55649.4us
I20260928 01:56:11.987372 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b795606604960bc7cafab4ff6f3d0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:11.995970 19463 raft_consensus.cc:2468] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:12.001240 19890 tablet_bootstrap.cc:492] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:12.054363 19184 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:12.058202 19184 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:12.077040 19890 ts_tablet_manager.cc:1403] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.712s	user 0.010s	sys 0.006s
I20260928 01:56:12.067020 19184 catalog_manager.cc:5838] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:12.083949 19184 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:12.095845 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522245da435b40ae84ae6dc5d19a2e95" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:12.096524 19473 raft_consensus.cc:2468] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:12.099020 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:12.099740 19473 raft_consensus.cc:2468] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
W20260928 01:56:12.102038 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 78405.3us
I20260928 01:56:12.105980 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287060a8d054b15b2252dcf280ca8c2" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:12.106168 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:12.049018 19896 raft_consensus.cc:359] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:12.123564 19896 raft_consensus.cc:385] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:12.123880 19896 raft_consensus.cc:740] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:12.125532 19896 consensus_queue.cc:260] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:12.129117 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:12.136982 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:12.137825 19473 raft_consensus.cc:3060] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:12.092079 19890 raft_consensus.cc:359] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:12.237043 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 70436.8us
I20260928 01:56:12.292990 19896 ts_tablet_manager.cc:1434] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.432s	user 0.006s	sys 0.002s
I20260928 01:56:12.295922 20029 tablet_bootstrap.cc:700] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent opening tablet: real 0.140s	user 0.002s	sys 0.000s
I20260928 01:56:12.297261 20029 tablet_bootstrap.cc:654] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:12.297906 19890 raft_consensus.cc:385] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:12.298305 19890 raft_consensus.cc:740] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:12.299310 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:12.299609 19890 consensus_queue.cc:260] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:12.300529 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:12.304859 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
I20260928 01:56:12.314749 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:56:12.330829 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:12.344386 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:12.346441 19185 catalog_manager.cc:5838] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:12.351703 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:12.357957 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:12.362845 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:12.372741 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:12.374375 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:12.378281 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
I20260928 01:56:12.379315 19473 raft_consensus.cc:2468] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:12.323488 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:12.382959 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
W20260928 01:56:12.395607 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 157485us
I20260928 01:56:12.395490 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:12.402984 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:12.405155 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
I20260928 01:56:12.411751 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:12.412287 21803 raft_consensus.cc:493] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:12.413146 21803 raft_consensus.cc:515] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:12.417695 19185 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
I20260928 01:56:12.011947 21808 raft_consensus.cc:515] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:12.425393 21808 leader_election.cc:290] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:12.427848 21827 raft_consensus.cc:493] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:12.428532 19186 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd] alter complete (version 1)
I20260928 01:56:12.428646 21827 raft_consensus.cc:515] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:12.432004 21827 leader_election.cc:290] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:12.441310 19896 tablet_bootstrap.cc:492] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:12.446452 19190 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88] alter complete (version 2)
W20260928 01:56:12.474013 19184 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 277) took 994 ms (client timeout 1000 ms). Trace:
I20260928 01:56:12.482239 19890 ts_tablet_manager.cc:1434] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.393s	user 0.006s	sys 0.000s
I20260928 01:56:12.483397 19890 tablet_bootstrap.cc:492] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:56:12.474589 19184 rpcz_store.cc:269] 0928 01:56:11.480124 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:11.480386 (+   262us) service_pool.cc:224] Handling call
0928 01:56:12.473907 (+993521us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:12.136635 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:12.137152 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:12.137184 (+    32us) write_op.cc:435] Acquired schema lock
0928 01:56:12.137200 (+    16us) tablet.cc:662] Decoding operations
0928 01:56:12.137589 (+   389us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:12.137640 (+    51us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:12.137679 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:56:12.138019 (+   340us) tablet.cc:701] Row locks acquired
0928 01:56:12.138033 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:56:12.138172 (+   139us) write_op.cc:270] Start()
0928 01:56:12.138280 (+   108us) write_op.cc:276] Timestamp: P: 1790560572138110 usec, L: 0
0928 01:56:12.138295 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:56:12.138947 (+   652us) log.cc:844] Serialized 907 byte log entry
0928 01:56:12.149758 (+ 10811us) op_driver.cc:464] REPLICATION: finished
0928 01:56:12.151003 (+  1245us) write_op.cc:301] APPLY: starting
0928 01:56:12.151070 (+    67us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:12.151207 (+   137us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:12.151309 (+   102us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:12.151680 (+   371us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:12.151858 (+   178us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:56:12.151904 (+    46us) write_op.cc:312] APPLY: finished
0928 01:56:12.152108 (+   204us) log.cc:844] Serialized 29 byte log entry
0928 01:56:12.152292 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:12.152367 (+    75us) write_op.cc:454] Released schema lock
0928 01:56:12.152402 (+    35us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:12.152657 (+   255us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:12.152682 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3982,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":1055,"apply.run_cpu_time_us":1608,"apply.run_wall_time_us":1608,"num_ops":2,"prepare.queue_time_us":166,"prepare.run_cpu_time_us":2662,"prepare.run_wall_time_us":2662,"raft.queue_time_us":114,"raft.run_cpu_time_us":829,"raft.run_wall_time_us":829,"replication_time_us":11335,"spinlock_wait_cycles":13184}]]}
I20260928 01:56:12.531189 21862 raft_consensus.cc:493] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:56:12.535030 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 138438us
W20260928 01:56:12.535838 19703 consensus_peers.cc:597] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ca0b52215454a99b6c5d1956088829a. This is attempt 11: this message will repeat every 5th retry.
I20260928 01:56:12.575078 19193 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5] alter complete (version 2)
W20260928 01:56:12.582269 19186 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 276) took 3643 ms (client timeout 1000 ms). Trace:
W20260928 01:56:12.630162 21848 log.cc:927] Time spent T 36076aa674b9401b9b76fbf066348d06 P 37089d44fdba4b6488b5b5aea28af614: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260928 01:56:12.688449 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522245da435b40ae84ae6dc5d19a2e95" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:12.689209 19468 raft_consensus.cc:3060] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:12.722481 21803 leader_election.cc:290] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:12.643868 19186 rpcz_store.cc:269] 0928 01:56:08.939057 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:08.939350 (+   293us) service_pool.cc:224] Handling call
0928 01:56:09.699916 (+760566us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:09.699946 (+    30us) write_op.cc:454] Released schema lock
0928 01:56:12.582179 (+2882233us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:09.603369 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:09.603869 (+   500us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:09.603908 (+    39us) write_op.cc:435] Acquired schema lock
0928 01:56:09.603930 (+    22us) tablet.cc:662] Decoding operations
0928 01:56:09.604328 (+   398us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:09.604373 (+    45us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:09.604403 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:56:09.604703 (+   300us) tablet.cc:701] Row locks acquired
0928 01:56:09.604721 (+    18us) write_op.cc:260] PREPARE: finished
0928 01:56:09.604856 (+   135us) write_op.cc:270] Start()
0928 01:56:09.604968 (+   112us) write_op.cc:276] Timestamp: P: 1790560569604790 usec, L: 0
0928 01:56:09.604988 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:56:09.605536 (+   548us) log.cc:844] Serialized 907 byte log entry
0928 01:56:09.614086 (+  8550us) op_driver.cc:464] REPLICATION: finished
0928 01:56:09.614427 (+   341us) write_op.cc:301] APPLY: starting
0928 01:56:09.614482 (+    55us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:09.614610 (+   128us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:09.614707 (+    97us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:09.615009 (+   302us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:09.615147 (+   138us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:56:09.615188 (+    41us) write_op.cc:312] APPLY: finished
0928 01:56:09.615381 (+   193us) log.cc:844] Serialized 29 byte log entry
0928 01:56:09.615531 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:09.615604 (+    73us) write_op.cc:454] Released schema lock
0928 01:56:09.615635 (+    31us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:09.615864 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:09.615899 (+    35us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:09.672450 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:09.672941 (+   491us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:09.672970 (+    29us) write_op.cc:435] Acquired schema lock
0928 01:56:09.672987 (+    17us) tablet.cc:662] Decoding operations
0928 01:56:09.673295 (+   308us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:09.673339 (+    44us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:09.673364 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:09.673529 (+   165us) tablet.cc:701] Row locks acquired
0928 01:56:09.673545 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:56:09.673703 (+   158us) write_op.cc:270] Start()
0928 01:56:09.673805 (+   102us) write_op.cc:276] Timestamp: P: 1790560569673637 usec, L: 0
0928 01:56:09.673822 (+    17us) op_driver.cc:348] REPLICATION: starting
0928 01:56:09.674384 (+   562us) log.cc:844] Serialized 356 byte log entry
0928 01:56:09.684468 (+ 10084us) op_driver.cc:464] REPLICATION: finished
0928 01:56:09.684831 (+   363us) write_op.cc:301] APPLY: starting
0928 01:56:09.684899 (+    68us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:09.684989 (+    90us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:09.685080 (+    91us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:09.685269 (+   189us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:09.685396 (+   127us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:09.685440 (+    44us) write_op.cc:312] APPLY: finished
0928 01:56:09.685610 (+   170us) log.cc:844] Serialized 23 byte log entry
0928 01:56:09.685748 (+   138us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:09.685829 (+    81us) write_op.cc:454] Released schema lock
0928 01:56:09.685860 (+    31us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":276,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":198,"apply.run_cpu_time_us":1409,"apply.run_wall_time_us":1408,"num_ops":2,"prepare.queue_time_us":1514,"prepare.run_cpu_time_us":2494,"prepare.run_wall_time_us":2494,"raft.queue_time_us":1323,"raft.run_cpu_time_us":806,"raft.run_wall_time_us":807,"replication_time_us":8983}],["op",{"apply.queue_time_us":227,"apply.run_cpu_time_us":1206,"apply.run_wall_time_us":1206,"num_ops":1,"prepare.queue_time_us":576,"prepare.run_cpu_time_us":2270,"prepare.run_wall_time_us":2269,"raft.queue_time_us":1456,"raft.run_cpu_time_us":751,"raft.run_wall_time_us":763,"replication_time_us":10537}]]}
W20260928 01:56:12.756064 19553 leader_election.cc:343] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:12.767853 20029 tablet_bootstrap.cc:492] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:12.768478 20029 ts_tablet_manager.cc:1403] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.848s	user 0.012s	sys 0.004s
W20260928 01:56:12.773857 19553 leader_election.cc:343] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:12.775961 19553 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
I20260928 01:56:12.821797 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:12.822750 19461 raft_consensus.cc:2468] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:12.531920 21862 raft_consensus.cc:515] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:12.805922 21853 raft_consensus.cc:493] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
W20260928 01:56:12.879500 19192 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet e43bec2c4274497ea73872d0db233eac consensus state has no leader
I20260928 01:56:12.883827 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:12.884573 19474 raft_consensus.cc:2468] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:12.890095 21862 leader_election.cc:290] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:12.897102 21853 raft_consensus.cc:515] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:12.907612 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 131685us
W20260928 01:56:12.909709 19179 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e43bec2c4274497ea73872d0db233eac consensus state has no leader
I20260928 01:56:12.910567 19468 raft_consensus.cc:2468] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:12.911643 21827 raft_consensus.cc:493] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:12.912385 21827 raft_consensus.cc:515] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:12.915465 19412 leader_election.cc:343] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:12.917340 21827 leader_election.cc:290] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:12.783509 21803 raft_consensus.cc:493] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:12.918253 21803 raft_consensus.cc:515] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:12.921433 21803 leader_election.cc:290] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:12.928774 19412 leader_election.cc:304] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:12.944720 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 87581.1us
I20260928 01:56:12.922353 21853 leader_election.cc:290] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:12.926075 19896 tablet_bootstrap.cc:654] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:12.916026 21860 consensus_queue.cc:1048] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:12.981353 21806 raft_consensus.cc:2749] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:12.986904 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 71362.4us
I20260928 01:56:13.009977 21860 consensus_queue.cc:1048] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260928 01:56:13.021023 19412 leader_election.cc:343] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:13.050218 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 140683us
I20260928 01:56:13.195408 21867 raft_consensus.cc:493] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:13.197681 21867 raft_consensus.cc:515] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:13.200344 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 252095us
I20260928 01:56:13.249184 19896 tablet_bootstrap.cc:492] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:13.249724 19896 ts_tablet_manager.cc:1403] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.809s	user 0.012s	sys 0.007s
I20260928 01:56:13.256107 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ae3663fbe024a4e946e47339a4b9090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.257273 19446 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ab79c6ad03e481a903a0f95ae0512e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:41 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.257356 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet eac01fc222dd480cbed7cac37a0e6693 with delete_type TABLET_DATA_DELETED (replaced by tablet 522245da435b40ae84ae6dc5d19a2e95) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.258123 19896 raft_consensus.cc:359] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:13.258863 19896 raft_consensus.cc:385] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:13.259119 19896 raft_consensus.cc:740] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:13.259752 19896 consensus_queue.cc:260] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:13.265036 19896 ts_tablet_manager.cc:1434] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260928 01:56:13.266101 19896 tablet_bootstrap.cc:492] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:13.273227 21881 tablet_replica.cc:333] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:13.275518 19896 tablet_bootstrap.cc:654] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:13.285200 21867 leader_election.cc:290] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:13.025027 19412 leader_election.cc:304] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:13.301069 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522245da435b40ae84ae6dc5d19a2e95" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:13.301718 19763 raft_consensus.cc:3060] T 522245da435b40ae84ae6dc5d19a2e95 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:13.306943 21875 log.cc:927] Time spent T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260928 01:56:13.322973 19896 tablet_bootstrap.cc:492] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:13.323434 19896 ts_tablet_manager.cc:1403] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.022s
I20260928 01:56:13.264505 21804 raft_consensus.cc:493] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:13.328559 21804 raft_consensus.cc:515] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:13.329917 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 60320.8us
W20260928 01:56:13.332093 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 311567us
I20260928 01:56:13.332835 19412 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:13.187515 21878 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:13.334967 21878 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:13.355001 21867 raft_consensus.cc:493] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:13.243258 20029 raft_consensus.cc:359] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.355775 20029 raft_consensus.cc:385] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:13.355626 21867 raft_consensus.cc:515] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:13.356062 20029 raft_consensus.cc:740] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:13.357846 21867 leader_election.cc:290] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:13.359063 21804 leader_election.cc:290] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:13.362488 19890 tablet_bootstrap.cc:654] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:13.380100 21808 raft_consensus.cc:493] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:13.377652 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:13.384402 21808 raft_consensus.cc:515] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:13.382263 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 156804us
I20260928 01:56:13.385136 21878 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
W20260928 01:56:13.390216 19188 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:53391 (request call id 254) took 5382 ms (client timeout 1000 ms). Trace:
I20260928 01:56:13.395119 19763 raft_consensus.cc:2468] T 522245da435b40ae84ae6dc5d19a2e95 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:13.399962 21808 leader_election.cc:290] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:13.404597 21881 raft_consensus.cc:2243] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 01:56:13.405880 19188 rpcz_store.cc:269] 0928 01:56:08.007492 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:08.007730 (+   238us) service_pool.cc:224] Handling call
0928 01:56:13.390099 (+5382369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112346,"reported_tablets":115}
I20260928 01:56:13.408380 21806 raft_consensus.cc:2749] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:13.409921 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 77176.7us
I20260928 01:56:13.410934 19412 leader_election.cc:304] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:13.412559 21765 raft_consensus.cc:2749] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:13.413156 21765 consensus_queue.cc:1048] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:13.414366 21765 raft_consensus.cc:2749] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:13.418357 21881 raft_consensus.cc:2272] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:13.421383 21881 ts_tablet_manager.cc:1916] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:13.392695 19192 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 249) took 6471 ms (client timeout 1000 ms). Trace:
W20260928 01:56:13.391582 19191 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 251) took 3657 ms (client timeout 1000 ms). Trace:
I20260928 01:56:13.431906 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 356 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:56:13.425191 19191 rpcz_store.cc:269] 0928 01:56:09.734168 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:09.734315 (+   147us) service_pool.cc:224] Handling call
0928 01:56:13.391415 (+3657100us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:11.624860 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:11.625897 (+  1037us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:11.625950 (+    53us) write_op.cc:435] Acquired schema lock
0928 01:56:11.625988 (+    38us) tablet.cc:662] Decoding operations
0928 01:56:11.626936 (+   948us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:11.627048 (+   112us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:11.627089 (+    41us) tablet.cc:685] Acquiring locks for 4 operations
0928 01:56:11.627713 (+   624us) tablet.cc:701] Row locks acquired
0928 01:56:11.627729 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:56:11.627938 (+   209us) write_op.cc:270] Start()
0928 01:56:11.628081 (+   143us) write_op.cc:276] Timestamp: P: 1790560571627876 usec, L: 0
0928 01:56:11.628097 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:56:11.689797 (+ 61700us) log.cc:844] Serialized 1662 byte log entry
0928 01:56:11.838100 (+148303us) op_driver.cc:464] REPLICATION: finished
0928 01:56:11.870185 (+ 32085us) write_op.cc:301] APPLY: starting
0928 01:56:11.870291 (+   106us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:11.870769 (+   478us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:11.871001 (+   232us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:11.871900 (+   899us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:11.890458 (+ 18558us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0928 01:56:11.890568 (+   110us) write_op.cc:312] APPLY: finished
0928 01:56:11.891109 (+   541us) log.cc:844] Serialized 41 byte log entry
0928 01:56:11.891359 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:11.891477 (+   118us) write_op.cc:454] Released schema lock
0928 01:56:11.891525 (+    48us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:11.891919 (+   394us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:11.891957 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":361588,"reported_tablets":112,"child_traces":[["op",{"apply.queue_time_us":31779,"apply.run_cpu_time_us":3324,"apply.run_wall_time_us":21680,"num_ops":4,"prepare.queue_time_us":49622,"prepare.run_cpu_time_us":5286,"prepare.run_wall_time_us":124509,"raft.queue_time_us":125,"raft.run_cpu_time_us":852,"raft.run_wall_time_us":852,"replication_time_us":209812,"spinlock_wait_cycles":47488,"thread_start_us":146762,"threads_started":3,"wal-append.queue_time_us":28923}]]}
W20260928 01:56:13.434126 19189 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 248) took 7874 ms (client timeout 1000 ms). Trace:
W20260928 01:56:13.434487 19189 rpcz_store.cc:269] 0928 01:56:05.559393 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:05.560343 (+   950us) service_pool.cc:224] Handling call
0928 01:56:13.433998 (+7873655us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121648,"reported_tablets":101}
I20260928 01:56:13.438628 20029 consensus_queue.cc:260] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:13.440357 19193 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:53391 (request call id 253) took 6881 ms (client timeout 1000 ms). Trace:
I20260928 01:56:13.443111 21808 raft_consensus.cc:493] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:13.443630 21808 raft_consensus.cc:515] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.451051 19890 tablet_bootstrap.cc:492] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:13.452502 19890 ts_tablet_manager.cc:1403] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.969s	user 0.018s	sys 0.002s
I20260928 01:56:13.454146 21808 leader_election.cc:290] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:13.458249 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:13.461265 19190 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:53391 (request call id 252) took 8313 ms (client timeout 1000 ms). Trace:
I20260928 01:56:13.461478 19757 raft_consensus.cc:2468] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:13.462001 21861 raft_consensus.cc:493] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:13.462472 21861 raft_consensus.cc:515] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:13.426034 19192 rpcz_store.cc:269] 0928 01:56:06.921215 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:06.921413 (+   198us) service_pool.cc:224] Handling call
0928 01:56:13.392621 (+6471208us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:09.446330 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:09.446946 (+   616us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:09.446983 (+    37us) write_op.cc:435] Acquired schema lock
0928 01:56:09.447011 (+    28us) tablet.cc:662] Decoding operations
0928 01:56:09.447454 (+   443us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:09.447523 (+    69us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:09.447550 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:56:09.447971 (+   421us) tablet.cc:701] Row locks acquired
0928 01:56:09.448002 (+    31us) write_op.cc:260] PREPARE: finished
0928 01:56:09.448175 (+   173us) write_op.cc:270] Start()
0928 01:56:09.453028 (+  4853us) write_op.cc:276] Timestamp: P: 1790560569448100 usec, L: 0
0928 01:56:09.453058 (+    30us) op_driver.cc:348] REPLICATION: starting
0928 01:56:09.457190 (+  4132us) log.cc:844] Serialized 907 byte log entry
0928 01:56:09.537019 (+ 79829us) op_driver.cc:464] REPLICATION: finished
0928 01:56:09.543282 (+  6263us) write_op.cc:301] APPLY: starting
0928 01:56:09.543354 (+    72us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:09.543470 (+   116us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:09.543587 (+   117us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:09.544001 (+   414us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:09.544169 (+   168us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:56:09.552280 (+  8111us) write_op.cc:312] APPLY: finished
0928 01:56:09.552562 (+   282us) log.cc:844] Serialized 29 byte log entry
0928 01:56:09.553287 (+   725us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:09.553361 (+    74us) write_op.cc:454] Released schema lock
0928 01:56:09.553399 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":277975,"reported_tablets":112,"child_traces":[["op",{"apply.queue_time_us":6024,"apply.run_cpu_time_us":1851,"apply.run_wall_time_us":33127,"num_ops":2,"prepare.queue_time_us":21028,"prepare.run_cpu_time_us":4679,"prepare.run_wall_time_us":29518,"raft.queue_time_us":420,"raft.run_cpu_time_us":777,"raft.run_wall_time_us":781,"replication_time_us":79041,"thread_start_us":72519,"threads_started":3,"wal-append.queue_time_us":8494,"wal-append.run_cpu_time_us":11175,"wal-append.run_wall_time_us":1626516}]]}
W20260928 01:56:13.465566 19187 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 250) took 4955 ms (client timeout 1000 ms). Trace:
I20260928 01:56:13.467162 21861 leader_election.cc:290] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:13.440702 19193 rpcz_store.cc:269] 0928 01:56:06.559177 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:06.559366 (+   189us) service_pool.cc:224] Handling call
0928 01:56:13.440267 (+6880901us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:07.510365 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:07.510859 (+   494us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:07.510888 (+    29us) write_op.cc:435] Acquired schema lock
0928 01:56:07.510900 (+    12us) tablet.cc:662] Decoding operations
0928 01:56:07.511233 (+   333us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:07.511283 (+    50us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:07.511310 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:07.511486 (+   176us) tablet.cc:701] Row locks acquired
0928 01:56:07.511503 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:56:07.511634 (+   131us) write_op.cc:270] Start()
0928 01:56:07.511731 (+    97us) write_op.cc:276] Timestamp: P: 1790560567511575 usec, L: 0
0928 01:56:07.511749 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:07.512410 (+   661us) log.cc:844] Serialized 530 byte log entry
0928 01:56:07.524084 (+ 11674us) op_driver.cc:464] REPLICATION: finished
0928 01:56:07.524505 (+   421us) write_op.cc:301] APPLY: starting
0928 01:56:07.524567 (+    62us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:07.524661 (+    94us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:07.524756 (+    95us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:07.524919 (+   163us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:07.525045 (+   126us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:07.525085 (+    40us) write_op.cc:312] APPLY: finished
0928 01:56:07.525276 (+   191us) log.cc:844] Serialized 23 byte log entry
0928 01:56:07.525443 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:07.525520 (+    77us) write_op.cc:454] Released schema lock
0928 01:56:07.525551 (+    31us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:07.525801 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:07.525850 (+    49us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:12.514779 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:12.515644 (+   865us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:12.515689 (+    45us) write_op.cc:435] Acquired schema lock
0928 01:56:12.515723 (+    34us) tablet.cc:662] Decoding operations
0928 01:56:12.516239 (+   516us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:12.516309 (+    70us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:12.516354 (+    45us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:12.516639 (+   285us) tablet.cc:701] Row locks acquired
0928 01:56:12.516672 (+    33us) write_op.cc:260] PREPARE: finished
0928 01:56:12.516884 (+   212us) write_op.cc:270] Start()
0928 01:56:12.517046 (+   162us) write_op.cc:276] Timestamp: P: 1790560572516824 usec, L: 0
0928 01:56:12.517083 (+    37us) op_driver.cc:348] REPLICATION: starting
0928 01:56:12.517992 (+   909us) log.cc:844] Serialized 356 byte log entry
0928 01:56:12.532658 (+ 14666us) op_driver.cc:464] REPLICATION: finished
0928 01:56:12.534944 (+  2286us) write_op.cc:301] APPLY: starting
0928 01:56:12.535049 (+   105us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:12.535201 (+   152us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:12.535354 (+   153us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:12.535692 (+   338us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:12.535906 (+   214us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:12.535982 (+    76us) write_op.cc:312] APPLY: finished
0928 01:56:12.536303 (+   321us) log.cc:844] Serialized 23 byte log entry
0928 01:56:12.536525 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:12.536622 (+    97us) write_op.cc:454] Released schema lock
0928 01:56:12.536671 (+    49us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:12.537058 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:12.537099 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":272917,"reported_tablets":113,"child_traces":[["op",{"apply.queue_time_us":256,"apply.run_cpu_time_us":1274,"apply.run_wall_time_us":1274,"num_ops":1,"prepare.queue_time_us":218,"prepare.run_cpu_time_us":2376,"prepare.run_wall_time_us":2376,"raft.queue_time_us":1755,"raft.run_cpu_time_us":782,"raft.run_wall_time_us":782,"replication_time_us":12218}],["op",{"apply.queue_time_us":1907,"apply.run_cpu_time_us":2015,"apply.run_wall_time_us":2016,"num_ops":1,"prepare.queue_time_us":2470,"prepare.run_cpu_time_us":3828,"prepare.run_wall_time_us":7148,"raft.queue_time_us":267,"raft.run_cpu_time_us":1435,"raft.run_wall_time_us":1480,"replication_time_us":15439}]]}
I20260928 01:56:13.473935 19890 raft_consensus.cc:359] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:13.474689 19890 raft_consensus.cc:385] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:13.474970 19890 raft_consensus.cc:740] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:13.475641 19890 consensus_queue.cc:260] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:13.482695 21880 raft_consensus.cc:493] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:13.483223 21880 raft_consensus.cc:515] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:13.465972 19187 rpcz_store.cc:269] 0928 01:56:08.504897 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:08.505339 (+   442us) service_pool.cc:224] Handling call
0928 01:56:10.132325 (+1626986us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:10.132354 (+    29us) write_op.cc:454] Released schema lock
0928 01:56:13.460427 (+3328073us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:10.044159 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:10.045083 (+   924us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:10.045129 (+    46us) write_op.cc:435] Acquired schema lock
0928 01:56:10.045161 (+    32us) tablet.cc:662] Decoding operations
0928 01:56:10.045616 (+   455us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:10.045673 (+    57us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:10.045730 (+    57us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:10.045988 (+   258us) tablet.cc:701] Row locks acquired
0928 01:56:10.046023 (+    35us) write_op.cc:260] PREPARE: finished
0928 01:56:10.046218 (+   195us) write_op.cc:270] Start()
0928 01:56:10.046357 (+   139us) write_op.cc:276] Timestamp: P: 1790560570046150 usec, L: 0
0928 01:56:10.046375 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:10.047219 (+   844us) log.cc:844] Serialized 530 byte log entry
0928 01:56:10.071738 (+ 24519us) op_driver.cc:464] REPLICATION: finished
0928 01:56:10.073175 (+  1437us) write_op.cc:301] APPLY: starting
0928 01:56:10.073448 (+   273us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:10.073693 (+   245us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:10.073886 (+   193us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:10.074207 (+   321us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:10.074855 (+   648us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:10.075062 (+   207us) write_op.cc:312] APPLY: finished
0928 01:56:10.076017 (+   955us) log.cc:844] Serialized 23 byte log entry
0928 01:56:10.087578 (+ 11561us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:10.087839 (+   261us) write_op.cc:454] Released schema lock
0928 01:56:10.088112 (+   273us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":164860,"reported_tablets":112,"child_traces":[["op",{"apply.queue_time_us":642,"apply.run_cpu_time_us":6727,"apply.run_wall_time_us":21547,"num_ops":1,"prepare.queue_time_us":104,"prepare.run_cpu_time_us":4042,"prepare.run_wall_time_us":33006,"raft.queue_time_us":128,"raft.run_cpu_time_us":1904,"raft.run_wall_time_us":1943,"replication_time_us":24935}]]}
W20260928 01:56:13.461658 19190 rpcz_store.cc:269] 0928 01:56:05.147603 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:05.153210 (+  5607us) service_pool.cc:224] Handling call
0928 01:56:13.461168 (+8307958us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:06.786426 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:06.786970 (+   544us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:06.787000 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:56:06.787018 (+    18us) tablet.cc:662] Decoding operations
0928 01:56:06.835109 (+ 48091us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:06.835173 (+    64us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:06.835201 (+    28us) tablet.cc:685] Acquiring locks for 36 operations
0928 01:56:06.837459 (+  2258us) tablet.cc:701] Row locks acquired
0928 01:56:06.837475 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:56:06.837619 (+   144us) write_op.cc:270] Start()
0928 01:56:06.837721 (+   102us) write_op.cc:276] Timestamp: P: 1790560566837557 usec, L: 0
0928 01:56:06.837739 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:06.838451 (+   712us) log.cc:844] Serialized 13726 byte log entry
0928 01:56:06.932670 (+ 94219us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b5400030d20. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbb5c0 00007f2fcdbc8be8 00007f2fcdbc882a 00007f2fcdc4d125 00007f2fcdc4d5c9 00007f2fce0dd791 00007f2fce0dcf68 00007f2fce0e1c01 00007f2fce0e1bb9 00007f2fce0e1b49 00007f2fce0e1b11
0928 01:56:07.091230 (+158560us) op_driver.cc:464] REPLICATION: finished
0928 01:56:07.143453 (+ 52223us) write_op.cc:301] APPLY: starting
0928 01:56:07.143530 (+    77us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:07.144167 (+   637us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:07.144189 (+    22us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:07.277802 (+133613us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:07.298379 (+ 20577us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=36
0928 01:56:07.298431 (+    52us) write_op.cc:312] APPLY: finished
0928 01:56:07.299045 (+   614us) log.cc:844] Serialized 236 byte log entry
0928 01:56:07.299235 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:07.299474 (+   239us) write_op.cc:454] Released schema lock
0928 01:56:07.299541 (+    67us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:07.299827 (+   286us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:07.299851 (+    24us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:07.358792 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:07.359286 (+   494us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:07.359314 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:56:07.359331 (+    17us) tablet.cc:662] Decoding operations
0928 01:56:07.359631 (+   300us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:07.359674 (+    43us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:07.359703 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:07.359873 (+   170us) tablet.cc:701] Row locks acquired
0928 01:56:07.359890 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:56:07.360028 (+   138us) write_op.cc:270] Start()
0928 01:56:07.360134 (+   106us) write_op.cc:276] Timestamp: P: 1790560567359979 usec, L: 0
0928 01:56:07.360154 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:56:07.360775 (+   621us) log.cc:844] Serialized 356 byte log entry
0928 01:56:07.376366 (+ 15591us) op_driver.cc:464] REPLICATION: finished
0928 01:56:07.390273 (+ 13907us) write_op.cc:301] APPLY: starting
0928 01:56:07.390329 (+    56us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:07.390431 (+   102us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:07.390528 (+    97us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:07.390699 (+   171us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:07.390825 (+   126us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:07.390873 (+    48us) write_op.cc:312] APPLY: finished
0928 01:56:07.391054 (+   181us) log.cc:844] Serialized 23 byte log entry
0928 01:56:07.393317 (+  2263us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:07.393388 (+    71us) write_op.cc:454] Released schema lock
0928 01:56:07.393420 (+    32us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:07.393683 (+   263us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:07.393709 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":367692,"reported_tablets":104,"child_traces":[["op",{"apply.queue_time_us":52015,"apply.run_cpu_time_us":5763,"apply.run_wall_time_us":156345,"num_ops":36,"prepare.queue_time_us":36867,"prepare.run_cpu_time_us":9924,"prepare.run_wall_time_us":159553,"raft.queue_time_us":4490,"raft.run_cpu_time_us":1101,"raft.run_wall_time_us":1105,"replication_time_us":253373,"spinlock_wait_cycles":30081792,"thread_start_us":304063,"threads_started":3,"wal-append.queue_time_us":72372,"wal-append.run_cpu_time_us":9855,"wal-append.run_wall_time_us":1615988}],["op",{"apply.queue_time_us":13725,"apply.run_cpu_time_us":1328,"apply.run_wall_time_us":3396,"num_ops":1,"prepare.queue_time_us":689,"prepare.run_cpu_time_us":2268,"prepare.run_wall_time_us":7837,"replication_time_us":16109}]]}
I20260928 01:56:13.489917 21880 leader_election.cc:290] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:13.493700 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 65286.1us
I20260928 01:56:13.496798 19890 ts_tablet_manager.cc:1434] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.002s
W20260928 01:56:13.499449 19185 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:53391 (request call id 255) took 3435 ms (client timeout 1000 ms). Trace:
I20260928 01:56:13.500818 19890 tablet_bootstrap.cc:492] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:56:13.501185 19185 rpcz_store.cc:269] 0928 01:56:10.063834 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:10.064526 (+   692us) service_pool.cc:224] Handling call
0928 01:56:13.499352 (+3434826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:12.575930 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:12.576534 (+   604us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:12.576572 (+    38us) write_op.cc:435] Acquired schema lock
0928 01:56:12.576591 (+    19us) tablet.cc:662] Decoding operations
0928 01:56:12.576986 (+   395us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:12.577058 (+    72us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:12.577092 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:12.577285 (+   193us) tablet.cc:701] Row locks acquired
0928 01:56:12.577297 (+    12us) write_op.cc:260] PREPARE: finished
0928 01:56:12.577441 (+   144us) write_op.cc:270] Start()
0928 01:56:12.577542 (+   101us) write_op.cc:276] Timestamp: P: 1790560572577385 usec, L: 0
0928 01:56:12.577558 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:56:12.584362 (+  6804us) log.cc:844] Serialized 530 byte log entry
0928 01:56:12.595603 (+ 11241us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b5400030554. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbaaa1 00007f2fcdc4d5e8 00007f2fce0dd791 00007f2fce0dcf68 00007f2fce0e1c01 00007f2fce0e1bb9 00007f2fce0e1b49 00007f2fce0e1b11 00007f2fce0e0d3d 00000000005bd4e4 00000000005bd319
0928 01:56:12.605716 (+ 10113us) op_driver.cc:464] REPLICATION: finished
0928 01:56:12.606193 (+   477us) write_op.cc:301] APPLY: starting
0928 01:56:12.606266 (+    73us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:12.606442 (+   176us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:12.606477 (+    35us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:12.606753 (+   276us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:12.606972 (+   219us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:12.607049 (+    77us) write_op.cc:312] APPLY: finished
0928 01:56:12.607330 (+   281us) log.cc:844] Serialized 23 byte log entry
0928 01:56:12.607537 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:12.607637 (+   100us) write_op.cc:454] Released schema lock
0928 01:56:12.607689 (+    52us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:12.608055 (+   366us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:12.608093 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":200780,"reported_tablets":115,"child_traces":[["op",{"apply.queue_time_us":273,"apply.run_cpu_time_us":1781,"apply.run_wall_time_us":1780,"num_ops":1,"prepare.queue_time_us":45834,"prepare.run_cpu_time_us":4038,"prepare.run_wall_time_us":19955,"raft.queue_time_us":258,"raft.run_cpu_time_us":968,"raft.run_wall_time_us":8114,"replication_time_us":27937,"spinlock_wait_cycles":13901696}]]}
I20260928 01:56:13.469273 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5e07078b2a4fe59d9293d9511cbb6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.435756 19896 raft_consensus.cc:359] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:13.506858 19896 raft_consensus.cc:385] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:13.507186 19896 raft_consensus.cc:740] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:13.489178 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet e05925303152462e8ca25cd15f3bedff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.507855 19896 consensus_queue.cc:260] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:13.513489 20029 ts_tablet_manager.cc:1434] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.745s	user 0.010s	sys 0.001s
W20260928 01:56:13.513752 20029 ts_tablet_manager.cc:1467] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da: Tablet startup took 744ms
W20260928 01:56:13.513988 20029 ts_tablet_manager.cc:1469] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da: Trace:
0928 01:55:44.406112 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.406252 (+   140us) service_pool.cc:224] Handling call
0928 01:55:44.504688 (+ 98436us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:44.504766 (+    78us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:44.550322 (+ 45556us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.793921 (+243599us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:44.794605 (+   684us) inbound_call.cc:177] Queueing success response
0928 01:56:11.919883 (+27125278us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0928 01:56:12.768879 (+848996us) ts_tablet_manager.cc:1435] Starting tablet replica
0928 01:56:12.905234 (+136355us) tablet_replica.cc:261] Starting instrumentation
0928 01:56:12.905760 (+   526us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":241795,"tablet-open.queue_time_us":27125491}
I20260928 01:56:13.515499 19896 ts_tablet_manager.cc:1434] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.192s	user 0.010s	sys 0.000s
W20260928 01:56:13.438086 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 105671us
I20260928 01:56:13.517659 20029 tablet_bootstrap.cc:492] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:13.518711 21806 consensus_queue.cc:1048] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:56:13.520551 19409 leader_election.cc:343] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:13.535483 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c6cfc9ff3344a48b09730dfde79d6cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.536842 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:35 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.537943 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 7daa1b799e0d408287edc03988f5b683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.539114 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 with delete_type TABLET_DATA_DELETED (replaced by tablet e43bec2c4274497ea73872d0db233eac) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.540078 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f with delete_type TABLET_DATA_DELETED (replaced by tablet 6546cfe6f3a6405fab41a4ebdcffb288) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.541117 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 7602706a3fbc438d8d448c9ac057087c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c6f4708c641414aa59f01703c86aaf1) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.541136 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:13.542062 19612 raft_consensus.cc:2393] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:13.544952 19896 tablet_bootstrap.cc:492] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:13.549130 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:13.549870 19619 raft_consensus.cc:2393] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:13.551787 19890 tablet_bootstrap.cc:654] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:13.563246 19890 tablet_bootstrap.cc:492] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:13.563766 19890 ts_tablet_manager.cc:1403] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.005s
I20260928 01:56:13.566372 19890 raft_consensus.cc:359] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.567250 19890 raft_consensus.cc:385] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:13.570144 19890 raft_consensus.cc:740] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
W20260928 01:56:13.570921 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 49008.4us
I20260928 01:56:13.570854 19890 consensus_queue.cc:260] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.572721 19890 ts_tablet_manager.cc:1434] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
W20260928 01:56:13.572583 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 160484us
I20260928 01:56:13.573500 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73835e2854976b40b31fe752d1b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.574561 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.575202 19890 tablet_bootstrap.cc:492] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:13.575513 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 12c7284250084d6299cafe8310cfd257 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c395a6a87f4927b10973720aa4d868) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.576465 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c61408724e4a70b39e5dbdab9a3e8a with delete_type TABLET_DATA_DELETED (replaced by tablet 8df69eb3a37445ed8a2be0ef3bf32cdb) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.577406 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 22fc9eff28c4436fb383c3d7169171bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:13.582005 19667 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:13.584798 19412 leader_election.cc:304] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:13.586228 21765 raft_consensus.cc:2749] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:13.594847 19594 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c61408724e4a70b39e5dbdab9a3e8a with delete_type TABLET_DATA_DELETED (replaced by tablet 8df69eb3a37445ed8a2be0ef3bf32cdb) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:13.607654 19890 tablet_bootstrap.cc:654] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:13.610296 19609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:13.622016 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 50453.7us
I20260928 01:56:13.636499 21808 raft_consensus.cc:493] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:13.637041 21808 raft_consensus.cc:515] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.638998 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:13.640486 21808 leader_election.cc:290] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:13.640607 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:13.641161 19759 raft_consensus.cc:2468] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:13.641433 21808 raft_consensus.cc:493] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:13.641855 21808 raft_consensus.cc:515] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.645354 21808 leader_election.cc:290] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:13.646430 21808 raft_consensus.cc:493] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:13.646874 21808 raft_consensus.cc:515] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:13.648906 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 58844.9us
I20260928 01:56:13.649940 19412 leader_election.cc:304] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:13.650682 21808 leader_election.cc:290] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:13.681018 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:13.684484 21765 raft_consensus.cc:2749] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:13.686813 19553 leader_election.cc:304] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:13.687623 21804 raft_consensus.cc:2804] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:13.688100 21804 raft_consensus.cc:697] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:13.688982 21804 consensus_queue.cc:237] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:13.693581 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ae3663fbe024a4e946e47339a4b9090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.694149 19896 tablet_bootstrap.cc:654] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:13.695083 19739 tablet_service.cc:1558] Processing DeleteTablet for tablet eac01fc222dd480cbed7cac37a0e6693 with delete_type TABLET_DATA_DELETED (replaced by tablet 522245da435b40ae84ae6dc5d19a2e95) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.695950 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ab79c6ad03e481a903a0f95ae0512e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:41 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.696805 19742 tablet_service.cc:1558] Processing DeleteTablet for tablet 158edf7a5d724c88992fecbadd2cedfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.697639 19743 tablet_service.cc:1558] Processing DeleteTablet for tablet e05925303152462e8ca25cd15f3bedff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.698479 19746 tablet_service.cc:1558] Processing DeleteTablet for tablet 7daa1b799e0d408287edc03988f5b683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.699267 19738 tablet_service.cc:1558] Processing DeleteTablet for tablet 57a81b9455a340728fea713318e1e77a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.700587 19742 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c6cfc9ff3344a48b09730dfde79d6cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.701386 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:35 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.702087 19739 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ca0b52215454a99b6c5d1956088829a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.702121 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:13.705287 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:13.705583 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:13.706976 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:13.714094 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
I20260928 01:56:13.735713 21881 ts_tablet_manager.cc:1929] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:13.738481 21808 raft_consensus.cc:493] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:13.739293 21808 raft_consensus.cc:515] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.641336 20029 tablet_bootstrap.cc:654] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:13.742350 21808 leader_election.cc:290] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:13.747593 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 22fc9eff28c4436fb383c3d7169171bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.749360 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5e07078b2a4fe59d9293d9511cbb6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.756408 21808 raft_consensus.cc:493] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:13.757057 21808 raft_consensus.cc:515] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.761106 21808 leader_election.cc:290] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:13.768136 21881 log.cc:1199] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/0ae3663fbe024a4e946e47339a4b9090
I20260928 01:56:13.767436 19890 tablet_bootstrap.cc:492] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
W20260928 01:56:13.740899 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 110683us
I20260928 01:56:13.749473 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:13.769886 19890 ts_tablet_manager.cc:1403] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.195s	user 0.013s	sys 0.000s
I20260928 01:56:13.770311 19461 raft_consensus.cc:2393] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
W20260928 01:56:13.771358 19553 leader_election.cc:343] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:13.772840 19890 raft_consensus.cc:359] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:13.773569 19890 raft_consensus.cc:385] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:56:13.736265 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 52003.7us
I20260928 01:56:13.774492 21808 raft_consensus.cc:493] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:13.774987 21808 raft_consensus.cc:515] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.774988 19553 leader_election.cc:304] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:13.777482 21867 raft_consensus.cc:2804] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:13.777838 21867 raft_consensus.cc:493] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:13.778163 21867 raft_consensus.cc:3060] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:13.781970 21804 raft_consensus.cc:493] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:13.783197 21804 raft_consensus.cc:515] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.785600 21909 tablet_replica.cc:333] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:13.786721 21867 raft_consensus.cc:515] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.773839 19890 raft_consensus.cc:740] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:13.803216 19522 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:13.824138 21806 raft_consensus.cc:493] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:13.825389 21806 raft_consensus.cc:515] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.814999 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:13.838984 19556 leader_election.cc:304] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:13.831019 19890 consensus_queue.cc:260] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:13.769533 21881 ts_tablet_manager.cc:1950] T 0ae3663fbe024a4e946e47339a4b9090 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:13.861981 21881 tablet_replica.cc:333] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:13.866276 21894 tablet_replica.cc:333] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:13.882332 21876 raft_consensus.cc:493] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:13.894304 21867 leader_election.cc:290] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:13.898331 21808 leader_election.cc:290] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:13.894711 21804 leader_election.cc:290] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:13.888754 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:13.918272 21803 raft_consensus.cc:2804] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:13.920600 21803 raft_consensus.cc:493] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:13.922201 21803 raft_consensus.cc:3060] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:13.925504 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.928834 19739 tablet_service.cc:1558] Processing DeleteTablet for tablet 7602706a3fbc438d8d448c9ac057087c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c6f4708c641414aa59f01703c86aaf1) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.851181 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:13.909929 21876 raft_consensus.cc:515] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:13.927479 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f with delete_type TABLET_DATA_DELETED (replaced by tablet 6546cfe6f3a6405fab41a4ebdcffb288) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.935192 21894 raft_consensus.cc:2243] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Raft consensus shutting down.
I20260928 01:56:13.937500 21894 raft_consensus.cc:2272] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:13.947232 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca443386942e49d9a66143e1fde777c5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:13.833752 21806 leader_election.cc:290] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:13.964274 19896 tablet_bootstrap.cc:492] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:13.966395 19896 ts_tablet_manager.cc:1403] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.422s	user 0.014s	sys 0.002s
W20260928 01:56:13.949463 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 110604us
I20260928 01:56:13.955910 21922 raft_consensus.cc:493] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:13.992489 21922 raft_consensus.cc:515] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:13.997256 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:14.000021 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:14.006090 19890 ts_tablet_manager.cc:1434] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.236s	user 0.015s	sys 0.003s
I20260928 01:56:13.981421 21881 raft_consensus.cc:2243] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:56:13.975463 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:14.013607 19890 tablet_bootstrap.cc:492] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:14.024331 21922 leader_election.cc:290] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:14.030223 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:56:14.033461 20456 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.613s (SENT) [suppressed 1 similar messages]
I20260928 01:56:14.034693 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c61408724e4a70b39e5dbdab9a3e8a with delete_type TABLET_DATA_DELETED (replaced by tablet 8df69eb3a37445ed8a2be0ef3bf32cdb) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:14.032013 19758 raft_consensus.cc:3060] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 2
I20260928 01:56:14.042097 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet 12c7284250084d6299cafe8310cfd257 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c395a6a87f4927b10973720aa4d868) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:14.040113 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73835e2854976b40b31fe752d1b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:14.062851 21894 ts_tablet_manager.cc:1916] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:14.066681 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:14.049166 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 with delete_type TABLET_DATA_DELETED (replaced by tablet e43bec2c4274497ea73872d0db233eac) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:13.953869 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:14.130265 21876 leader_election.cc:290] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:14.109020 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82d3233e4514813b22121f75d11eebc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:14.125018 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ab79c6ad03e481a903a0f95ae0512e6" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:14.165340 19179 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e43bec2c4274497ea73872d0db233eac consensus state has no leader
I20260928 01:56:14.167744 21922 raft_consensus.cc:493] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:14.169600 21922 raft_consensus.cc:515] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:14.206591 20029 tablet_bootstrap.cc:492] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:14.168183 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:56:14.218421 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:14.226107 19553 leader_election.cc:304] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:14.234381 19758 raft_consensus.cc:2468] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:14.236613 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:14.250973 20029 ts_tablet_manager.cc:1403] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.733s	user 0.015s	sys 0.015s
I20260928 01:56:14.253960 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
W20260928 01:56:14.277591 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 43612.2us
W20260928 01:56:14.317773 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 91838us
I20260928 01:56:14.281769 19184 catalog_manager.cc:5838] T 7441c2d1a7fa4dc8a89c6717a80d3efb P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
W20260928 01:56:14.321415 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 333698us
I20260928 01:56:14.334671 21909 raft_consensus.cc:2243] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
W20260928 01:56:14.328100 19556 leader_election.cc:343] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 57a81b9455a340728fea713318e1e77a
W20260928 01:56:14.362129 19410 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:14.364081 19556 leader_election.cc:304] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:14.373951 21927 log.cc:927] Time spent T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.142s	user 0.000s	sys 0.002s
I20260928 01:56:14.389858 21929 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:14.407884 21923 raft_consensus.cc:2804] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:14.409611 21923 raft_consensus.cc:493] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:14.409986 21923 raft_consensus.cc:3060] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:14.391832 21929 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:14.509865 21909 raft_consensus.cc:2272] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:14.509974 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
W20260928 01:56:14.528740 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 203872us
I20260928 01:56:14.546325 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:14.510919 21808 raft_consensus.cc:493] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:14.561195 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:14.528865 21935 raft_consensus.cc:2749] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:14.566232 20029 raft_consensus.cc:359] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:14.569585 20029 raft_consensus.cc:385] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:14.572633 20029 raft_consensus.cc:740] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
W20260928 01:56:14.566203 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 286784us
W20260928 01:56:14.554862 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 226969us
I20260928 01:56:14.589461 19556 leader_election.cc:304] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:14.590988 21881 raft_consensus.cc:2272] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:14.575045 20029 consensus_queue.cc:260] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:14.614964 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:14.622946 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:56:14.600400 19896 raft_consensus.cc:359] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:14.630954 19896 raft_consensus.cc:385] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:14.634209 21929 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:14.231388 21803 raft_consensus.cc:515] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:14.647316 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 70026.9us
I20260928 01:56:14.653863 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:14.657357 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:14.667145 19475 raft_consensus.cc:2393] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:14.557154 21922 leader_election.cc:290] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:14.662966 21929 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260928 01:56:14.671377 19104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 48728.2us
I20260928 01:56:14.690670 21909 ts_tablet_manager.cc:1916] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:14.697867 20456 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.613s (SENT)
I20260928 01:56:14.700682 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
W20260928 01:56:14.715330 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 65310.7us
I20260928 01:56:14.734592 21806 raft_consensus.cc:493] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:14.743084 21806 raft_consensus.cc:515] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:14.633746 19896 raft_consensus.cc:740] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:14.749522 21945 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260928 01:56:14.750957 20456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 53317.8us
I20260928 01:56:14.556167 21808 raft_consensus.cc:515] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:14.805955 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:14.775580 20029 ts_tablet_manager.cc:1434] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.523s	user 0.018s	sys 0.005s
W20260928 01:56:14.825093 20029 ts_tablet_manager.cc:1467] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da: Tablet startup took 572ms
W20260928 01:56:14.840273 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 240685us
I20260928 01:56:14.866707 19890 tablet_bootstrap.cc:700] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0: Time spent opening tablet: real 0.106s	user 0.004s	sys 0.000s
W20260928 01:56:14.870867 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 108108us
I20260928 01:56:14.887986 19890 tablet_bootstrap.cc:654] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:14.752727 21935 raft_consensus.cc:2804] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:14.942289 21881 ts_tablet_manager.cc:1916] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:14.971448 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:56:14.828542 20029 ts_tablet_manager.cc:1469] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da: Trace:
0928 01:55:44.758276 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.759854 (+  1578us) service_pool.cc:224] Handling call
0928 01:55:44.783119 (+ 23265us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b5800000f98. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a19fae8a1 00007f0a1a0f2b51 00007f0a1a0f3182 00007f0a230662c9 00007f0a22277918 00007f0a2233a1b0 00007f0a222e8640 00007f0a20872bf4 00007f0a20872b82 00007f0a20872ab1 00007f0a20872a2c
0928 01:55:44.786793 (+  3674us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:44.786883 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:44.816485 (+ 29602us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.829370 (+ 12885us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:44.829813 (+   443us) inbound_call.cc:177] Queueing success response
0928 01:56:13.517345 (+28687532us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0928 01:56:14.252752 (+735407us) ts_tablet_manager.cc:1435] Starting tablet replica
0928 01:56:14.327955 (+ 75203us) tablet_replica.cc:261] Starting instrumentation
0928 01:56:14.330063 (+  2108us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":343268,"raft.queue_time_us":167556,"raft.run_cpu_time_us":785,"raft.run_wall_time_us":784,"spinlock_wait_cycles":14384128,"tablet-open.queue_time_us":28687589}
W20260928 01:56:14.981491 19464 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.013s
I20260928 01:56:14.919287 21935 raft_consensus.cc:493] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:14.958858 21934 raft_consensus.cc:493] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
W20260928 01:56:15.017448 19464 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.006s	sys 0.014s
I20260928 01:56:14.905120 19896 consensus_queue.cc:260] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:15.042958 21942 raft_consensus.cc:493] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:15.015552 21935 raft_consensus.cc:3060] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:15.031402 19612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.001s	sys 0.021s
W20260928 01:56:15.062465 19612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.002s	sys 0.022s
I20260928 01:56:15.044895 21942 raft_consensus.cc:515] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:15.103173 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 128810us
I20260928 01:56:15.092288 21803 leader_election.cc:290] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:15.121866 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 129905us
I20260928 01:56:15.141717 21860 raft_consensus.cc:493] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:15.082441 21940 raft_consensus.cc:493] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:15.142295 21933 raft_consensus.cc:493] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:15.120947 21804 raft_consensus.cc:493] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:15.046226 21934 raft_consensus.cc:515] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.178476 21806 leader_election.cc:290] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:15.169854 21947 raft_consensus.cc:493] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:15.181073 21933 raft_consensus.cc:515] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:15.205233 21853 raft_consensus.cc:493] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.164915 21804 raft_consensus.cc:515] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.166158 21860 raft_consensus.cc:515] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:15.149302 21808 leader_election.cc:290] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:15.233631 21948 raft_consensus.cc:493] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
W20260928 01:56:15.238688 19179 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e43bec2c4274497ea73872d0db233eac consensus state has no leader
I20260928 01:56:15.208141 21853 raft_consensus.cc:515] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.209636 19896 ts_tablet_manager.cc:1434] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 1.213s	user 0.024s	sys 0.005s
W20260928 01:56:15.246727 19896 ts_tablet_manager.cc:1467] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614: Tablet startup took 1249ms
I20260928 01:56:15.263710 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
W20260928 01:56:15.248328 19896 ts_tablet_manager.cc:1469] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614: Trace:
0928 01:56:05.669531 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:05.669648 (+   117us) service_pool.cc:224] Handling call
0928 01:56:05.670965 (+  1317us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:56:05.671042 (+    77us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:56:05.699789 (+ 28747us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:05.780401 (+ 80612us) tablet_replica.cc:206] Creating consensus instance
0928 01:56:05.780827 (+   426us) inbound_call.cc:177] Queueing success response
0928 01:56:13.544608 (+7763781us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0928 01:56:13.996968 (+452360us) ts_tablet_manager.cc:1435] Starting tablet replica
0928 01:56:13.998298 (+  1330us) tablet_replica.cc:261] Starting instrumentation
0928 01:56:13.999535 (+  1237us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":54959,"raft.queue_time_us":155842,"raft.run_cpu_time_us":1965,"raft.run_wall_time_us":43365,"spinlock_wait_cycles":291814272,"tablet-open.queue_time_us":7763858}
I20260928 01:56:15.219038 21947 raft_consensus.cc:515] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:15.256598 19556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.001s	sys 0.013s
W20260928 01:56:15.296286 19556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.002s	sys 0.013s
W20260928 01:56:15.299454 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 710160us
W20260928 01:56:15.257620 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 127869us
I20260928 01:56:15.318413 19896 tablet_bootstrap.cc:492] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:15.325554 21939 raft_consensus.cc:493] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:15.330350 21860 leader_election.cc:290] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:15.162671 21940 raft_consensus.cc:515] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.353550 21947 leader_election.cc:290] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:15.355335 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 0ae3663fbe024a4e946e47339a4b9090 (table default.Table_fa2cc70b96124fedb7f77c2fd58c9d89 [id=90e10f23ac7f4af489416a55f3287681]) successfully deleted
I20260928 01:56:15.270226 19609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.3:54107 (request call id 1151) took 1077 ms. Trace:
I20260928 01:56:15.343231 21853 leader_election.cc:290] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:15.343044 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:15.400573 19757 raft_consensus.cc:2468] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:15.402940 19612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.3:54107 (request call id 1150) took 1211 ms. Trace:
W20260928 01:56:15.362857 21952 log.cc:927] Time spent T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260928 01:56:15.348361 21933 leader_election.cc:290] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:15.442167 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:15.381033 21849 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
W20260928 01:56:15.430639 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 128324us
I20260928 01:56:15.328084 21939 raft_consensus.cc:515] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:15.461094 21849 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:15.478156 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 364716us
W20260928 01:56:15.480587 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 106473us
I20260928 01:56:15.475620 21860 raft_consensus.cc:493] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.485263 21950 raft_consensus.cc:493] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.368876 21948 raft_consensus.cc:515] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:15.483419 21860 raft_consensus.cc:515] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.365528 19609 rpcz_store.cc:276] 0928 01:56:14.192695 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:14.228492 (+ 35797us) service_pool.cc:224] Handling call
0928 01:56:14.230316 (+  1824us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 01:56:14.231456 (+  1140us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 01:56:14.231805 (+   349us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 01:56:14.304481 (+ 72676us) alter_schema_op.cc:128] START. Timestamp: 1790560573652075
0928 01:56:14.444921 (+140440us) log.cc:844] Serialized 173 byte log entry
0928 01:56:15.050843 (+605922us) raft_consensus.cc:1645] Marking committed up to 1
0928 01:56:15.059462 (+  8619us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:56:15.059963 (+   501us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:56:15.229134 (+169171us) raft_consensus.cc:1685] finished
0928 01:56:15.236928 (+  7794us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:56:15.252607 (+ 15679us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:14.422803 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:14.441340 (+ 18537us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:14.441524 (+   184us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:14.441683 (+   159us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
Metrics: {"thread_start_us":447765,"threads_started":1,"wal-append.queue_time_us":582449,"child_traces":[["op",{"prepare.queue_time_us":1160,"prepare.run_cpu_time_us":2956,"prepare.run_wall_time_us":19161}]]}
I20260928 01:56:15.487023 21950 raft_consensus.cc:515] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.476006 21853 raft_consensus.cc:493] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:15.518652 21860 leader_election.cc:290] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:15.524502 20029 tablet_bootstrap.cc:492] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:56:15.522469 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 66549.5us
I20260928 01:56:15.532971 21939 leader_election.cc:290] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:15.475618 21953 raft_consensus.cc:493] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.536718 21860 raft_consensus.cc:493] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.526027 21853 raft_consensus.cc:515] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:15.551100 21853 leader_election.cc:290] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:15.577662 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:15.554661 21950 leader_election.cc:290] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:15.538398 21860 raft_consensus.cc:515] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.575728 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:15.579073 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:15.536826 21953 raft_consensus.cc:515] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.619485 19461 raft_consensus.cc:2468] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:15.597821 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:15.601472 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:15.603606 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:56:15.624173 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 213057us
I20260928 01:56:15.625191 21860 leader_election.cc:290] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:15.628646 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:15.636858 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:15.547750 21849 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:15.549523 19703 leader_election.cc:304] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:15.606329 19410 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260928 01:56:15.672657 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 123226us
I20260928 01:56:15.385861 21942 leader_election.cc:290] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:15.574926 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 121525us
I20260928 01:56:15.426407 21804 leader_election.cc:290] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:15.568867 21947 raft_consensus.cc:493] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:15.692830 21947 raft_consensus.cc:515] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.565475 21867 raft_consensus.cc:493] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:15.397840 21934 leader_election.cc:290] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:15.404695 19612 rpcz_store.cc:276] 0928 01:56:14.191243 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:14.191368 (+   125us) service_pool.cc:224] Handling call
0928 01:56:14.191774 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 01:56:14.192072 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 01:56:14.192104 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 01:56:14.225487 (+ 33383us) alter_schema_op.cc:128] START. Timestamp: 1790560573663538
0928 01:56:14.259193 (+ 33706us) log.cc:844] Serialized 173 byte log entry
0928 01:56:15.075217 (+816024us) raft_consensus.cc:1645] Marking committed up to 1
0928 01:56:15.075457 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:56:15.075818 (+   361us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:56:15.335108 (+259290us) raft_consensus.cc:1685] finished
0928 01:56:15.335131 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:56:15.402842 (+ 67711us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:14.227499 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:14.228684 (+  1185us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:14.228764 (+    80us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:14.228813 (+    49us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
Metrics: {"thread_start_us":772800,"threads_started":1,"wal-append.queue_time_us":834684,"child_traces":[["op",{"prepare.queue_time_us":911,"prepare.run_cpu_time_us":1519,"prepare.run_wall_time_us":1519}]]}
I20260928 01:56:15.700717 19896 tablet_bootstrap.cc:654] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:15.697180 21867 raft_consensus.cc:515] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:15.622480 21935 consensus_meta.cc:287] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.014s
I20260928 01:56:15.703215 21935 raft_consensus.cc:515] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:15.705127 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca443386942e49d9a66143e1fde777c5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:15.640074 21953 leader_election.cc:290] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:15.714573 21867 leader_election.cc:290] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:15.716293 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:15.722544 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82d3233e4514813b22121f75d11eebc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:15.723693 21860 raft_consensus.cc:493] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.645879 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:15.735354 21934 raft_consensus.cc:493] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:15.714167 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:15.736828 21934 raft_consensus.cc:515] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.726207 21860 raft_consensus.cc:515] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.637878 21940 leader_election.cc:290] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:15.743945 21934 leader_election.cc:290] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:15.750267 21961 raft_consensus.cc:493] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
W20260928 01:56:15.751333 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 98191.1us
W20260928 01:56:15.751480 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 76622.6us
I20260928 01:56:15.755692 21858 raft_consensus.cc:3060] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:15.751436 21961 raft_consensus.cc:515] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.757047 21860 leader_election.cc:290] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:15.764456 21877 raft_consensus.cc:493] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:15.765358 21877 raft_consensus.cc:515] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:15.771551 21849 raft_consensus.cc:493] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:15.635957 19890 tablet_bootstrap.cc:492] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:15.716821 21947 leader_election.cc:290] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:15.730705 21803 raft_consensus.cc:493] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:15.783820 21960 raft_consensus.cc:493] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.785837 21961 leader_election.cc:290] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:15.732057 21922 raft_consensus.cc:493] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:15.780642 21806 raft_consensus.cc:493] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.789100 21922 raft_consensus.cc:515] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.784592 21803 raft_consensus.cc:515] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.791934 21806 raft_consensus.cc:515] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.802516 21922 leader_election.cc:290] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:15.807083 21953 raft_consensus.cc:493] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.809544 21803 leader_election.cc:290] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:15.807796 21953 raft_consensus.cc:515] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:15.814962 19890 ts_tablet_manager.cc:1403] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 1.802s	user 0.041s	sys 0.011s
W20260928 01:56:15.758695 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 65956.1us
W20260928 01:56:15.828768 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 176483us
I20260928 01:56:15.834147 19553 leader_election.cc:304] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:15.781795 21849 raft_consensus.cc:515] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.825446 21964 raft_consensus.cc:493] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.768105 21877 leader_election.cc:290] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:15.861882 21938 raft_consensus.cc:493] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
W20260928 01:56:15.870826 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 117382us
I20260928 01:56:15.828123 21961 raft_consensus.cc:493] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.828024 21950 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.786931 21960 raft_consensus.cc:515] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:15.886031 21950 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:15.856915 21964 raft_consensus.cc:515] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:15.643718 21923 consensus_meta.cc:287] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 1.231s	user 0.026s	sys 0.007s
I20260928 01:56:15.895714 19896 tablet_bootstrap.cc:492] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:15.894819 21923 raft_consensus.cc:515] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.896328 21961 raft_consensus.cc:515] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.682253 21948 leader_election.cc:290] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:15.901500 21853 raft_consensus.cc:493] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.902277 21853 raft_consensus.cc:515] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:15.911015 21964 leader_election.cc:290] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:15.919474 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 166049us
I20260928 01:56:15.902637 21938 raft_consensus.cc:515] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:15.928704 21849 leader_election.cc:290] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:15.945086 19758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.1:45657 (request call id 615) took 1143 ms. Trace:
I20260928 01:56:15.896301 19896 ts_tablet_manager.cc:1403] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.579s	user 0.029s	sys 0.010s
I20260928 01:56:15.929486 21950 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:15.959964 21939 raft_consensus.cc:493] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:15.928087 21853 leader_election.cc:290] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:15.965701 21960 leader_election.cc:290] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:15.819456 19556 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
I20260928 01:56:15.935487 21961 leader_election.cc:290] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:15.970463 21862 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.971535 19556 leader_election.cc:304] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:15.989223 21961 raft_consensus.cc:493] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:15.944085 21876 raft_consensus.cc:493] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:15.998538 21876 raft_consensus.cc:515] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:15.845129 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
I20260928 01:56:15.887117 21967 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:16.014549 21953 leader_election.cc:290] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:15.962656 21939 raft_consensus.cc:515] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.010713 21938 leader_election.cc:290] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:15.994634 21935 leader_election.cc:290] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:16.057076 19814 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
W20260928 01:56:16.057374 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 151362us
W20260928 01:56:16.058527 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 136817us
I20260928 01:56:16.062065 19890 raft_consensus.cc:359] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.062793 19890 raft_consensus.cc:385] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:16.063073 19890 raft_consensus.cc:740] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:16.070178 19703 leader_election.cc:304] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:16.071223 21937 raft_consensus.cc:2749] T 043ddb5b0b0e4ad0b30d2927d37971fb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:16.071502 19703 leader_election.cc:304] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:16.013291 21862 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.073668 21862 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.074208 21937 raft_consensus.cc:2749] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:16.018512 21806 leader_election.cc:290] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:16.010085 21967 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:16.084182 21967 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:15.990960 21961 raft_consensus.cc:515] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.050175 21960 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.053478 21853 raft_consensus.cc:493] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.055954 21950 raft_consensus.cc:493] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.056617 21964 raft_consensus.cc:493] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.087090 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 356 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:16.088548 19896 raft_consensus.cc:359] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.089968 19896 raft_consensus.cc:385] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:16.090334 19896 raft_consensus.cc:740] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:16.091080 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b836e20d6b43cba8eaa08887afb076" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.091683 21964 raft_consensus.cc:515] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.093655 21964 leader_election.cc:290] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.076849 21939 leader_election.cc:290] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.091305 21950 raft_consensus.cc:515] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.097878 21950 leader_election.cc:290] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.089138 21853 raft_consensus.cc:515] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.098457 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:16.099498 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 280101us
I20260928 01:56:16.100231 21853 leader_election.cc:290] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.100804 21960 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:16.101773 21956 raft_consensus.cc:493] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:16.102272 21956 raft_consensus.cc:515] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.102818 21960 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:16.104641 21961 leader_election.cc:290] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.108440 21806 raft_consensus.cc:493] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.109100 21806 raft_consensus.cc:515] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.109653 21923 leader_election.cc:290] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.110599 21964 raft_consensus.cc:493] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:16.111145 21964 raft_consensus.cc:515] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.112315 21876 leader_election.cc:290] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.113729 21962 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.114257 21962 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.116259 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea6adefd15a4ea19011419949047e83" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.117475 21962 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.119091 21964 leader_election.cc:290] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.121223 19609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:16.121960 19609 raft_consensus.cc:2468] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:16.125262 21806 leader_election.cc:290] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.126348 19896 consensus_queue.cc:260] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.128154 19896 ts_tablet_manager.cc:1434] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.161s	user 0.013s	sys 0.000s
I20260928 01:56:16.129231 19896 tablet_bootstrap.cc:492] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:16.130375 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897503329be649e38473561cea1fdaf1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.130654 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daa1b799e0d408287edc03988f5b683" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.130273 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.132987 21956 leader_election.cc:290] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.142799 19556 leader_election.cc:304] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:16.143949 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c320eb2ca2ac4ac68293ef8f7400b45f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.144677 21975 tablet.cc:1751] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:16.146153 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.129997 21962 raft_consensus.cc:493] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.147475 21962 raft_consensus.cc:515] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.132790 21860 raft_consensus.cc:493] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.150097 21860 raft_consensus.cc:515] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.132915 21953 raft_consensus.cc:493] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:15.947391 19758 rpcz_store.cc:276] 0928 01:56:14.802313 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:14.802948 (+   635us) service_pool.cc:224] Handling call
0928 01:56:14.804580 (+  1632us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 01:56:14.806276 (+  1696us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 01:56:14.806469 (+   193us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 01:56:15.535197 (+728728us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b2c00004d28. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a20498c91 00007f0a204a85f2 00007f0a212c81c1 00007f0a2128cbfa 00007f0a2128bffe 00007f0a222ec659 00007f0a20968d34 00007f0a20968cc2 00007f0a20968bf1 00007f0a20968b6c 00007f0a20967e22
0928 01:56:15.536732 (+  1535us) log.cc:844] Serialized 26 byte log entry
0928 01:56:15.761037 (+224305us) raft_consensus.cc:1645] Marking committed up to 0
0928 01:56:15.852347 (+ 91310us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:56:15.902697 (+ 50350us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:56:15.914237 (+ 11540us) raft_consensus.cc:1685] finished
0928 01:56:15.914353 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:56:15.944650 (+ 30297us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2569,"raft.run_cpu_time_us":932,"raft.run_wall_time_us":948,"spinlock_wait_cycles":1162430848,"thread_start_us":213915,"threads_started":1,"wal-append.queue_time_us":227994}
I20260928 01:56:16.152557 21953 raft_consensus.cc:515] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.153412 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.154660 21953 leader_election.cc:290] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.134109 21960 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.155201 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.008179 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:16.155694 21960 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.157719 21960 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.158483 21860 leader_election.cc:290] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.158511 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.159261 21858 raft_consensus.cc:2749] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:16.159688 21962 leader_election.cc:290] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.136989 19409 leader_election.cc:304] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:16.160542 21962 raft_consensus.cc:2804] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:16.160897 21962 raft_consensus.cc:493] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:16.161283 21962 raft_consensus.cc:3060] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:16.166988 21960 raft_consensus.cc:493] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.167600 21960 raft_consensus.cc:515] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:16.167996 19412 leader_election.cc:343] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:16.168465 19412 leader_election.cc:304] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:16.169160 21853 raft_consensus.cc:493] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:16.169651 21853 raft_consensus.cc:515] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.171358 21860 raft_consensus.cc:493] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:16.171823 21853 leader_election.cc:290] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.172052 21860 raft_consensus.cc:515] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.173357 21960 leader_election.cc:290] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.174711 21860 leader_election.cc:290] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.176549 21950 raft_consensus.cc:493] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:16.177966 21950 raft_consensus.cc:515] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.180573 21950 leader_election.cc:290] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.175969 21961 raft_consensus.cc:2749] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:16.174722 21853 raft_consensus.cc:493] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:16.181799 21853 raft_consensus.cc:515] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.184168 21853 leader_election.cc:290] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:16.184846 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 47977.8us
I20260928 01:56:16.187501 21808 raft_consensus.cc:2749] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:16.140344 21881 ts_tablet_manager.cc:1929] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:16.188767 21881 log.cc:1199] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/7ab79c6ad03e481a903a0f95ae0512e6
I20260928 01:56:16.188879 21808 raft_consensus.cc:2804] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:16.189370 21808 raft_consensus.cc:697] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:16.189971 21881 ts_tablet_manager.cc:1950] T 7ab79c6ad03e481a903a0f95ae0512e6 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:16.190346 21808 consensus_queue.cc:237] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.198576 21947 raft_consensus.cc:2804] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:16.199179 21947 raft_consensus.cc:697] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:16.200343 21947 consensus_queue.cc:237] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.206280 19896 tablet_bootstrap.cc:654] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
W20260928 01:56:16.206341 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 372651us
W20260928 01:56:16.207129 19553 leader_election.cc:343] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:16.230353 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 60187.3us
I20260928 01:56:16.063705 19890 consensus_queue.cc:260] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.234416 19890 ts_tablet_manager.cc:1434] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.417s	user 0.008s	sys 0.001s
I20260928 01:56:16.235427 19890 tablet_bootstrap.cc:492] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:16.238773 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:16.248351 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 15) took 2992 ms. Trace:
I20260928 01:56:16.248802 21881 rpcz_store.cc:276] 0928 01:56:13.255548 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.257029 (+  1481us) service_pool.cc:224] Handling call
0928 01:56:13.860864 (+603835us) ts_tablet_manager.cc:1151] Deleting tablet 7ab79c6ad03e481a903a0f95ae0512e6
0928 01:56:13.861199 (+   335us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:15.917225 (+2056026us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:16.140134 (+222909us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:16.248245 (+108111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":585663,"tablet-delete.queue_time_us":602679}
I20260928 01:56:16.249863 21894 ts_tablet_manager.cc:1929] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260928 01:56:16.250397 21894 log.cc:1199] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:16.250880 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 7ab79c6ad03e481a903a0f95ae0512e6 (table default.Table_501342eaebce40d1a76ace4b05f022fd [id=f5f0643fe0534f2e82e105f01832931f]) successfully deleted
I20260928 01:56:16.251674 21894 ts_tablet_manager.cc:1950] T 58c61408724e4a70b39e5dbdab9a3e8a P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:16.252813 21881 tablet_replica.cc:333] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:16.254518 21894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 14) took 2660 ms. Trace:
I20260928 01:56:16.263980 21853 raft_consensus.cc:493] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:16.264592 21853 raft_consensus.cc:515] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:16.266494 19409 leader_election.cc:343] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:16.267692 19409 leader_election.cc:343] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:16.271907 21853 leader_election.cc:290] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:16.277056 21962 raft_consensus.cc:515] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.160421 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.161965 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.301666 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b795606604960bc7cafab4ff6f3d0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:16.302418 19757 raft_consensus.cc:3060] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:16.303184 21962 leader_election.cc:290] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:16.162293 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.162803 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.171036 19761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.1:45657 (request call id 614) took 1370 ms. Trace:
I20260928 01:56:16.172276 20029 tablet_bootstrap.cc:700] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent opening tablet: real 0.138s	user 0.003s	sys 0.000s
I20260928 01:56:16.305485 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d114d5ba862044b4b88eee27395db7e3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.306743 20029 tablet_bootstrap.cc:654] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:16.172127 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5e07078b2a4fe59d9293d9511cbb6b" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.174834 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.187899 21956 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.199115 19704 leader_election.cc:304] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:16.202812 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3505a502bff747deaf1e03c03375aafa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.203334 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.205812 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.205844 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fc9eff28c4436fb383c3d7169171bb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:16.311116 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 112457us
I20260928 01:56:16.208068 19767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376b5a87b07b4f87a2a502b5fa1b23f8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.210078 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.211954 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555e557370a4e92915a9c55107b573b" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.213920 19754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.216180 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.217921 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b222e5366a64f52bc97acd551c7a067" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.219094 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.219622 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab12ba3e1f542949e3f203dae0fa80e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.221570 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12bafcc09ef4342bff89b0475f721af" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.222978 21976 tablet.cc:1751] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
W20260928 01:56:16.242134 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 168214us
I20260928 01:56:16.299913 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3b9ec9f88342c0aa77c0fc92d26205" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.317433 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.319080 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.328670 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:16.328846 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:16.330401 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:16.331135 19471 raft_consensus.cc:2468] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:16.332463 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.333900 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.338564 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:16.343956 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:16.344789 19464 raft_consensus.cc:2468] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:16.353281 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:16.354115 19464 raft_consensus.cc:2468] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:16.356597 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:16.356920 21894 rpcz_store.cc:276] 0928 01:56:13.594343 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.594485 (+   142us) service_pool.cc:224] Handling call
0928 01:56:13.730795 (+136310us) ts_tablet_manager.cc:1151] Deleting tablet 58c61408724e4a70b39e5dbdab9a3e8a
0928 01:56:13.753004 (+ 22209us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b5800000f98. stack: 00007fd5309ed323 00007fd5309ed220 00007fd530591574 0000000000516964 00000000005168f9 00007fd5308a38a1 00007fd5309e7b51 00007fd5309e8182 00007fd53995b2c9 00007fd538b6c918 00007fd538c332c9 00007fd538c338c3 00007fd538c64960 00007fd538c4ae6d 00007fd538c4ae19 00007fd538c4ada9
0928 01:56:13.865446 (+112442us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:15.176059 (+1310613us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:16.249640 (+1073581us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:16.254413 (+  4773us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46143360,"tablet-delete.queue_time_us":135295,"thread_start_us":136996,"threads_started":1}
I20260928 01:56:16.365274 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:16.373026 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b795606604960bc7cafab4ff6f3d0" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:16.375021 19464 raft_consensus.cc:2468] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:16.305460 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1710b95678440b1bff8a92080d43272" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.386052 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b520e89c364692af1aedde2a59c3da" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.307682 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:16.408007 19409 leader_election.cc:343] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:16.411744 21961 raft_consensus.cc:493] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:16.413406 21961 raft_consensus.cc:515] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.331499 21956 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.415805 21961 leader_election.cc:290] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:16.413533 21973 raft_consensus.cc:2804] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:16.396649 19751 raft_consensus.cc:2468] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:16.424760 21881 raft_consensus.cc:2243] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:16.426250 21973 raft_consensus.cc:493] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:16.305617 19761 rpcz_store.cc:276] 0928 01:56:14.801125 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:14.804705 (+  3580us) service_pool.cc:224] Handling call
0928 01:56:14.806505 (+  1800us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 01:56:14.807433 (+   928us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 01:56:14.807544 (+   111us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 01:56:15.089263 (+281719us) alter_schema_op.cc:128] START. Timestamp: 1790560573262738
0928 01:56:15.942672 (+853409us) log.cc:844] Serialized 173 byte log entry
0928 01:56:16.078795 (+136123us) raft_consensus.cc:1645] Marking committed up to 1
0928 01:56:16.078848 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:56:16.078931 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:56:16.170773 (+ 91842us) raft_consensus.cc:1685] finished
0928 01:56:16.170789 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:56:16.170918 (+   129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:15.767874 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:15.768386 (+   512us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:15.768432 (+    46us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:15.768540 (+   108us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
Metrics: {"thread_start_us":134919,"threads_started":1,"wal-append.queue_time_us":79073,"child_traces":[["op",{"prepare.queue_time_us":452771,"prepare.run_cpu_time_us":745,"prepare.run_wall_time_us":744,"thread_start_us":344263,"threads_started":1}]]}
I20260928 01:56:16.451488 21956 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.452421 19766 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:16.439162 21973 raft_consensus.cc:3060] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:16.468719 21877 raft_consensus.cc:493] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.469662 21881 raft_consensus.cc:2272] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:16.469357 21877 raft_consensus.cc:515] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.471671 21877 leader_election.cc:290] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.472735 21881 ts_tablet_manager.cc:1916] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:16.473912 21974 raft_consensus.cc:493] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.474581 21974 raft_consensus.cc:515] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:16.476955 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 58018.4us
I20260928 01:56:16.479472 21972 raft_consensus.cc:493] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.419063 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602706a3fbc438d8d448c9ac057087c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.480118 21972 raft_consensus.cc:515] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.487367 21972 leader_election.cc:290] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.500383 21974 leader_election.cc:290] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:16.523283 19409 leader_election.cc:343] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:16.539978 21934 raft_consensus.cc:493] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:16.540699 21934 raft_consensus.cc:515] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.543000 21934 leader_election.cc:290] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.543954 21923 raft_consensus.cc:493] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:16.544497 21923 raft_consensus.cc:515] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.547055 21923 leader_election.cc:290] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.547621 21923 raft_consensus.cc:493] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:16.548699 21935 raft_consensus.cc:493] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:16.549688 21935 raft_consensus.cc:515] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.551715 21935 leader_election.cc:290] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.548806 21803 raft_consensus.cc:493] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:16.552695 21803 raft_consensus.cc:515] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.554780 21803 leader_election.cc:290] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.555104 21973 raft_consensus.cc:515] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.548177 21923 raft_consensus.cc:515] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.557615 21923 leader_election.cc:290] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:16.579070 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 53691.4us
W20260928 01:56:16.582842 19409 leader_election.cc:343] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:16.583580 19409 leader_election.cc:343] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:16.588413 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:16.633200 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:16.633903 19620 raft_consensus.cc:2468] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
W20260928 01:56:16.638092 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 53915.5us
W20260928 01:56:16.640039 19409 leader_election.cc:343] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:16.640998 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.643231 19409 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:16.657444 19896 tablet_bootstrap.cc:492] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:16.657963 19896 ts_tablet_manager.cc:1403] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.529s	user 0.066s	sys 0.073s
I20260928 01:56:16.661540 21881 ts_tablet_manager.cc:1929] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:16.662652 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8d07b367b4fafbd7171f8ea7b2a26" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.666999 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22606f012f1c44bd92c8e0341e9ca2b7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.662645 21953 raft_consensus.cc:2804] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:16.667740 21953 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.668111 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287060a8d054b15b2252dcf280ca8c2" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.668167 21953 raft_consensus.cc:3060] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:16.668743 19896 raft_consensus.cc:359] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.669373 19896 raft_consensus.cc:385] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:16.669618 19896 raft_consensus.cc:740] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:16.670503 19896 consensus_queue.cc:260] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.673578 19896 ts_tablet_manager.cc:1434] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260928 01:56:16.674786 19896 tablet_bootstrap.cc:492] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:16.676720 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05925303152462e8ca25cd15f3bedff" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.676682 21953 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.678507 19754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:16.679593 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.681357 21953 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.688653 21999 tablet.cc:1751] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:16.694574 21997 tablet.cc:1751] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 3
I20260928 01:56:16.702142 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:16.698119 19754 raft_consensus.cc:3060] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:16.704351 19896 tablet_bootstrap.cc:654] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:16.706168 21938 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.706785 21938 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:16.709012 21938 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.714988 19754 raft_consensus.cc:2468] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:16.663475 19409 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:56:16.718567 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 55176.8us
I20260928 01:56:16.718672 21953 raft_consensus.cc:2804] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:16.719152 21953 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.719573 21953 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:16.723486 21881 log.cc:1199] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/eac01fc222dd480cbed7cac37a0e6693
I20260928 01:56:16.724496 21881 ts_tablet_manager.cc:1950] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:16.726395 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 13) took 3471 ms. Trace:
I20260928 01:56:16.741833 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
I20260928 01:56:16.743186 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:16.552037 19757 raft_consensus.cc:2468] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:16.756006 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.757817 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:16.758617 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.710037 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.748996 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555e557370a4e92915a9c55107b573b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:16.785359 19766 raft_consensus.cc:2393] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 2: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
W20260928 01:56:16.749817 21976 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.333s	user 0.005s	sys 0.007s
I20260928 01:56:16.798705 21972 raft_consensus.cc:493] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.799736 21972 raft_consensus.cc:515] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.802107 21972 leader_election.cc:290] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.792224 21862 raft_consensus.cc:493] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.767208 21938 raft_consensus.cc:493] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
W20260928 01:56:16.810355 21922 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.062s	sys 0.094s
W20260928 01:56:16.810890 21808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.061s	sys 0.091s
I20260928 01:56:16.812647 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:16.814357 19620 raft_consensus.cc:2468] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
W20260928 01:56:16.813495 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 238636us
I20260928 01:56:16.816298 19556 leader_election.cc:304] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:16.819608 21948 raft_consensus.cc:493] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:16.825778 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:16.825857 21948 raft_consensus.cc:515] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:16.817561 21808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.062s	sys 0.091s
I20260928 01:56:16.828856 21934 raft_consensus.cc:2804] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:16.835233 21934 raft_consensus.cc:493] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:16.835610 21934 raft_consensus.cc:3060] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:16.840008 19556 leader_election.cc:304] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:16.840961 21948 leader_election.cc:290] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.841560 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:16.844832 19556 leader_election.cc:304] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:16.842321 21947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.039s	sys 0.116s
I20260928 01:56:16.847208 21803 raft_consensus.cc:2749] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:16.845577 21948 raft_consensus.cc:2749] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:16.840996 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:16.850193 19556 leader_election.cc:304] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:16.861793 19556 leader_election.cc:304] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:16.863854 19556 leader_election.cc:304] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:16.865278 19556 leader_election.cc:304] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:16.858863 21975 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.713s	user 0.003s	sys 0.000s
I20260928 01:56:16.792575 21974 raft_consensus.cc:493] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:16.727433 21953 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.741962 19896 tablet_bootstrap.cc:492] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:16.790867 21961 raft_consensus.cc:493] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:56:16.810336 19410 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:16.804805 21862 raft_consensus.cc:515] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.905385 20029 tablet_bootstrap.cc:492] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:16.906013 20029 ts_tablet_manager.cc:1403] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 1.382s	user 0.015s	sys 0.021s
I20260928 01:56:16.915570 21973 leader_election.cc:290] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.859680 21938 raft_consensus.cc:515] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.867550 21962 raft_consensus.cc:493] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:16.927361 21962 raft_consensus.cc:515] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.902089 21853 raft_consensus.cc:493] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:16.930325 21853 raft_consensus.cc:515] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.934053 21853 leader_election.cc:290] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:16.922298 21964 raft_consensus.cc:493] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:16.934842 21964 raft_consensus.cc:515] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.896142 21961 raft_consensus.cc:515] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.938602 21961 leader_election.cc:290] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:16.845484 21922 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.062s	sys 0.094s
W20260928 01:56:16.848043 21947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.039s	sys 0.116s
I20260928 01:56:16.945254 21964 leader_election.cc:290] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.866406 21808 raft_consensus.cc:2749] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:16.866130 21948 raft_consensus.cc:2749] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:16.854686 21934 raft_consensus.cc:515] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.948189 21934 leader_election.cc:290] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.849591 21983 tablet.cc:1751] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:16.949832 21962 leader_election.cc:290] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.882642 21923 raft_consensus.cc:493] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:16.882426 19890 tablet_bootstrap.cc:654] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:16.950984 21923 raft_consensus.cc:515] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.953229 21923 leader_election.cc:290] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.901473 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:16.916535 19605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:16.954406 19605 raft_consensus.cc:2468] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:16.939309 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:16.955331 19619 raft_consensus.cc:2468] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:16.957496 21922 raft_consensus.cc:2749] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:16.958509 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 93334.4us
I20260928 01:56:16.966048 19751 raft_consensus.cc:1240] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:16.967226 22016 raft_consensus.cc:493] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
W20260928 01:56:16.933256 21997 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.237s	user 0.002s	sys 0.000s
W20260928 01:56:16.932845 21999 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.243s	user 0.000s	sys 0.002s
I20260928 01:56:16.967811 22016 raft_consensus.cc:515] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:16.973069 21938 leader_election.cc:290] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.893829 21974 raft_consensus.cc:515] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.975659 21862 leader_election.cc:290] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:16.922662 22008 tablet.cc:1751] T 67be39a8cae04ff9ae99c2c3b02713cd P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:16.924916 21953 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.984992 21953 raft_consensus.cc:493] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:16.985567 21953 raft_consensus.cc:515] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:16.986483 21974 leader_election.cc:290] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:16.895205 21881 rpcz_store.cc:276] 0928 01:56:13.254970 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.257029 (+  2059us) service_pool.cc:224] Handling call
0928 01:56:16.252014 (+2994985us) ts_tablet_manager.cc:1151] Deleting tablet eac01fc222dd480cbed7cac37a0e6693
0928 01:56:16.252101 (+    87us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:16.560382 (+308281us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:16.661399 (+101017us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:16.726318 (+ 64919us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":214629,"tablet-delete.queue_time_us":2994123}
I20260928 01:56:16.987886 21953 leader_election.cc:290] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:16.936416 19896 ts_tablet_manager.cc:1403] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.262s	user 0.022s	sys 0.005s
I20260928 01:56:16.988252 21881 tablet_replica.cc:333] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:16.989435 21881 raft_consensus.cc:2243] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:16.990175 21881 raft_consensus.cc:2272] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:16.990895 19896 raft_consensus.cc:359] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.991600 19896 raft_consensus.cc:385] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:16.991863 19896 raft_consensus.cc:740] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:16.992735 19896 consensus_queue.cc:260] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:16.994903 19896 ts_tablet_manager.cc:1434] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260928 01:56:16.995846 19896 tablet_bootstrap.cc:492] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:17.010627 19896 tablet_bootstrap.cc:654] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:17.010793 22016 leader_election.cc:290] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:17.014423 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
I20260928 01:56:17.044494 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet eac01fc222dd480cbed7cac37a0e6693 (table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]) successfully deleted
I20260928 01:56:17.045903 22022 raft_consensus.cc:493] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:17.046471 22022 raft_consensus.cc:515] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.047648 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.049952 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bec2c4274497ea73872d0db233eac" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.053368 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.053653 19896 tablet_bootstrap.cc:492] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:17.054081 19896 ts_tablet_manager.cc:1403] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.000s
I20260928 01:56:17.056761 19896 raft_consensus.cc:359] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.057441 19896 raft_consensus.cc:385] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:17.057715 19896 raft_consensus.cc:740] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:17.058357 19896 consensus_queue.cc:260] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.061000 19896 ts_tablet_manager.cc:1434] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260928 01:56:17.063026 21881 ts_tablet_manager.cc:1916] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:17.065598 22022 leader_election.cc:290] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:17.077865 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.084700 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:17.087755 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:17.100759 22008 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:50444 (request call id 16) took 3844 ms. Trace:
I20260928 01:56:17.101233 22008 rpcz_store.cc:276] 0928 01:56:13.255877 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.256022 (+   145us) service_pool.cc:224] Handling call
0928 01:56:17.100642 (+3844620us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.262030 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.262601 (+   571us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.262634 (+    33us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.262736 (+   102us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.262868 (+   132us) alter_schema_op.cc:128] START. Timestamp: 1790560573262738
0928 01:56:13.262888 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.263519 (+   631us) log.cc:844] Serialized 173 byte log entry
0928 01:56:16.664234 (+3400715us) op_driver.cc:464] REPLICATION: finished
0928 01:56:16.922445 (+258211us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:16.985503 (+ 63058us) log.cc:844] Serialized 5 byte log entry
0928 01:56:17.099366 (+113863us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.100371 (+  1005us) log.cc:844] Serialized 14 byte log entry
0928 01:56:17.100481 (+   110us) alter_schema_op.cc:73] Released schema lock
0928 01:56:17.100512 (+    31us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":257841,"prepare.queue_time_us":4876,"prepare.run_cpu_time_us":12197,"prepare.run_wall_time_us":30807,"replication_time_us":3401125,"thread_start_us":222826,"threads_started":4,"wal-append.queue_time_us":41930,"wal-append.run_cpu_time_us":2471,"wal-append.run_wall_time_us":1256871}]]}
I20260928 01:56:17.109814 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:17.110196 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:17.110598 19473 raft_consensus.cc:2393] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 2: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:17.110826 19471 raft_consensus.cc:2468] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:17.109863 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:17.111810 19475 raft_consensus.cc:2468] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:17.109233 22008 tablet.cc:1751] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:17.115674 22016 raft_consensus.cc:493] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:17.116161 22016 raft_consensus.cc:515] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.116921 21876 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:17.117443 21876 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:17.118187 22016 leader_election.cc:290] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:17.119437 21876 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:17.120249 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7801c623930d4e4eaf24c5c424b06d26" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.134063 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:17.134759 19474 raft_consensus.cc:2468] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
W20260928 01:56:17.139236 20456 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.523s (SENT)
I20260928 01:56:17.139672 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:17.132447 21939 raft_consensus.cc:493] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:17.142879 21939 raft_consensus.cc:515] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.149874 21862 raft_consensus.cc:493] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:17.150692 21862 raft_consensus.cc:515] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.151314 22041 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:17.153524 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:17.154348 19471 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:17.154556 21953 raft_consensus.cc:493] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:17.155279 21953 raft_consensus.cc:515] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.156366 21862 leader_election.cc:290] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:17.171195 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:17.178032 21953 leader_election.cc:290] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:17.178997 21962 raft_consensus.cc:493] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:17.179626 21962 raft_consensus.cc:515] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.160800 21939 leader_election.cc:290] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:17.182967 21962 leader_election.cc:290] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:17.183254 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 60322.3us
I20260928 01:56:16.967494 21983 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:57616 (request call id 19) took 3365 ms. Trace:
I20260928 01:56:16.987318 19605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b795606604960bc7cafab4ff6f3d0" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:16.993077 19890 tablet_bootstrap.cc:492] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:16.995683 21803 raft_consensus.cc:2749] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:17.001552 22030 tablet.cc:1751] T 86825485bfca479ea63c1a99dddb68d6 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:17.031106 19609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:17.033135 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:17.036778 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:17.094895 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:17.127101 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:17.143989 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:17.163424 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:17.188604 19605 raft_consensus.cc:2393] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:17.167842 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab12ba3e1f542949e3f203dae0fa80e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:17.170358 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:17.192750 19556 leader_election.cc:304] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:17.189037 19890 ts_tablet_manager.cc:1403] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.954s	user 0.012s	sys 0.004s
I20260928 01:56:17.194101 19556 leader_election.cc:304] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:17.180512 20029 raft_consensus.cc:359] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.204671 20029 raft_consensus.cc:385] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:17.205062 20029 raft_consensus.cc:740] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:17.184608 19703 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:56:17.236128 19409 leader_election.cc:343] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:17.236932 22038 tablet.cc:1751] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 3
I20260928 01:56:17.191053 19615 raft_consensus.cc:3060] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:17.237511 21853 consensus_queue.cc:1059] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:17.232715 22023 raft_consensus.cc:493] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:17.239781 21962 raft_consensus.cc:3055] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:17.196952 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ab79c6ad03e481a903a0f95ae0512e6" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:17.239923 22023 raft_consensus.cc:515] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:17.240253 21962 raft_consensus.cc:740] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:17.240468 19617 raft_consensus.cc:2468] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:17.195178 22021 raft_consensus.cc:2749] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:17.234813 21961 raft_consensus.cc:493] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:17.188053 21983 rpcz_store.cc:276] 0928 01:56:13.602344 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.603671 (+  1327us) service_pool.cc:224] Handling call
0928 01:56:16.967412 (+3363741us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.708917 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.709545 (+   628us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.709578 (+    33us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.709621 (+    43us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.709749 (+   128us) alter_schema_op.cc:128] START. Timestamp: 1790560573709686
0928 01:56:13.709774 (+    25us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.710382 (+   608us) log.cc:844] Serialized 173 byte log entry
0928 01:56:16.210535 (+2500153us) op_driver.cc:464] REPLICATION: finished
0928 01:56:16.843307 (+632772us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:16.949683 (+106376us) log.cc:844] Serialized 5 byte log entry
0928 01:56:16.966109 (+ 16426us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:16.967122 (+  1013us) log.cc:844] Serialized 14 byte log entry
0928 01:56:16.967236 (+   114us) alter_schema_op.cc:73] Released schema lock
0928 01:56:16.967270 (+    34us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":619431,"prepare.queue_time_us":104152,"prepare.run_cpu_time_us":2399,"prepare.run_wall_time_us":66946,"replication_time_us":2500594,"thread_start_us":926668,"threads_started":4,"wal-append.queue_time_us":70108,"wal-append.run_cpu_time_us":2155,"wal-append.run_wall_time_us":1066138}]]}
I20260928 01:56:17.241955 21962 consensus_queue.cc:260] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:17.244179 19412 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.2:33591 timed out after 3.431s (SENT)
I20260928 01:56:17.244704 22023 leader_election.cc:290] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:17.215708 19890 raft_consensus.cc:359] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.242419 21961 raft_consensus.cc:515] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.245348 19890 raft_consensus.cc:385] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:17.245651 19890 raft_consensus.cc:740] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:17.217919 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:17.219766 21922 raft_consensus.cc:493] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:17.220144 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:17.248039 21922 raft_consensus.cc:515] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.248104 21961 leader_election.cc:290] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:17.220525 21923 raft_consensus.cc:493] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:17.250932 21923 raft_consensus.cc:515] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.221232 21803 raft_consensus.cc:493] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:17.223081 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:17.258854 19412 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:17.259665 19890 consensus_queue.cc:260] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.262217 19890 ts_tablet_manager.cc:1434] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260928 01:56:17.259380 21803 raft_consensus.cc:515] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.266305 22036 tablet.cc:1751] T 86825485bfca479ea63c1a99dddb68d6 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
W20260928 01:56:17.268507 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 74485.1us
I20260928 01:56:17.269409 19556 leader_election.cc:304] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:17.272622 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 88079.3us
I20260928 01:56:17.274132 21962 raft_consensus.cc:3060] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:17.276079 21858 raft_consensus.cc:2804] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:17.276592 21858 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:17.277096 21858 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:17.277626 21909 ts_tablet_manager.cc:1929] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:17.278194 21909 log.cc:1199] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/0ae3663fbe024a4e946e47339a4b9090
I20260928 01:56:17.230170 22031 tablet.cc:1751] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:56:17.281221 20029 consensus_queue.cc:260] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:17.288573 19409 leader_election.cc:343] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:17.305138 19704 leader_election.cc:304] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:17.314815 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22606f012f1c44bd92c8e0341e9ca2b7" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.321054 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.332890 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.344821 19754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb014699060e4a6caf4caaf33c31710a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.350384 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6b59144fe14daab98b0965c7f8af02" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.290764 21975 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55034 (request call id 14) took 3640 ms. Trace:
W20260928 01:56:17.359083 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 54020.8us
I20260928 01:56:17.360984 21877 raft_consensus.cc:2804] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:17.361485 21877 raft_consensus.cc:493] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:17.362021 21877 raft_consensus.cc:3060] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:17.270363 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:17.366353 21962 raft_consensus.cc:493] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:17.366961 21962 raft_consensus.cc:515] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.369726 21961 raft_consensus.cc:493] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:17.370407 21961 raft_consensus.cc:515] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.375317 21961 leader_election.cc:290] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:17.376722 21962 leader_election.cc:290] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:17.383927 19754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c755f16ea1496eb7fa26fb12e01708" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:17.375332 19409 leader_election.cc:343] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:17.390112 21909 ts_tablet_manager.cc:1950] T 0ae3663fbe024a4e946e47339a4b9090 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:17.391700 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 18) took 3698 ms. Trace:
W20260928 01:56:17.402037 19409 leader_election.cc:343] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:17.403074 19409 leader_election.cc:343] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:17.411293 19179 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e43bec2c4274497ea73872d0db233eac consensus state has no leader
W20260928 01:56:17.363849 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 90565.8us
I20260928 01:56:17.399247 21881 ts_tablet_manager.cc:1929] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:17.422031 21881 log.cc:1199] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/8a5e07078b2a4fe59d9293d9511cbb6b
I20260928 01:56:17.423182 21881 ts_tablet_manager.cc:1950] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:17.440721 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 18) took 3971 ms. Trace:
I20260928 01:56:17.441359 21881 rpcz_store.cc:276] 0928 01:56:13.468945 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.469080 (+   135us) service_pool.cc:224] Handling call
0928 01:56:16.988021 (+3518941us) ts_tablet_manager.cc:1151] Deleting tablet 8a5e07078b2a4fe59d9293d9511cbb6b
0928 01:56:16.988096 (+    75us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:17.285377 (+297281us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.399094 (+113717us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.440629 (+ 41535us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3481366}
I20260928 01:56:17.444439 21881 tablet_replica.cc:333] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:17.447742 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 8a5e07078b2a4fe59d9293d9511cbb6b (table default.Table_deb7dc16f0794afd95d9f29bed3a5621 [id=0da09ac1dc794d82b6f9323d0196b4cc]) successfully deleted
I20260928 01:56:17.453648 21881 raft_consensus.cc:2243] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 01:56:17.454985 22028 log.cc:927] Time spent T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260928 01:56:17.457070 19758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.2:59399 (request call id 768) took 1229 ms. Trace:
I20260928 01:56:17.460772 21881 raft_consensus.cc:2272] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:17.462906 21962 raft_consensus.cc:493] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:17.463564 21962 raft_consensus.cc:515] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.467362 21962 leader_election.cc:290] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:17.468744 19754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.473300 21881 ts_tablet_manager.cc:1916] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:17.473440 21976 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55034 (request call id 13) took 3826 ms. Trace:
I20260928 01:56:17.476306 20029 ts_tablet_manager.cc:1434] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.570s	user 0.007s	sys 0.001s
W20260928 01:56:17.476681 20029 ts_tablet_manager.cc:1467] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da: Tablet startup took 570ms
W20260928 01:56:17.484809 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 69632.2us
I20260928 01:56:17.485546 19703 leader_election.cc:304] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:17.486771 19890 tablet_bootstrap.cc:492] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:17.515496 21803 leader_election.cc:290] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:17.489779 21934 raft_consensus.cc:2749] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:17.518311 21881 ts_tablet_manager.cc:1929] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:17.528434 21881 log.cc:1199] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/e05925303152462e8ca25cd15f3bedff
I20260928 01:56:17.529417 21881 ts_tablet_manager.cc:1950] T e05925303152462e8ca25cd15f3bedff P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:17.520643 21922 leader_election.cc:290] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:17.534677 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 17) took 4278 ms. Trace:
I20260928 01:56:17.535112 21881 rpcz_store.cc:276] 0928 01:56:13.441447 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.488959 (+ 47512us) service_pool.cc:224] Handling call
0928 01:56:17.444108 (+3955149us) ts_tablet_manager.cc:1151] Deleting tablet e05925303152462e8ca25cd15f3bedff
0928 01:56:17.444232 (+   124us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:17.504999 (+ 60767us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.518153 (+ 13154us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.534576 (+ 16423us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3931265}
I20260928 01:56:17.532043 19890 tablet_bootstrap.cc:654] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:17.537158 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet e05925303152462e8ca25cd15f3bedff (table default.Table_21e19e0229e74ecba58c719d9d48d826 [id=73589cf1bbce4173ac1347c30cc2d811]) successfully deleted
I20260928 01:56:17.539003 21923 leader_election.cc:290] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:17.538435 21881 tablet_replica.cc:333] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:17.541213 21881 raft_consensus.cc:2243] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Raft consensus shutting down.
W20260928 01:56:17.544991 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 184758us
I20260928 01:56:17.545790 19704 leader_election.cc:304] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:17.546314 21881 raft_consensus.cc:2272] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:17.548971 21881 ts_tablet_manager.cc:1916] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:17.553395 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 67943.3us
I20260928 01:56:17.554070 19704 leader_election.cc:304] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:17.560811 21938 raft_consensus.cc:2804] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:17.561179 21938 raft_consensus.cc:493] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:17.561563 21938 raft_consensus.cc:3060] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:17.569007 19703 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:56:17.476954 20029 ts_tablet_manager.cc:1469] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da: Trace:
0928 01:55:44.402883 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:44.404187 (+  1304us) service_pool.cc:224] Handling call
0928 01:55:44.596442 (+192255us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:44.596526 (+    84us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:44.808575 (+212049us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:44.846014 (+ 37439us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:44.846466 (+   452us) inbound_call.cc:177] Queueing success response
0928 01:56:15.515694 (+30669228us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0928 01:56:16.906467 (+1390773us) ts_tablet_manager.cc:1435] Starting tablet replica
0928 01:56:17.171455 (+264988us) tablet_replica.cc:261] Starting instrumentation
0928 01:56:17.172009 (+   554us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":132409,"raft.queue_time_us":160120,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":20329,"tablet-open.queue_time_us":30609219}
I20260928 01:56:17.580495 19703 leader_election.cc:304] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:17.581171 21972 raft_consensus.cc:2764] T a01b795606604960bc7cafab4ff6f3d0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 01:56:17.557634 21973 raft_consensus.cc:2804] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:17.583356 21973 raft_consensus.cc:493] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:17.583966 21973 raft_consensus.cc:3060] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:17.562568 21939 raft_consensus.cc:2749] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:17.575001 21876 raft_consensus.cc:2804] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:17.594749 21876 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:17.595191 21876 raft_consensus.cc:3060] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:17.595747 21881 ts_tablet_manager.cc:1929] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:17.599059 21881 log.cc:1199] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/3c6cfc9ff3344a48b09730dfde79d6cf
I20260928 01:56:17.600553 21881 ts_tablet_manager.cc:1950] T 3c6cfc9ff3344a48b09730dfde79d6cf P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:17.601224 19755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.2:59399 (request call id 760) took 1376 ms. Trace:
I20260928 01:56:17.601714 19755 rpcz_store.cc:276] 0928 01:56:16.224332 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:16.399977 (+175645us) service_pool.cc:224] Handling call
0928 01:56:16.400543 (+   566us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 01:56:16.400975 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 01:56:16.401016 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 01:56:16.488194 (+ 87178us) alter_schema_op.cc:128] START. Timestamp: 1790560573706898
0928 01:56:16.984247 (+496053us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b2c00004d28. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a20498c91 00007f0a204a85f2 00007f0a212c81c1 00007f0a2128cbfa 00007f0a2128bffe 00007f0a222ec659 00007f0a20968d34 00007f0a20968cc2 00007f0a20968bf1 00007f0a20968b6c 00007f0a20967e22
0928 01:56:17.076636 (+ 92389us) log.cc:844] Serialized 173 byte log entry
0928 01:56:17.306682 (+230046us) raft_consensus.cc:1645] Marking committed up to 1
0928 01:56:17.376882 (+ 70200us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:56:17.376975 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:56:17.547599 (+170624us) raft_consensus.cc:1685] finished
0928 01:56:17.575951 (+ 28352us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:56:17.601156 (+ 25205us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:16.692686 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:16.770428 (+ 77742us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:16.770464 (+    36us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:16.770533 (+    69us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
Metrics: {"spinlock_wait_cycles":35630976,"thread_start_us":204003,"threads_started":1,"wal-append.queue_time_us":318889,"child_traces":[["op",{"prepare.queue_time_us":204071,"prepare.run_cpu_time_us":904,"prepare.run_wall_time_us":77920,"thread_start_us":259103,"threads_started":1}]]}
I20260928 01:56:17.603510 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 19) took 4134 ms. Trace:
I20260928 01:56:17.609649 21938 raft_consensus.cc:515] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.613288 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.628839 22044 raft_consensus.cc:493] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:17.629397 22044 raft_consensus.cc:515] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.631522 22044 leader_election.cc:290] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:17.630402 21858 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:17.603888 21881 rpcz_store.cc:276] 0928 01:56:13.469250 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.535280 (+ 66030us) service_pool.cc:224] Handling call
0928 01:56:17.536719 (+4001439us) ts_tablet_manager.cc:1151] Deleting tablet 3c6cfc9ff3344a48b09730dfde79d6cf
0928 01:56:17.538223 (+  1504us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:17.575078 (+ 36855us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.595582 (+ 20504us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.603432 (+  7850us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4000737}
I20260928 01:56:17.642114 21881 tablet_replica.cc:333] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:17.643221 21881 raft_consensus.cc:2243] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:17.644109 21881 raft_consensus.cc:2272] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:17.648167 21881 ts_tablet_manager.cc:1916] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:17.484601 21909 rpcz_store.cc:276] 0928 01:56:13.693156 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.693272 (+   116us) service_pool.cc:224] Handling call
0928 01:56:13.785340 (+ 92068us) ts_tablet_manager.cc:1151] Deleting tablet 0ae3663fbe024a4e946e47339a4b9090
0928 01:56:13.785418 (+    78us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:16.134949 (+2349531us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.277451 (+1142502us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.391565 (+114114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":711947,"tablet-delete.queue_time_us":91159,"thread_start_us":92063,"threads_started":1}
I20260928 01:56:17.649343 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 3c6cfc9ff3344a48b09730dfde79d6cf (table default.Table_919e392236f9437fb1c2f9fee1f94f84 [id=e8373f635df4445ca4acdbab7cdeb448]) successfully deleted
I20260928 01:56:17.657027 21997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55034 (request call id 17) took 3965 ms. Trace:
W20260928 01:56:17.636098 19184 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.003s	sys 0.000s
I20260928 01:56:17.676409 19615 raft_consensus.cc:2468] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:17.680605 21923 raft_consensus.cc:493] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:17.680794 21803 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:17.681782 21803 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.684613 21934 raft_consensus.cc:2749] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:17.681607 21923 raft_consensus.cc:515] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.687551 21923 leader_election.cc:290] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:17.678658 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 58c61408724e4a70b39e5dbdab9a3e8a (table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]) successfully deleted
W20260928 01:56:17.668634 19184 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.006s	sys 0.000s
I20260928 01:56:17.696015 21922 raft_consensus.cc:493] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:17.697386 19890 tablet_bootstrap.cc:492] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:17.709822 19890 ts_tablet_manager.cc:1403] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.223s	user 0.010s	sys 0.005s
I20260928 01:56:17.699342 21803 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:17.709601 21922 raft_consensus.cc:515] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.718493 19890 raft_consensus.cc:359] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.724267 19522 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:17.727525 22044 raft_consensus.cc:493] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:17.728037 22044 raft_consensus.cc:515] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.730281 22044 leader_election.cc:290] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:17.743727 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 474264us
I20260928 01:56:17.745544 21922 leader_election.cc:290] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:17.659345 21973 raft_consensus.cc:515] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.357012 21975 rpcz_store.cc:276] 0928 01:56:13.647210 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.661500 (+ 14290us) service_pool.cc:224] Handling call
0928 01:56:17.285894 (+3624394us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.663000 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.663475 (+   475us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.663528 (+    53us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.663614 (+    86us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.663750 (+   136us) alter_schema_op.cc:128] START. Timestamp: 1790560573663538
0928 01:56:13.663769 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.664471 (+   702us) log.cc:844] Serialized 173 byte log entry
0928 01:56:13.684432 (+ 19961us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b54000819a0. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a211f5aa1 00007f0a2120d056 00007f0a212069ca 00007f0a21205c44 00007f0a211e63da 00007f0a211ed283 00007f0a211ed209 00007f0a211ed199 00007f0a211ed161 00007f0a211ec32d 00000000005bd4e4
0928 01:56:16.121767 (+2437335us) op_driver.cc:464] REPLICATION: finished
0928 01:56:16.144282 (+ 22515us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:16.146429 (+  2147us) log.cc:844] Serialized 5 byte log entry
0928 01:56:17.038210 (+891781us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.181512 (+143302us) log.cc:844] Serialized 14 byte log entry
0928 01:56:17.182416 (+   904us) alter_schema_op.cc:73] Released schema lock
0928 01:56:17.183070 (+   654us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":22178,"mutex_wait_us":42,"prepare.queue_time_us":159,"prepare.run_cpu_time_us":5624,"prepare.run_wall_time_us":16948,"raft.queue_time_us":2817,"raft.run_cpu_time_us":2952,"raft.run_wall_time_us":4239,"replication_time_us":2457865,"spinlock_wait_cycles":2860544,"thread_start_us":188528,"threads_started":3,"wal-append.queue_time_us":616133,"wal-append.run_cpu_time_us":2210,"wal-append.run_wall_time_us":1011844}]]}
I20260928 01:56:17.660544 19754 raft_consensus.cc:3060] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:17.457670 19758 rpcz_store.cc:276] 0928 01:56:16.227353 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:16.455720 (+228367us) service_pool.cc:224] Handling call
0928 01:56:16.495520 (+ 39800us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 01:56:16.495873 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 01:56:16.495910 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 01:56:16.496344 (+   434us) alter_schema_op.cc:128] START. Timestamp: 1790560573712688
0928 01:56:16.880271 (+383927us) log.cc:844] Serialized 173 byte log entry
0928 01:56:17.363629 (+483358us) raft_consensus.cc:1645] Marking committed up to 1
0928 01:56:17.380697 (+ 17068us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:56:17.413213 (+ 32516us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:56:17.456771 (+ 43558us) raft_consensus.cc:1685] finished
0928 01:56:17.456815 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:56:17.456993 (+   178us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:16.693415 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:16.902490 (+209075us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:16.902526 (+    36us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:16.906799 (+  4273us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
Metrics: {"thread_start_us":352505,"threads_started":1,"wal-append.queue_time_us":458229,"child_traces":[["op",{"prepare.queue_time_us":196727,"prepare.run_cpu_time_us":1347,"prepare.run_wall_time_us":213453,"thread_start_us":230784,"threads_started":1}]]}
I20260928 01:56:17.662654 20029 tablet_bootstrap.cc:492] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:17.663038 21938 leader_election.cc:290] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:17.730679 21909 tablet_replica.cc:333] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:17.731178 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:17.732339 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.733017 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6a5cb9b09e4e5a8400bf71dbf99987" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.734445 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.735526 21999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55034 (request call id 31) took 3985 ms. Trace:
I20260928 01:56:17.736838 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b836e20d6b43cba8eaa08887afb076" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.737489 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.733042 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7979940c4a2e470bbecc40384edf38c9" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.744935 21876 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:17.773021 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9690a224bb004152ba65d525cc10bd9f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.764371 19890 raft_consensus.cc:385] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:17.784157 19556 leader_election.cc:304] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:17.786383 19556 leader_election.cc:304] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:17.792569 22053 raft_consensus.cc:2749] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:17.793718 22053 raft_consensus.cc:2749] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:17.782989 19890 raft_consensus.cc:740] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:17.799690 19890 consensus_queue.cc:260] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.801926 19890 ts_tablet_manager.cc:1434] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.001s
I20260928 01:56:17.815474 21909 raft_consensus.cc:2243] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:17.816164 21909 raft_consensus.cc:2272] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:17.816717 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf1b727e86a43b08bd464647fa529a3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.818066 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.818778 21909 ts_tablet_manager.cc:1916] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:17.821354 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:17.822145 19409 leader_election.cc:343] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:17.829877 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:17.830554 19463 raft_consensus.cc:3060] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:17.838789 19463 raft_consensus.cc:2468] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
W20260928 01:56:17.842407 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 256592us
I20260928 01:56:17.844398 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cc307b127446958bd4199a1aa60adb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:17.626427 21877 raft_consensus.cc:515] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:17.846937 19409 leader_election.cc:343] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:17.851423 21881 ts_tablet_manager.cc:1929] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:17.851686 19890 tablet_bootstrap.cc:492] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:17.852022 21881 log.cc:1199] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/89e1d60db21f4a8294792df3fadf5d90
I20260928 01:56:17.852931 21881 ts_tablet_manager.cc:1950] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:17.854283 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 20) took 4317 ms. Trace:
I20260928 01:56:17.769897 21999 rpcz_store.cc:276] 0928 01:56:13.751712 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.751829 (+   117us) service_pool.cc:224] Handling call
0928 01:56:17.735450 (+3983621us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.794013 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.794472 (+   459us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.794512 (+    40us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.795007 (+   495us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.795161 (+   154us) alter_schema_op.cc:128] START. Timestamp: 1790560573794922
0928 01:56:13.795179 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.795774 (+   595us) log.cc:844] Serialized 173 byte log entry
0928 01:56:16.384424 (+2588650us) op_driver.cc:464] REPLICATION: finished
0928 01:56:16.688292 (+303868us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:16.690274 (+  1982us) log.cc:844] Serialized 5 byte log entry
0928 01:56:17.618950 (+928676us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.735177 (+116227us) log.cc:844] Serialized 14 byte log entry
0928 01:56:17.735287 (+   110us) alter_schema_op.cc:73] Released schema lock
0928 01:56:17.735318 (+    31us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":303613,"prepare.queue_time_us":13511,"prepare.run_cpu_time_us":16551,"prepare.run_wall_time_us":397417,"replication_time_us":2589073,"thread_start_us":721214,"threads_started":3,"wal-append.queue_time_us":396431,"wal-append.run_cpu_time_us":3951,"wal-append.run_wall_time_us":1041575}]]}
I20260928 01:56:17.860270 21858 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:17.864905 21975 tablet.cc:1751] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:17.473982 21976 rpcz_store.cc:276] 0928 01:56:13.646818 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.647042 (+   224us) service_pool.cc:224] Handling call
0928 01:56:17.473341 (+3826299us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.651500 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.651945 (+   445us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.652002 (+    57us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.652092 (+    90us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.652249 (+   157us) alter_schema_op.cc:128] START. Timestamp: 1790560573652075
0928 01:56:13.652279 (+    30us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.653070 (+   791us) log.cc:844] Serialized 173 byte log entry
0928 01:56:16.122992 (+2469922us) op_driver.cc:464] REPLICATION: finished
0928 01:56:16.222648 (+ 99656us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:16.416995 (+194347us) log.cc:844] Serialized 5 byte log entry
0928 01:56:17.436145 (+1019150us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.471677 (+ 35532us) log.cc:844] Serialized 14 byte log entry
0928 01:56:17.473113 (+  1436us) alter_schema_op.cc:73] Released schema lock
0928 01:56:17.473165 (+    52us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":99425,"mutex_wait_us":38224,"prepare.queue_time_us":3350,"prepare.run_cpu_time_us":3812,"prepare.run_wall_time_us":262940,"raft.queue_time_us":47246,"raft.run_cpu_time_us":3113,"raft.run_wall_time_us":14661,"replication_time_us":2470573,"thread_start_us":585881,"threads_started":3,"wal-append.queue_time_us":333829,"wal-append.run_cpu_time_us":1822,"wal-append.run_wall_time_us":1027040}]]}
W20260928 01:56:17.871766 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 316307us
I20260928 01:56:17.900460 21881 rpcz_store.cc:276] 0928 01:56:13.536553 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.536668 (+   115us) service_pool.cc:224] Handling call
0928 01:56:17.641903 (+4105235us) ts_tablet_manager.cc:1151] Deleting tablet 89e1d60db21f4a8294792df3fadf5d90
0928 01:56:17.641987 (+    84us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:17.666663 (+ 24676us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.808946 (+142283us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.854211 (+ 45265us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4104615}
I20260928 01:56:17.916504 21922 raft_consensus.cc:493] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:56:17.916976 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 44504.3us
I20260928 01:56:17.917181 21922 raft_consensus.cc:515] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.918181 19704 leader_election.cc:304] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:17.919480 21922 leader_election.cc:290] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:17.921094 19553 leader_election.cc:343] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:17.922245 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 48649us
I20260928 01:56:17.905247 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:17.928845 19703 leader_election.cc:304] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:17.929991 21881 tablet_replica.cc:333] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:17.932094 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 89e1d60db21f4a8294792df3fadf5d90 (table default.Table_3ce866b8da2a4181bedfe396a59a2b76 [id=2e72bf3c803b4352af5b9d6300abbd35]) successfully deleted
I20260928 01:56:17.921360 19890 tablet_bootstrap.cc:654] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:17.946986 19890 tablet_bootstrap.cc:492] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:17.947533 19890 ts_tablet_manager.cc:1403] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.096s	user 0.007s	sys 0.003s
I20260928 01:56:17.936435 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:17.948076 19463 raft_consensus.cc:2468] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:17.949992 21881 raft_consensus.cc:2243] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:17.950136 21877 leader_election.cc:290] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:17.950632 21881 raft_consensus.cc:2272] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:17.953148 21939 raft_consensus.cc:2804] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:17.953531 21939 raft_consensus.cc:493] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:17.953871 21939 raft_consensus.cc:3060] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:17.954795 19703 leader_election.cc:304] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:17.955487 19704 leader_election.cc:304] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:17.952026 21976 tablet.cc:1751] T 67be39a8cae04ff9ae99c2c3b02713cd P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:17.965550 21999 tablet.cc:1751] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:56:17.958412 21974 raft_consensus.cc:2804] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:17.745908 21997 rpcz_store.cc:276] 0928 01:56:13.691253 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.691345 (+    92us) service_pool.cc:224] Handling call
0928 01:56:17.656951 (+3965606us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.730241 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.730698 (+   457us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.730729 (+    31us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.730807 (+    78us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.730952 (+   145us) alter_schema_op.cc:128] START. Timestamp: 1790560573730728
0928 01:56:13.730979 (+    27us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.731647 (+   668us) log.cc:844] Serialized 173 byte log entry
0928 01:56:16.393570 (+2661923us) op_driver.cc:464] REPLICATION: finished
0928 01:56:16.694064 (+300494us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:16.696419 (+  2355us) log.cc:844] Serialized 5 byte log entry
0928 01:56:17.654909 (+958490us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:17.655685 (+   776us) log.cc:844] Serialized 14 byte log entry
0928 01:56:17.656770 (+  1085us) alter_schema_op.cc:73] Released schema lock
0928 01:56:17.656811 (+    41us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":300271,"prepare.queue_time_us":38042,"prepare.run_cpu_time_us":2733,"prepare.run_wall_time_us":16454,"raft.queue_time_us":3011,"raft.run_cpu_time_us":991,"raft.run_wall_time_us":991,"replication_time_us":2662444,"thread_start_us":635932,"threads_started":4,"wal-append.queue_time_us":200229,"wal-append.run_cpu_time_us":2107,"wal-append.run_wall_time_us":1025644}]]}
I20260928 01:56:17.961882 21876 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:17.969264 21938 raft_consensus.cc:2804] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:17.974596 21974 raft_consensus.cc:493] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:17.984032 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:17.984740 19463 raft_consensus.cc:2468] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:17.984808 21974 raft_consensus.cc:3060] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:17.979960 21862 raft_consensus.cc:2804] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:17.981693 21938 raft_consensus.cc:493] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:17.986212 21862 raft_consensus.cc:493] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:17.983976 21973 leader_election.cc:290] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:17.986691 21862 raft_consensus.cc:3060] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:17.986307 21938 raft_consensus.cc:3060] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:56:17.996457 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 49211.9us
I20260928 01:56:18.000396 19890 raft_consensus.cc:359] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:18.001238 19890 raft_consensus.cc:385] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:18.001546 19890 raft_consensus.cc:740] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:18.002283 19890 consensus_queue.cc:260] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:17.988306 19703 leader_election.cc:304] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:18.004925 19703 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:18.005172 21881 ts_tablet_manager.cc:1916] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:18.006304 21858 raft_consensus.cc:2804] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:18.006691 21858 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:18.006367 21997 tablet.cc:1751] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.006778 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b795606604960bc7cafab4ff6f3d0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:18.007066 21858 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:18.007336 19474 raft_consensus.cc:3060] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:18.014523 19553 leader_election.cc:343] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:18.016130 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.018201 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.019625 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602706a3fbc438d8d448c9ac057087c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.020608 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.022425 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.024091 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3b9ec9f88342c0aa77c0fc92d26205" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.025696 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8d07b367b4fafbd7171f8ea7b2a26" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.027180 20029 tablet_bootstrap.cc:654] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
W20260928 01:56:18.030042 19553 leader_election.cc:343] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:18.030218 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.030665 19553 leader_election.cc:304] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:18.030884 21858 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:18.031476 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.032320 22053 raft_consensus.cc:2804] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:18.032876 22053 raft_consensus.cc:697] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:18.034124 22053 consensus_queue.cc:237] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.034648 22031 tablet.cc:1751] T 897503329be649e38473561cea1fdaf1 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.039775 19890 ts_tablet_manager.cc:1434] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.001s
I20260928 01:56:18.041411 19890 tablet_bootstrap.cc:492] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:18.058430 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:18.059239 19461 raft_consensus.cc:3060] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:18.063055 22044 raft_consensus.cc:493] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:18.063547 22044 raft_consensus.cc:515] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.065717 22044 leader_election.cc:290] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:18.077167 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555e557370a4e92915a9c55107b573b" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.080327 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287060a8d054b15b2252dcf280ca8c2" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.081130 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:18.081974 19471 raft_consensus.cc:2393] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:18.081200 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22606f012f1c44bd92c8e0341e9ca2b7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.082526 19473 raft_consensus.cc:2468] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:18.082394 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.047394 19553 leader_election.cc:304] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:18.046698 19474 raft_consensus.cc:2468] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:18.086596 21881 ts_tablet_manager.cc:1929] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:18.087080 21881 log.cc:1199] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/7daa1b799e0d408287edc03988f5b683
I20260928 01:56:18.087836 21881 ts_tablet_manager.cc:1950] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:18.015446 21972 raft_consensus.cc:2804] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:18.090728 21972 raft_consensus.cc:493] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:18.090644 21922 raft_consensus.cc:493] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:18.091120 21972 raft_consensus.cc:3060] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:18.091303 21922 raft_consensus.cc:515] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.091902 21909 ts_tablet_manager.cc:1929] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:18.093632 21922 leader_election.cc:290] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:18.094228 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 46983.3us
I20260928 01:56:18.094332 21922 raft_consensus.cc:2804] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:18.096107 22021 raft_consensus.cc:493] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:18.096711 22021 raft_consensus.cc:515] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:18.098846 22021 leader_election.cc:290] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:18.032328 19703 leader_election.cc:343] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:18.102574 21923 raft_consensus.cc:493] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:18.103116 21923 raft_consensus.cc:515] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.105386 21923 leader_election.cc:290] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:18.106087 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.106338 22021 raft_consensus.cc:493] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:18.106763 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6a5cb9b09e4e5a8400bf71dbf99987" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.107613 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.106961 22021 raft_consensus.cc:515] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.108336 19474 raft_consensus.cc:2468] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:18.109694 22021 leader_election.cc:290] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:18.110786 21922 raft_consensus.cc:697] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
W20260928 01:56:18.113778 19553 leader_election.cc:343] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: 0ae3663fbe024a4e946e47339a4b9090
W20260928 01:56:18.079701 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 118131us
I20260928 01:56:18.075155 21975 tablet.cc:1751] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.087147 21939 raft_consensus.cc:515] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.074287 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.112687 21922 consensus_queue.cc:237] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:18.122248 19553 leader_election.cc:343] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:18.122364 22076 tablet.cc:1751] T 22e095aba1cb4fb7be461d625a922751 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.124712 22054 consensus_queue.cc:1048] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:18.129812 21923 raft_consensus.cc:493] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
W20260928 01:56:18.101440 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 69148.5us
I20260928 01:56:18.130816 21923 raft_consensus.cc:515] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.133612 21923 leader_election.cc:290] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:18.141220 21808 raft_consensus.cc:493] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:18.141716 21808 raft_consensus.cc:515] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:18.143843 21808 leader_election.cc:290] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:18.148217 21939 leader_election.cc:290] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:18.150414 19409 leader_election.cc:343] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:18.150569 21909 log.cc:1199] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/eac01fc222dd480cbed7cac37a0e6693
I20260928 01:56:18.154670 22072 tablet.cc:1751] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.168870 19461 raft_consensus.cc:2468] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:18.173247 21974 raft_consensus.cc:515] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.175408 21974 leader_election.cc:290] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:18.178673 21938 raft_consensus.cc:515] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:18.197260 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.191576 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.193791 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:18.198401 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.198904 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:18.193887 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:18.199368 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:18.199708 19466 raft_consensus.cc:3060] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:18.201175 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b836e20d6b43cba8eaa08887afb076" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.201357 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:18.201771 19459 raft_consensus.cc:2468] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:18.202054 19476 raft_consensus.cc:2393] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 2: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:18.202678 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.204409 19473 raft_consensus.cc:2468] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:18.204625 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.205240 19458 raft_consensus.cc:2468] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:18.194314 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7979940c4a2e470bbecc40384edf38c9" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.199411 19469 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
W20260928 01:56:18.174557 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 50844.6us
W20260928 01:56:18.210075 19553 leader_election.cc:343] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:18.218456 22044 raft_consensus.cc:493] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:18.219952 22044 raft_consensus.cc:515] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:18.222240 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.222939 19470 raft_consensus.cc:2468] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
W20260928 01:56:18.224678 19703 leader_election.cc:343] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 7ab79c6ad03e481a903a0f95ae0512e6
I20260928 01:56:18.223974 22044 leader_election.cc:290] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:18.233728 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:18.234382 19461 raft_consensus.cc:3060] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:18.234699 22044 raft_consensus.cc:493] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:18.235275 22044 raft_consensus.cc:515] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.236791 19466 raft_consensus.cc:2468] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:18.187996 19890 tablet_bootstrap.cc:654] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:18.238301 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.238310 22044 leader_election.cc:290] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:18.288414 19474 raft_consensus.cc:2468] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
W20260928 01:56:18.288455 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 78467.1us
I20260928 01:56:18.240799 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:18.241721 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.290100 19471 raft_consensus.cc:2468] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:18.240006 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:18.245070 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:18.246902 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf1b727e86a43b08bd464647fa529a3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.249536 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab12ba3e1f542949e3f203dae0fa80e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.273250 22083 tablet.cc:1751] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:56:18.294963 19469 raft_consensus.cc:2468] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:18.217185 22078 raft_consensus.cc:493] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:18.282977 19457 raft_consensus.cc:1240] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:18.220281 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.304518 21938 leader_election.cc:290] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:18.099313 21862 raft_consensus.cc:515] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:18.308647 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 174107us
W20260928 01:56:18.312647 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 84568.7us
I20260928 01:56:18.320636 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2597de2c4304074977db5a3c0426814" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.308579 21909 ts_tablet_manager.cc:1950] T eac01fc222dd480cbed7cac37a0e6693 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
W20260928 01:56:18.309535 21997 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.301s	user 0.000s	sys 0.017s
I20260928 01:56:18.336037 19752 raft_consensus.cc:1240] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: []
W20260928 01:56:18.356518 21999 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.390s	user 0.000s	sys 0.022s
I20260928 01:56:18.356554 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.361014 21858 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:18.373862 22076 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260928 01:56:18.393672 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:18.394817 22085 log.cc:927] Time spent T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260928 01:56:18.397475 22078 raft_consensus.cc:515] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.401383 22098 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:18.401916 22098 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:18.406275 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 19) took 4712 ms. Trace:
I20260928 01:56:18.406746 21909 rpcz_store.cc:276] 0928 01:56:13.693715 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.694756 (+  1041us) service_pool.cc:224] Handling call
0928 01:56:17.650011 (+3955255us) ts_tablet_manager.cc:1151] Deleting tablet eac01fc222dd480cbed7cac37a0e6693
0928 01:56:17.730452 (+ 80441us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b5800000f98. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a19fae8a1 00007f0a1a0f2b51 00007f0a1a0f3182 00007f0a230662c9 00007f0a22277918 00007f0a2233e2c9 00007f0a2233e8c3 00007f0a2236f960 00007f0a22355e6d 00007f0a22355e19 00007f0a22355da9
0928 01:56:17.730515 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:18.036005 (+305490us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:18.091761 (+ 55756us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:18.406180 (+314419us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181388672,"tablet-delete.queue_time_us":3954452}
I20260928 01:56:18.410830 21972 raft_consensus.cc:515] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.362401 21862 leader_election.cc:290] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:18.400873 21948 raft_consensus.cc:493] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:18.417994 21948 raft_consensus.cc:515] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:18.421480 21972 leader_election.cc:290] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:18.427927 20029 tablet_bootstrap.cc:492] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:18.429013 21909 tablet_replica.cc:333] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:18.420143 21948 leader_election.cc:290] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:18.433336 20029 ts_tablet_manager.cc:1403] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.771s	user 0.018s	sys 0.022s
W20260928 01:56:18.359074 21976 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.344s	user 0.014s	sys 0.010s
I20260928 01:56:18.438727 22078 leader_election.cc:290] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:18.430456 21909 raft_consensus.cc:2243] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:18.460873 19758 raft_consensus.cc:1275] T e927cd8a991f46278c2bb663cee7f753 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:56:18.461635 21997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55034 (request call id 36) took 4535 ms. Trace:
I20260928 01:56:18.450693 21999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55034 (request call id 15) took 4787 ms. Trace:
I20260928 01:56:18.454335 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.455900 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.439975 22076 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:57616 (request call id 16) took 4845 ms. Trace:
I20260928 01:56:18.473544 22098 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:18.474102 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 357 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:18.479244 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 21) took 4941 ms. Trace:
I20260928 01:56:18.479641 21881 rpcz_store.cc:276] 0928 01:56:13.537699 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.537801 (+   102us) service_pool.cc:224] Handling call
0928 01:56:17.929780 (+4391979us) ts_tablet_manager.cc:1151] Deleting tablet 7daa1b799e0d408287edc03988f5b683
0928 01:56:17.929859 (+    79us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:18.045283 (+115424us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:18.086462 (+ 41179us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:18.191308 (+104846us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b5800000f98. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc19ec558a1 00007fc19ed99b51 00007fc19ed9a2ee 00007fc1a7d0d309 00007fc1a6f1e9e1 00007fc1a6fe5e36 00007fc1a7016960 00007fc1a6ffce6d 00007fc1a6ffce19 00007fc1a6ffcda9 00007fc1a6ffcd71
0928 01:56:18.479120 (+287812us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14507264,"tablet-delete.queue_time_us":4391430}
I20260928 01:56:18.468326 22076 rpcz_store.cc:276] 0928 01:56:13.594969 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.595182 (+   213us) service_pool.cc:224] Handling call
0928 01:56:18.439811 (+4844629us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.630497 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.630942 (+   445us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.630973 (+    31us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.631017 (+    44us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.631146 (+   129us) alter_schema_op.cc:128] START. Timestamp: 1790560573631076
0928 01:56:13.631166 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.635573 (+  4407us) log.cc:844] Serialized 173 byte log entry
0928 01:56:18.047970 (+4412397us) op_driver.cc:464] REPLICATION: finished
0928 01:56:18.121965 (+ 73995us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:18.125167 (+  3202us) log.cc:844] Serialized 5 byte log entry
0928 01:56:18.437074 (+311907us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:18.437961 (+   887us) log.cc:844] Serialized 14 byte log entry
0928 01:56:18.439560 (+  1599us) alter_schema_op.cc:73] Released schema lock
0928 01:56:18.439608 (+    48us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":73734,"prepare.queue_time_us":34318,"prepare.run_cpu_time_us":2203,"prepare.run_wall_time_us":23927,"replication_time_us":4416633,"thread_start_us":445024,"threads_started":4,"wal-append.queue_time_us":261094,"wal-append.run_cpu_time_us":1727,"wal-append.run_wall_time_us":1013585}]]}
I20260928 01:56:18.490190 21961 consensus_queue.cc:1059] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:18.491721 21962 raft_consensus.cc:3055] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:18.492096 21962 raft_consensus.cc:740] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:18.493028 21962 consensus_queue.cc:260] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.456161 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.457617 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.464975 20029 raft_consensus.cc:359] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.507815 20029 raft_consensus.cc:385] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:18.508160 20029 raft_consensus.cc:740] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:18.508888 20029 consensus_queue.cc:260] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.516134 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cacb4a90a54cd3b5b3e7a9310e06ed" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.519186 19768 raft_consensus.cc:1240] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:18.521404 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b836e20d6b43cba8eaa08887afb076" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.522291 19618 raft_consensus.cc:2468] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:18.523097 19766 raft_consensus.cc:1240] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:18.462060 21997 rpcz_store.cc:276] 0928 01:56:13.926530 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.931153 (+  4623us) service_pool.cc:224] Handling call
0928 01:56:18.461558 (+4530405us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.934535 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.935331 (+   796us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.935399 (+    68us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.935526 (+   127us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:14.014221 (+ 78695us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b2c00004d28. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a20498c91 00007f0a204a7c8a 00007f0a204a7913 00007f0a204a78b1 00007f0a212c80c2 00007f0a212c7e9d 00007f0a21718453 00007f0a21717f68 00007f0a2171cc01 00007f0a2171cbb9 00007f0a2171cb49
0928 01:56:14.014461 (+   240us) alter_schema_op.cc:128] START. Timestamp: 1790560574004422
0928 01:56:14.014520 (+    59us) op_driver.cc:348] REPLICATION: starting
0928 01:56:14.015786 (+  1266us) log.cc:844] Serialized 173 byte log entry
0928 01:56:17.341547 (+3325761us) op_driver.cc:464] REPLICATION: finished
0928 01:56:18.006265 (+664718us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:18.007751 (+  1486us) log.cc:844] Serialized 5 byte log entry
0928 01:56:18.440878 (+433127us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:18.442866 (+  1988us) log.cc:844] Serialized 14 byte log entry
0928 01:56:18.461356 (+ 18490us) alter_schema_op.cc:73] Released schema lock
0928 01:56:18.461398 (+    42us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":645699,"mutex_wait_us":166242,"prepare.queue_time_us":593,"prepare.run_cpu_time_us":28070,"prepare.run_wall_time_us":575432,"raft.queue_time_us":172611,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":141,"replication_time_us":3326849,"spinlock_wait_cycles":158254464,"thread_start_us":313616,"threads_started":2,"wal-append.queue_time_us":512815,"wal-append.run_cpu_time_us":5340,"wal-append.run_wall_time_us":1145358}]]}
I20260928 01:56:18.534915 21909 raft_consensus.cc:2272] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:18.537091 22076 tablet.cc:1751] T 0b222e5366a64f52bc97acd551c7a067 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.535773 19762 raft_consensus.cc:1240] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
W20260928 01:56:18.550653 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 220778us
I20260928 01:56:18.556188 22090 tablet.cc:1751] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
W20260928 01:56:18.520253 21975 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.392s	user 0.025s	sys 0.003s
I20260928 01:56:18.576598 19457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.583465 19890 tablet_bootstrap.cc:492] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:18.583966 19890 ts_tablet_manager.cc:1403] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.543s	user 0.016s	sys 0.014s
I20260928 01:56:18.589947 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea6adefd15a4ea19011419949047e83" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.590996 22031 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:57616 (request call id 15) took 4996 ms. Trace:
I20260928 01:56:18.598838 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:18.599967 19412 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:18.601991 19618 raft_consensus.cc:1240] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:18.604036 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7daa1b799e0d408287edc03988f5b683" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:18.607861 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 56529.7us
W20260928 01:56:18.608759 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 130622us
I20260928 01:56:18.584354 22091 tablet.cc:1751] T 0287060a8d054b15b2252dcf280ca8c2 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.586180 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.566942 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:18.564888 22088 tablet.cc:1751] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.626579 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb014699060e4a6caf4caaf33c31710a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.629853 21881 tablet_replica.cc:333] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:18.631042 19766 raft_consensus.cc:1240] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:18.650717 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 7daa1b799e0d408287edc03988f5b683 (table default.Table_7b0eeaea0af144bf8165b6228c454e7e [id=a051e78b19ab4fe1be3db9e064eaf56d]) successfully deleted
W20260928 01:56:18.655772 22083 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.363s	user 0.002s	sys 0.011s
I20260928 01:56:18.663123 19461 raft_consensus.cc:2468] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:18.591601 22031 rpcz_store.cc:276] 0928 01:56:13.594651 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.595874 (+  1223us) service_pool.cc:224] Handling call
0928 01:56:18.590872 (+4994998us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.654591 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.713773 (+ 59182us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.713816 (+    43us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.713858 (+    42us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.713987 (+   129us) alter_schema_op.cc:128] START. Timestamp: 1790560573713927
0928 01:56:13.714008 (+    21us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.714484 (+   476us) log.cc:844] Serialized 173 byte log entry
0928 01:56:18.033892 (+4319408us) op_driver.cc:464] REPLICATION: finished
0928 01:56:18.034419 (+   527us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:18.036218 (+  1799us) log.cc:844] Serialized 5 byte log entry
0928 01:56:18.535691 (+499473us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:18.590461 (+ 54770us) log.cc:844] Serialized 14 byte log entry
0928 01:56:18.590597 (+   136us) alter_schema_op.cc:73] Released schema lock
0928 01:56:18.590642 (+    45us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":290,"prepare.queue_time_us":57784,"prepare.run_cpu_time_us":1309,"prepare.run_wall_time_us":60090,"replication_time_us":4319606,"thread_start_us":278963,"threads_started":2,"wal-append.queue_time_us":118467}]]}
I20260928 01:56:18.670423 19890 raft_consensus.cc:359] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:18.671167 19890 raft_consensus.cc:385] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:18.671464 19890 raft_consensus.cc:740] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:18.672811 19890 consensus_queue.cc:260] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:18.679246 19890 ts_tablet_manager.cc:1434] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.001s
I20260928 01:56:18.679855 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.680505 19607 raft_consensus.cc:2468] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:18.686200 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:18.664399 21962 raft_consensus.cc:3060] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:18.665731 21881 raft_consensus.cc:2243] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:18.693230 21881 raft_consensus.cc:2272] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:18.694602 19890 tablet_bootstrap.cc:492] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:18.695441 21881 ts_tablet_manager.cc:1916] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:18.699662 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
I20260928 01:56:18.553337 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53d75604ee3405d83fe9ecaa824ea68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.705837 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:18.707229 19611 raft_consensus.cc:2468] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:18.707998 20029 ts_tablet_manager.cc:1434] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.274s	user 0.006s	sys 0.000s
I20260928 01:56:18.706372 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cc307b127446958bd4199a1aa60adb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.711041 19755 raft_consensus.cc:1240] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 2. Current term is 3. Ops: []
I20260928 01:56:18.711045 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c320eb2ca2ac4ac68293ef8f7400b45f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.711951 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.712327 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.714087 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.717314 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897503329be649e38473561cea1fdaf1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.717253 19757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cfc9ff3344a48b09730dfde79d6cf" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.721808 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36076aa674b9401b9b76fbf066348d06" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:18.722541 22095 log.cc:927] Time spent T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260928 01:56:18.723256 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.724170 19754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.1:45657 (request call id 715) took 1245 ms. Trace:
I20260928 01:56:18.724609 21997 tablet.cc:1751] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.724532 19754 rpcz_store.cc:276] 0928 01:56:17.478422 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:17.548442 (+ 70020us) service_pool.cc:224] Handling call
0928 01:56:17.660289 (+111847us) raft_consensus.cc:1471] Updating replica for 2 ops
0928 01:56:17.928468 (+268179us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 01:56:17.928501 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0928 01:56:17.948354 (+ 19853us) alter_schema_op.cc:128] START. Timestamp: 1790560573655438
0928 01:56:18.154823 (+206469us) log.cc:844] Serialized 199 byte log entry
0928 01:56:18.467666 (+312843us) raft_consensus.cc:1645] Marking committed up to 1
0928 01:56:18.468180 (+   514us) log.cc:844] Serialized 14 byte log entry
0928 01:56:18.468447 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:56:18.468536 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:56:18.723945 (+255409us) raft_consensus.cc:1685] finished
0928 01:56:18.723969 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:56:18.724109 (+   140us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:18.171958 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:18.172399 (+   441us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:18.172435 (+    36us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:18.172497 (+    62us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
Metrics: {"mutex_wait_us":26385,"prepare.queue_time_us":121,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":32076,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":329,"thread_start_us":312455,"threads_started":1,"wal-append.queue_time_us":312753,"child_traces":[["op",{"prepare.queue_time_us":223283,"prepare.run_cpu_time_us":631,"prepare.run_wall_time_us":632,"thread_start_us":202064,"threads_started":1}]]}
I20260928 01:56:18.730968 22072 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:57616 (request call id 17) took 5129 ms. Trace:
I20260928 01:56:18.507427 21999 rpcz_store.cc:276] 0928 01:56:13.663292 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.678815 (+ 15523us) service_pool.cc:224] Handling call
0928 01:56:18.450600 (+4771785us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.680117 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.680519 (+   402us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.680552 (+    33us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.680623 (+    71us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.680742 (+   119us) alter_schema_op.cc:128] START. Timestamp: 1790560573680538
0928 01:56:13.680760 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.681350 (+   590us) log.cc:844] Serialized 173 byte log entry
0928 01:56:17.293818 (+3612468us) op_driver.cc:464] REPLICATION: finished
0928 01:56:17.965436 (+671618us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:17.966779 (+  1343us) log.cc:844] Serialized 5 byte log entry
0928 01:56:18.436853 (+470074us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:18.449205 (+ 12352us) log.cc:844] Serialized 14 byte log entry
0928 01:56:18.450434 (+  1229us) alter_schema_op.cc:73] Released schema lock
0928 01:56:18.450470 (+    36us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":671444,"prepare.queue_time_us":299,"prepare.run_cpu_time_us":24559,"prepare.run_wall_time_us":304029,"raft.queue_time_us":27424,"raft.run_cpu_time_us":4468,"raft.run_wall_time_us":78167,"replication_time_us":3612934,"thread_start_us":440651,"threads_started":3,"wal-append.queue_time_us":601270,"wal-append.run_cpu_time_us":2361,"wal-append.run_wall_time_us":1055558}]]}
I20260928 01:56:18.736850 21999 tablet.cc:1751] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.737589 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.732694 22072 rpcz_store.cc:276] 0928 01:56:13.601554 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.601841 (+   287us) service_pool.cc:224] Handling call
0928 01:56:18.730890 (+5129049us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.706242 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.706736 (+   494us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.706771 (+    35us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.706818 (+    47us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.706959 (+   141us) alter_schema_op.cc:128] START. Timestamp: 1790560573706898
0928 01:56:13.706981 (+    22us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.707619 (+   638us) log.cc:844] Serialized 173 byte log entry
0928 01:56:18.101900 (+4394281us) op_driver.cc:464] REPLICATION: finished
0928 01:56:18.154412 (+ 52512us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:18.193223 (+ 38811us) log.cc:844] Serialized 5 byte log entry
0928 01:56:18.698449 (+505226us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:18.729636 (+ 31187us) log.cc:844] Serialized 14 byte log entry
0928 01:56:18.730614 (+   978us) alter_schema_op.cc:73] Released schema lock
0928 01:56:18.730739 (+   125us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":52268,"prepare.queue_time_us":103249,"prepare.run_cpu_time_us":3158,"prepare.run_wall_time_us":147593,"replication_time_us":4394626,"thread_start_us":351237,"threads_started":4,"wal-append.queue_time_us":172830,"wal-append.run_cpu_time_us":2090,"wal-append.run_wall_time_us":1052277}]]}
I20260928 01:56:18.739925 21909 ts_tablet_manager.cc:1916] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:18.742357 22103 log.cc:927] Time spent T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260928 01:56:18.748616 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.753753 22076 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:57616 (request call id 20) took 5151 ms. Trace:
W20260928 01:56:18.758369 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 67543us
I20260928 01:56:18.759406 22078 consensus_queue.cc:1048] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:18.762924 21976 tablet.cc:1751] T 897503329be649e38473561cea1fdaf1 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.765070 20029 tablet_bootstrap.cc:492] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:18.769125 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.770589 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.774523 22083 tablet.cc:1751] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.785454 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.785562 19185 catalog_manager.cc:5838] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:18.789353 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:56:18.791141 19757 raft_consensus.cc:1240] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
W20260928 01:56:18.793269 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 452130us
I20260928 01:56:18.793999 19703 leader_election.cc:304] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:56:18.793958 19553 leader_election.cc:343] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:18.795282 22054 consensus_queue.cc:1059] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260928 01:56:18.795889 22090 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.238s	user 0.000s	sys 0.012s
I20260928 01:56:18.796589 22054 raft_consensus.cc:3055] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:18.796931 22054 raft_consensus.cc:740] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:18.797708 22054 consensus_queue.cc:260] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:18.799000 22054 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:18.805544 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet eac01fc222dd480cbed7cac37a0e6693 with delete_type TABLET_DATA_DELETED (replaced by tablet 522245da435b40ae84ae6dc5d19a2e95) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:18.809288 22106 raft_consensus.cc:493] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:18.810096 22106 raft_consensus.cc:515] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:18.813354 22106 leader_election.cc:290] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:18.813362 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:18.616174 19704 leader_election.cc:343] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:18.815328 19704 leader_election.cc:304] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:18.817710 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ae3663fbe024a4e946e47339a4b9090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:18.820647 19890 tablet_bootstrap.cc:654] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:18.826396 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
W20260928 01:56:18.828258 22088 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.204s	user 0.004s	sys 0.006s
I20260928 01:56:18.829814 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ab79c6ad03e481a903a0f95ae0512e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:41 UTC) from {username='slave'} at 127.0.0.1:50444
W20260928 01:56:18.843622 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 49704.7us
I20260928 01:56:18.844766 22050 raft_consensus.cc:2804] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:18.843137 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3505a502bff747deaf1e03c03375aafa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.845311 22050 raft_consensus.cc:493] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:18.845855 22050 raft_consensus.cc:3060] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:18.846141 19703 leader_election.cc:304] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:18.847121 21972 raft_consensus.cc:2804] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:18.847582 21972 raft_consensus.cc:493] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:18.847574 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.848080 21972 raft_consensus.cc:3060] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:18.851402 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22fc9eff28c4436fb383c3d7169171bb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.852890 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5e07078b2a4fe59d9293d9511cbb6b" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.852989 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:18.854236 21948 consensus_queue.cc:1059] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:18.855929 21948 raft_consensus.cc:3055] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:18.856281 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet e05925303152462e8ca25cd15f3bedff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:18.856480 21948 raft_consensus.cc:740] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:18.857988 21948 consensus_queue.cc:260] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:18.859445 21948 raft_consensus.cc:3060] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:18.855154 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:18.862562 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:18.840916 21975 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55034 (request call id 28) took 5138 ms. Trace:
I20260928 01:56:18.867864 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c6cfc9ff3344a48b09730dfde79d6cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:18.867300 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5e07078b2a4fe59d9293d9511cbb6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:50444
W20260928 01:56:18.871925 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 255803us
W20260928 01:56:18.860450 22091 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.242s	user 0.006s	sys 0.003s
I20260928 01:56:18.872941 21858 raft_consensus.cc:2749] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:18.873256 19758 raft_consensus.cc:1240] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:18.880923 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.881811 19612 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:18.883912 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376b5a87b07b4f87a2a502b5fa1b23f8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.877542 19754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7441c2d1a7fa4dc8a89c6717a80d3efb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:18.886288 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.891711 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
I20260928 01:56:18.912545 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555e557370a4e92915a9c55107b573b" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.913431 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet 7daa1b799e0d408287edc03988f5b683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:18.754195 22076 rpcz_store.cc:276] 0928 01:56:13.602674 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.605460 (+  2786us) service_pool.cc:224] Handling call
0928 01:56:18.753627 (+5148167us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.712036 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.712522 (+   486us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.712559 (+    37us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.712621 (+    62us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.712743 (+   122us) alter_schema_op.cc:128] START. Timestamp: 1790560573712688
0928 01:56:13.712763 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.713378 (+   615us) log.cc:844] Serialized 173 byte log entry
0928 01:56:18.454909 (+4741531us) op_driver.cc:464] REPLICATION: finished
0928 01:56:18.536895 (+ 81986us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:18.538976 (+  2081us) log.cc:844] Serialized 5 byte log entry
0928 01:56:18.752511 (+213535us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:18.753325 (+   814us) log.cc:844] Serialized 14 byte log entry
0928 01:56:18.753433 (+   108us) alter_schema_op.cc:73] Released schema lock
0928 01:56:18.753466 (+    33us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":81781,"prepare.queue_time_us":105551,"prepare.run_cpu_time_us":2340,"prepare.run_wall_time_us":76622,"replication_time_us":4741926,"thread_start_us":337237,"threads_started":4,"wal-append.queue_time_us":205446,"wal-append.run_cpu_time_us":2182,"wal-append.run_wall_time_us":1058046}]]}
I20260928 01:56:18.920637 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:35 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:18.922070 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b222e5366a64f52bc97acd551c7a067" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.923411 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.925163 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.926306 20029 tablet_bootstrap.cc:654] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:18.937362 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:18.938376 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:18.941049 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
W20260928 01:56:18.942260 19522 heartbeater.cc:646] Failed to heartbeat to 127.18.161.61:43775 (6 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.18.161.61:43775 timed out after 1.000s (SENT)
I20260928 01:56:18.942958 19522 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:18.946259 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab12ba3e1f542949e3f203dae0fa80e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.947983 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.951668 19890 tablet_bootstrap.cc:492] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:18.952950 19890 ts_tablet_manager.cc:1403] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.259s	user 0.014s	sys 0.001s
W20260928 01:56:18.952807 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 80113.9us
I20260928 01:56:18.962705 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.964363 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12bafcc09ef4342bff89b0475f721af" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:18.971748 19667 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:18.869314 21975 rpcz_store.cc:276] 0928 01:56:13.697970 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.742297 (+ 44327us) service_pool.cc:224] Handling call
0928 01:56:18.836718 (+5094421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.743767 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.745220 (+  1453us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.745256 (+    36us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.745325 (+    69us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.745472 (+   147us) alter_schema_op.cc:128] START. Timestamp: 1790560573745240
0928 01:56:13.745491 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.746054 (+   563us) log.cc:844] Serialized 173 byte log entry
0928 01:56:17.342135 (+3596081us) op_driver.cc:464] REPLICATION: finished
0928 01:56:18.075033 (+732898us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:18.128010 (+ 52977us) log.cc:844] Serialized 5 byte log entry
0928 01:56:18.775355 (+647345us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:18.776073 (+   718us) log.cc:844] Serialized 14 byte log entry
0928 01:56:18.776180 (+   107us) alter_schema_op.cc:73] Released schema lock
0928 01:56:18.790821 (+ 14641us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":732692,"prepare.queue_time_us":241,"prepare.run_cpu_time_us":13323,"prepare.run_wall_time_us":261578,"replication_time_us":3596478,"thread_start_us":607216,"threads_started":2,"wal-append.queue_time_us":590993,"wal-append.run_cpu_time_us":5201,"wal-append.run_wall_time_us":1283805}]]}
I20260928 01:56:18.973315 21975 tablet.cc:1751] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:18.977576 22088 tablet.cc:1751] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
W20260928 01:56:18.960364 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 114305us
I20260928 01:56:18.981012 22050 raft_consensus.cc:515] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:18.982837 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b520e89c364692af1aedde2a59c3da" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:18.982970 19184 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 252) took 7174 ms (client timeout 1000 ms). Trace:
I20260928 01:56:18.972007 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:18.985327 22050 leader_election.cc:290] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:18.985872 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:18.986971 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:18.989368 19754 raft_consensus.cc:1240] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:19.000190 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1710b95678440b1bff8a92080d43272" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.001511 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d114d5ba862044b4b88eee27395db7e3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.002761 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.004395 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.007074 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
I20260928 01:56:19.007249 19703 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:19.013090 21972 raft_consensus.cc:515] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.015380 21972 leader_election.cc:290] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:19.022485 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.024319 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.026453 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.027042 22097 raft_consensus.cc:2804] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:19.027567 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.027591 22097 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:19.028105 22097 raft_consensus.cc:3060] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:19.028371 19618 raft_consensus.cc:2468] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:19.031162 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.036732 19890 raft_consensus.cc:359] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:19.038900 19703 consensus_peers.cc:597] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e05925303152462e8ca25cd15f3bedff. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:19.046125 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
W20260928 01:56:18.983709 19184 rpcz_store.cc:269] 0928 01:56:11.807934 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:12.499653 (+691719us) service_pool.cc:224] Handling call
0928 01:56:18.982295 (+6482642us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:17.545612 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:17.546193 (+   581us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:17.546223 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:56:17.546238 (+    15us) tablet.cc:662] Decoding operations
0928 01:56:17.546571 (+   333us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:17.546631 (+    60us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:17.546669 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:17.546878 (+   209us) tablet.cc:701] Row locks acquired
0928 01:56:17.546896 (+    18us) write_op.cc:260] PREPARE: finished
0928 01:56:17.547048 (+   152us) write_op.cc:270] Start()
0928 01:56:17.547142 (+    94us) write_op.cc:276] Timestamp: P: 1790560577546970 usec, L: 0
0928 01:56:17.547161 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:17.692557 (+145396us) log.cc:844] Serialized 530 byte log entry
0928 01:56:17.888795 (+196238us) op_driver.cc:464] REPLICATION: finished
0928 01:56:18.076082 (+187287us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b1800063d60. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcf9e9b81 00007f2fcf9f6571 00007f2fc6aef363 00007f2fc6af1751 00007f2fc6af1709 00007f2fc6af1699 00007f2fc6af1661 00007f2fc6af095d 00000000005bd4e4 00000000005bd319 00007f2fc6ad281a
0928 01:56:18.076226 (+   144us) write_op.cc:301] APPLY: starting
0928 01:56:18.076291 (+    65us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:18.076408 (+   117us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:18.076434 (+    26us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:18.076678 (+   244us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:18.076838 (+   160us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:18.076885 (+    47us) write_op.cc:312] APPLY: finished
0928 01:56:18.077143 (+   258us) log.cc:844] Serialized 23 byte log entry
0928 01:56:18.077880 (+   737us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:18.077950 (+    70us) write_op.cc:454] Released schema lock
0928 01:56:18.077986 (+    36us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:18.078272 (+   286us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:18.078297 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":243039,"reported_tablets":112,"child_traces":[["op",{"apply.queue_time_us":80046,"apply.run_cpu_time_us":1482,"apply.run_wall_time_us":2032,"num_ops":1,"prepare.queue_time_us":527371,"prepare.run_cpu_time_us":4131,"prepare.run_wall_time_us":168552,"raft.queue_time_us":42344,"raft.run_cpu_time_us":845,"raft.run_wall_time_us":6402,"replication_time_us":341480,"spinlock_wait_cycles":26400512,"thread_start_us":773340,"threads_started":3,"wal-append.queue_time_us":19244}]]}
I20260928 01:56:19.062572 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
W20260928 01:56:19.066803 21997 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.341s	user 0.007s	sys 0.005s
I20260928 01:56:19.037575 19890 raft_consensus.cc:385] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:19.070755 19890 raft_consensus.cc:740] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:19.073055 19890 consensus_queue.cc:260] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:19.082506 19409 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 145437us
W20260928 01:56:19.083479 19409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:19.088822 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.088734 22097 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:19.090767 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bec2c4274497ea73872d0db233eac" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.091080 22097 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:19.091626 19612 raft_consensus.cc:2468] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:19.091718 19754 raft_consensus.cc:1240] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 2. Current term is 3. Ops: []
W20260928 01:56:19.095672 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 56174.4us
I20260928 01:56:19.099299 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb014699060e4a6caf4caaf33c31710a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.100032 19618 raft_consensus.cc:2468] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:19.101049 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7801c623930d4e4eaf24c5c424b06d26" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.103348 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.104583 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.105307 19618 raft_consensus.cc:2468] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:19.105630 19704 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.107216 19890 ts_tablet_manager.cc:1434] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.154s	user 0.006s	sys 0.001s
I20260928 01:56:19.108548 19890 tablet_bootstrap.cc:492] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:19.112599 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22606f012f1c44bd92c8e0341e9ca2b7" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.115487 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.116819 19768 raft_consensus.cc:1240] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:19.117403 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.122365 20029 tablet_bootstrap.cc:492] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:19.122836 20029 ts_tablet_manager.cc:1403] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.358s	user 0.010s	sys 0.002s
W20260928 01:56:19.128355 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 83850.5us
I20260928 01:56:19.167649 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c755f16ea1496eb7fa26fb12e01708" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.169112 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6b59144fe14daab98b0965c7f8af02" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.171262 21948 raft_consensus.cc:493] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:19.172025 21948 raft_consensus.cc:515] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.175514 21948 leader_election.cc:290] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:19.183864 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cc307b127446958bd4199a1aa60adb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.188378 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.191254 21948 consensus_queue.cc:1059] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:19.192553 22054 raft_consensus.cc:3055] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:19.192950 22054 raft_consensus.cc:740] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:19.193864 22054 consensus_queue.cc:260] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.194846 22054 raft_consensus.cc:3060] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:19.199326 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.199770 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.200513 19607 raft_consensus.cc:2393] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:19.201069 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2597de2c4304074977db5a3c0426814" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.201628 19619 raft_consensus.cc:2468] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:19.204396 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522245da435b40ae84ae6dc5d19a2e95" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.209981 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9690a224bb004152ba65d525cc10bd9f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.216490 19618 raft_consensus.cc:2468] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
W20260928 01:56:19.221040 19553 leader_election.cc:343] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:19.225512 19553 leader_election.cc:343] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:19.149263 21976 tablet.cc:1751] T 22e095aba1cb4fb7be461d625a922751 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
W20260928 01:56:19.152840 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 196620us
I20260928 01:56:19.153385 22050 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:19.248106 19704 leader_election.cc:304] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
W20260928 01:56:19.248883 19704 raft_consensus.cc:2686] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:19.250800 19704 leader_election.cc:304] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.256453 21862 raft_consensus.cc:2749] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.259267 19704 leader_election.cc:304] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:19.263441 21972 raft_consensus.cc:2804] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:19.264634 21972 raft_consensus.cc:697] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:19.266083 21972 consensus_queue.cc:237] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.288692 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 0ae3663fbe024a4e946e47339a4b9090 (table default.Table_fa2cc70b96124fedb7f77c2fd58c9d89 [id=90e10f23ac7f4af489416a55f3287681]) successfully deleted
W20260928 01:56:19.209103 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 103529us
I20260928 01:56:19.292819 19703 leader_election.cc:304] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.294512 22096 raft_consensus.cc:2804] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:19.295102 22096 raft_consensus.cc:493] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:19.295698 22096 raft_consensus.cc:3060] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:19.217789 21909 ts_tablet_manager.cc:1929] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:19.300655 21909 log.cc:1199] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/7ab79c6ad03e481a903a0f95ae0512e6
I20260928 01:56:19.301898 21909 ts_tablet_manager.cc:1950] T 7ab79c6ad03e481a903a0f95ae0512e6 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:19.305817 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 20) took 5611 ms. Trace:
I20260928 01:56:19.322270 22054 consensus_queue.cc:1059] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:19.330586 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:19.331234 19472 raft_consensus.cc:2468] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:19.332245 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53d75604ee3405d83fe9ecaa824ea68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:19.333231 19461 raft_consensus.cc:1275] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:56:19.333815 19472 raft_consensus.cc:1240] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:19.334510 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:19.335723 19462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cacb4a90a54cd3b5b3e7a9310e06ed" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:19.233713 21881 ts_tablet_manager.cc:1929] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:19.340556 21881 log.cc:1199] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/f709eccf4ab5413bbbd8b4746f185db4
I20260928 01:56:19.341352 21881 ts_tablet_manager.cc:1950] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:19.342717 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 22) took 5803 ms. Trace:
I20260928 01:56:19.343050 21881 rpcz_store.cc:276] 0928 01:56:13.538860 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.538959 (+    99us) service_pool.cc:224] Handling call
0928 01:56:18.625963 (+5087004us) ts_tablet_manager.cc:1151] Deleting tablet f709eccf4ab5413bbbd8b4746f185db4
0928 01:56:18.629715 (+  3752us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:18.835130 (+205415us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:19.233194 (+398064us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:19.342645 (+109451us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5086454}
I20260928 01:56:19.344508 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet f709eccf4ab5413bbbd8b4746f185db4 (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]) successfully deleted
I20260928 01:56:19.352643 22078 raft_consensus.cc:3055] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260928 01:56:19.353065 22078 raft_consensus.cc:740] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:19.353889 22078 consensus_queue.cc:260] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:19.356011 19890 tablet_bootstrap.cc:654] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:19.322917 22076 tablet.cc:1751] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:56:19.328835 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.361428 19476 raft_consensus.cc:1240] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 2. Current term is 3. Ops: []
I20260928 01:56:19.365285 22090 tablet.cc:1751] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:56:19.374867 21961 raft_consensus.cc:493] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:19.375453 21961 raft_consensus.cc:515] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.378075 21961 leader_election.cc:290] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:19.379724 21961 raft_consensus.cc:493] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:19.380610 21961 raft_consensus.cc:515] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:19.384565 21961 leader_election.cc:290] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:19.391860 22109 raft_consensus.cc:493] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:19.392879 22109 raft_consensus.cc:515] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.397579 22109 leader_election.cc:290] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:19.415843 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea6adefd15a4ea19011419949047e83" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:19.416699 19618 raft_consensus.cc:2468] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:19.279233 21999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55034 (request call id 16) took 5589 ms. Trace:
I20260928 01:56:19.430689 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.428769 21999 rpcz_store.cc:276] 0928 01:56:13.689892 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.689999 (+   107us) service_pool.cc:224] Handling call
0928 01:56:19.279127 (+5589128us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.698621 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.699088 (+   467us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.699123 (+    35us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.699177 (+    54us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.699322 (+   145us) alter_schema_op.cc:128] START. Timestamp: 1790560573699094
0928 01:56:13.699340 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.700057 (+   717us) log.cc:844] Serialized 173 byte log entry
0928 01:56:17.972880 (+4272823us) op_driver.cc:464] REPLICATION: finished
0928 01:56:18.736751 (+763871us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:18.738185 (+  1434us) log.cc:844] Serialized 5 byte log entry
0928 01:56:19.050599 (+312414us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:19.051721 (+  1122us) log.cc:844] Serialized 14 byte log entry
0928 01:56:19.278869 (+227148us) alter_schema_op.cc:73] Released schema lock
0928 01:56:19.278942 (+    73us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":763706,"prepare.queue_time_us":7682,"prepare.run_cpu_time_us":2531,"prepare.run_wall_time_us":36610,"replication_time_us":4273383,"thread_start_us":77362,"threads_started":2,"wal-append.queue_time_us":160626,"wal-append.run_cpu_time_us":1771,"wal-append.run_wall_time_us":1010889}]]}
I20260928 01:56:19.166491 20029 raft_consensus.cc:359] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:19.432358 20029 raft_consensus.cc:385] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:19.432617 20029 raft_consensus.cc:740] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:19.433393 20029 consensus_queue.cc:260] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:19.313154 19703 leader_election.cc:304] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.272068 22050 raft_consensus.cc:2749] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.431941 21999 tablet.cc:1751] T 0b222e5366a64f52bc97acd551c7a067 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:19.424701 21997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55034 (request call id 32) took 5662 ms. Trace:
I20260928 01:56:19.437793 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.438335 21909 rpcz_store.cc:276] 0928 01:56:13.694162 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.695701 (+  1539us) service_pool.cc:224] Handling call
0928 01:56:18.408030 (+4712329us) ts_tablet_manager.cc:1151] Deleting tablet 7ab79c6ad03e481a903a0f95ae0512e6
0928 01:56:18.408095 (+    65us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:18.866368 (+458273us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:19.217628 (+351260us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:19.305700 (+ 88072us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4711621}
I20260928 01:56:19.439291 21881 tablet_replica.cc:333] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:19.450357 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.456300 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.436386 21997 rpcz_store.cc:276] 0928 01:56:13.762481 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.763061 (+   580us) service_pool.cc:224] Handling call
0928 01:56:19.424606 (+5661545us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.854373 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.988466 (+134093us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.990303 (+  1837us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:14.007678 (+ 17375us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:14.007826 (+   148us) alter_schema_op.cc:128] START. Timestamp: 1790560574007587
0928 01:56:14.007847 (+    21us) op_driver.cc:348] REPLICATION: starting
0928 01:56:14.008815 (+   968us) log.cc:844] Serialized 173 byte log entry
0928 01:56:17.586824 (+3578009us) op_driver.cc:464] REPLICATION: finished
0928 01:56:18.721729 (+1134905us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:18.725896 (+  4167us) log.cc:844] Serialized 5 byte log entry
0928 01:56:19.366939 (+641043us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:19.367785 (+   846us) log.cc:844] Serialized 14 byte log entry
0928 01:56:19.424375 (+ 56590us) alter_schema_op.cc:73] Released schema lock
0928 01:56:19.424424 (+    49us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1122194,"prepare.queue_time_us":89752,"prepare.run_cpu_time_us":8097,"prepare.run_wall_time_us":299732,"replication_time_us":3578839,"thread_start_us":559802,"threads_started":3,"wal-append.queue_time_us":667921,"wal-append.run_cpu_time_us":7246,"wal-append.run_wall_time_us":1042097}]]}
I20260928 01:56:19.459873 22090 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:50444 (request call id 30) took 5806 ms. Trace:
I20260928 01:56:19.468544 21909 tablet_replica.cc:333] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:19.441325 22096 raft_consensus.cc:515] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:19.473603 22096 leader_election.cc:290] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:19.471763 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.461400 22090 rpcz_store.cc:276] 0928 01:56:13.653697 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.653818 (+   121us) service_pool.cc:224] Handling call
0928 01:56:19.459774 (+5805956us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:13.654916 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:13.655268 (+   352us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:13.655307 (+    39us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:13.655402 (+    95us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:13.655539 (+   137us) alter_schema_op.cc:128] START. Timestamp: 1790560573655438
0928 01:56:13.655559 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:56:13.732872 (+ 77313us) log.cc:844] Serialized 173 byte log entry
0928 01:56:13.734518 (+  1646us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b54001e2154. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc1a5e9caa1 00007fc1a5f2f5e8 00007fc1a63bf791 00007fc1a63bef68 00007fc1a63c3c01 00007fc1a63c3bb9 00007fc1a63c3b49 00007fc1a63c3b11 00007fc1a63c2d3d 00000000005bd4e4 00000000005bd319
0928 01:56:19.364880 (+5630362us) op_driver.cc:464] REPLICATION: finished
0928 01:56:19.365149 (+   269us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:19.366727 (+  1578us) log.cc:844] Serialized 5 byte log entry
0928 01:56:19.427775 (+ 61048us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:19.458750 (+ 30975us) log.cc:844] Serialized 14 byte log entry
0928 01:56:19.459614 (+   864us) alter_schema_op.cc:73] Released schema lock
0928 01:56:19.459649 (+    35us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":82,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":4367,"prepare.run_wall_time_us":79828,"raft.queue_time_us":3715,"raft.run_cpu_time_us":20,"raft.run_wall_time_us":20,"replication_time_us":5709165,"spinlock_wait_cycles":175960192,"thread_start_us":2921,"threads_started":1,"wal-append.queue_time_us":3240}]]}
I20260928 01:56:19.495225 22135 tablet.cc:1751] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:19.518275 21962 raft_consensus.cc:493] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:19.518839 21962 raft_consensus.cc:515] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:19.519702 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 114926us
I20260928 01:56:19.530129 22131 tablet.cc:1751] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:19.530616 21962 leader_election.cc:290] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:19.535748 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 219448us
I20260928 01:56:19.539988 22078 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:19.540138 22129 consensus_queue.cc:1059] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:19.539978 21948 consensus_queue.cc:1059] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260928 01:56:19.547019 20456 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.533s (SENT)
I20260928 01:56:19.547533 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:19.559265 22129 raft_consensus.cc:3055] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:19.560528 22129 raft_consensus.cc:740] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:19.569192 21962 raft_consensus.cc:493] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:19.569712 21962 raft_consensus.cc:515] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.571650 21962 leader_election.cc:290] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:19.574182 22129 consensus_queue.cc:260] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.575544 22129 raft_consensus.cc:3060] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:56:19.577947 19553 consensus_peers.cc:597] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eac01fc222dd480cbed7cac37a0e6693. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:19.571625 22054 consensus_queue.cc:1059] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:19.578137 22141 tablet.cc:1751] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
W20260928 01:56:19.587637 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 64240.4us
W20260928 01:56:19.594532 20456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 47568.8us
I20260928 01:56:19.601557 21961 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:19.601596 21962 raft_consensus.cc:493] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:19.602098 21961 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.602154 21962 raft_consensus.cc:515] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.603298 22106 raft_consensus.cc:493] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:19.603786 22106 raft_consensus.cc:515] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:19.604662 21962 leader_election.cc:290] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:19.606776 22106 leader_election.cc:290] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:19.608645 21961 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:19.601285 22146 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:19.608639 19412 leader_election.cc:304] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:19.615778 22106 raft_consensus.cc:493] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:19.617195 22106 raft_consensus.cc:515] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.619203 22106 leader_election.cc:290] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:19.621980 22143 raft_consensus.cc:3055] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:19.622483 22143 raft_consensus.cc:740] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:19.623437 22143 consensus_queue.cc:260] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:19.624147 21881 raft_consensus.cc:2243] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:19.624809 22143 raft_consensus.cc:3060] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:19.626434 22106 raft_consensus.cc:2804] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:19.626571 21881 raft_consensus.cc:2272] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:19.626865 22106 raft_consensus.cc:493] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:19.627223 22106 raft_consensus.cc:3060] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:19.628898 21881 ts_tablet_manager.cc:1916] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:19.633018 22144 raft_consensus.cc:493] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:19.633634 22144 raft_consensus.cc:515] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:19.635020 22106 raft_consensus.cc:515] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.636037 22144 leader_election.cc:290] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:19.638326 19890 tablet_bootstrap.cc:492] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:19.638840 19890 ts_tablet_manager.cc:1403] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.531s	user 0.007s	sys 0.013s
I20260928 01:56:19.643285 19412 leader_election.cc:304] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.645409 21961 raft_consensus.cc:2749] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:19.648334 19557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:19.650861 19412 leader_election.cc:304] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:19.661021 19412 raft_consensus.cc:2686] T 7daa1b799e0d408287edc03988f5b683 P 37089d44fdba4b6488b5b5aea28af614: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 01:56:19.661919 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 348662us
W20260928 01:56:19.665024 19556 leader_election.cc:343] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 7ab79c6ad03e481a903a0f95ae0512e6
I20260928 01:56:19.665565 19556 leader_election.cc:304] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:19.666767 19556 leader_election.cc:304] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:19.668581 22144 raft_consensus.cc:2749] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.669413 22144 raft_consensus.cc:2749] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:19.674573 19555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:19.677163 22106 leader_election.cc:290] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:19.679251 19412 leader_election.cc:304] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:19.682365 21961 raft_consensus.cc:2804] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:19.682808 21961 raft_consensus.cc:493] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:19.683143 21961 raft_consensus.cc:3060] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:19.683220 21948 raft_consensus.cc:3055] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:19.683595 21948 raft_consensus.cc:740] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:19.684477 21948 consensus_queue.cc:260] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.685796 21948 raft_consensus.cc:3060] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:19.700636 21881 ts_tablet_manager.cc:1929] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:19.701061 21881 log.cc:1199] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/c320eb2ca2ac4ac68293ef8f7400b45f
I20260928 01:56:19.701823 21881 ts_tablet_manager.cc:1950] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:19.702451 19703 leader_election.cc:304] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.703228 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 23) took 6163 ms. Trace:
I20260928 01:56:19.701853 19412 leader_election.cc:304] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:19.705475 19412 raft_consensus.cc:2686] T c320eb2ca2ac4ac68293ef8f7400b45f P 37089d44fdba4b6488b5b5aea28af614: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:19.654719 19890 raft_consensus.cc:359] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:19.706221 19890 raft_consensus.cc:385] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:19.706532 19890 raft_consensus.cc:740] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:19.707176 19890 consensus_queue.cc:260] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:19.721554 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet eac01fc222dd480cbed7cac37a0e6693 (table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]) successfully deleted
I20260928 01:56:19.726121 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522245da435b40ae84ae6dc5d19a2e95" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:19.726408 19754 raft_consensus.cc:1240] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:19.730046 19412 leader_election.cc:304] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.734941 19757 raft_consensus.cc:1240] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:19.738749 22149 raft_consensus.cc:2804] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:19.739270 22149 raft_consensus.cc:493] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:19.739730 22149 raft_consensus.cc:3060] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:19.692027 21961 raft_consensus.cc:515] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:19.743426 19412 raft_consensus.cc:2686] T 89e1d60db21f4a8294792df3fadf5d90 P 37089d44fdba4b6488b5b5aea28af614: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:19.744602 19703 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:19.745765 21961 leader_election.cc:290] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:19.703538 21881 rpcz_store.cc:276] 0928 01:56:13.539834 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.539929 (+    95us) service_pool.cc:224] Handling call
0928 01:56:19.428523 (+5888594us) ts_tablet_manager.cc:1151] Deleting tablet c320eb2ca2ac4ac68293ef8f7400b45f
0928 01:56:19.439144 (+ 10621us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:19.636856 (+197712us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:19.700494 (+ 63638us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:19.703155 (+  2661us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185219,"tablet-delete.queue_time_us":5888021}
I20260928 01:56:19.751822 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet c320eb2ca2ac4ac68293ef8f7400b45f (table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]) successfully deleted
I20260928 01:56:19.751914 19412 leader_election.cc:304] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.752635 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.755861 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:56:19.755540 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 88840.3us
I20260928 01:56:19.757681 19556 leader_election.cc:304] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:19.760867 22109 raft_consensus.cc:2749] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.762151 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.762403 19412 leader_election.cc:304] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.765424 21881 tablet_replica.cc:333] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:19.766294 21881 raft_consensus.cc:2243] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:19.768586 21961 raft_consensus.cc:2749] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.770881 21881 raft_consensus.cc:2272] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:19.773165 21881 ts_tablet_manager.cc:1916] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:19.775010 19412 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.789219 21961 raft_consensus.cc:2749] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:19.790452 19412 leader_election.cc:304] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.791422 21961 raft_consensus.cc:2749] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:19.792775 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.792768 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.794376 19412 leader_election.cc:304] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.796792 21961 raft_consensus.cc:2749] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.798117 19412 leader_election.cc:304] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.802022 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89e1d60db21f4a8294792df3fadf5d90" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.808852 21961 raft_consensus.cc:2749] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.810305 19412 leader_election.cc:304] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:19.811107 19412 raft_consensus.cc:2686] T 8a5e07078b2a4fe59d9293d9511cbb6b P 37089d44fdba4b6488b5b5aea28af614: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:19.815091 19412 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:19.822414 21961 raft_consensus.cc:2804] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:19.822855 21961 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:19.823169 21961 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:19.834473 19412 leader_election.cc:304] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.835693 19615 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:19.831228 21961 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:19.838842 22106 raft_consensus.cc:2749] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.848816 19412 leader_election.cc:304] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.855414 22106 raft_consensus.cc:2749] T 1555e557370a4e92915a9c55107b573b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.856829 19412 leader_election.cc:304] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.854259 21961 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:19.859272 22106 raft_consensus.cc:2749] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.801232 22152 raft_consensus.cc:2804] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:19.861991 19412 leader_election.cc:304] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.861086 22152 raft_consensus.cc:493] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:19.868923 22152 raft_consensus.cc:3060] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:19.870633 19412 leader_election.cc:304] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.871305 21961 raft_consensus.cc:2749] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.874537 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.837703 19620 raft_consensus.cc:2468] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:19.839406 19612 raft_consensus.cc:2468] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:19.879240 21999 tablet.cc:1751] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:56:19.883891 21862 raft_consensus.cc:2749] T bab12ba3e1f542949e3f203dae0fa80e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.889736 21972 raft_consensus.cc:2804] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:19.890302 21972 raft_consensus.cc:697] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:19.890498 19749 raft_consensus.cc:1240] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:19.897925 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:19.905776 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:56:19.908594 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 151186us
I20260928 01:56:19.891476 21972 consensus_queue.cc:237] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:19.909543 19556 leader_election.cc:304] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:19.911612 22054 raft_consensus.cc:2804] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:19.911964 22054 raft_consensus.cc:493] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:19.912324 22054 raft_consensus.cc:3060] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:19.922996 19890 ts_tablet_manager.cc:1434] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.284s	user 0.004s	sys 0.002s
I20260928 01:56:19.924309 19556 leader_election.cc:304] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:19.916275 22131 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.385s	user 0.002s	sys 0.004s
W20260928 01:56:19.916162 22141 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.306s	user 0.000s	sys 0.005s
I20260928 01:56:19.926614 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:19.928026 19890 tablet_bootstrap.cc:492] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:19.933785 20029 ts_tablet_manager.cc:1434] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.811s	user 0.008s	sys 0.005s
W20260928 01:56:19.934172 20029 ts_tablet_manager.cc:1467] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da: Tablet startup took 811ms
W20260928 01:56:19.934437 20029 ts_tablet_manager.cc:1469] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da: Trace:
0928 01:55:45.121559 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:45.121728 (+   169us) service_pool.cc:224] Handling call
0928 01:55:45.134160 (+ 12432us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0928 01:55:45.148973 (+ 14813us) ts_tablet_manager.cc:682] Creating new metadata...
0928 01:55:45.203720 (+ 54747us) tablet_metadata.cc:665] Metadata flushed
0928 01:55:45.285991 (+ 82271us) tablet_replica.cc:206] Creating consensus instance
0928 01:55:45.292524 (+  6533us) inbound_call.cc:177] Queueing success response
0928 01:56:18.764736 (+33472212us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0928 01:56:19.123092 (+358356us) ts_tablet_manager.cc:1435] Starting tablet replica
0928 01:56:19.147882 (+ 24790us) tablet_replica.cc:261] Starting instrumentation
0928 01:56:19.148490 (+   608us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":451770,"raft.queue_time_us":458150,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":417,"tablet-open.queue_time_us":33436436,"thread_start_us":43790,"threads_started":1}
I20260928 01:56:19.937589 20029 tablet_bootstrap.cc:492] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:19.946854 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
I20260928 01:56:19.950362 21961 raft_consensus.cc:2749] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:19.951463 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 80929.3us
I20260928 01:56:19.952227 19412 leader_election.cc:304] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.952927 21961 raft_consensus.cc:2749] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:19.956605 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 371106us
I20260928 01:56:19.865324 21881 ts_tablet_manager.cc:1929] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260928 01:56:19.968449 21881 log.cc:1199] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/7602706a3fbc438d8d448c9ac057087c
I20260928 01:56:19.969301 21881 ts_tablet_manager.cc:1950] T 7602706a3fbc438d8d448c9ac057087c P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:19.974781 19412 leader_election.cc:304] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.975548 21961 raft_consensus.cc:2749] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:19.976807 19412 leader_election.cc:343] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:19.977187 19412 leader_election.cc:304] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.898629 22149 raft_consensus.cc:515] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:19.981225 21961 raft_consensus.cc:2749] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:19.982378 19412 leader_election.cc:343] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:19.984920 19412 leader_election.cc:304] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.990286 21961 raft_consensus.cc:2749] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:19.991714 19412 leader_election.cc:343] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:19.992113 19412 leader_election.cc:304] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:20.005062 19412 leader_election.cc:343] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:20.006577 19412 leader_election.cc:304] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.947937 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:20.008961 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:20.009780 22106 raft_consensus.cc:2749] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:20.008487 19412 leader_election.cc:304] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.010787 21961 raft_consensus.cc:2749] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:20.012925 22106 raft_consensus.cc:2749] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.014600 19412 leader_election.cc:304] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.016287 21961 raft_consensus.cc:2749] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.016369 22145 consensus_queue.cc:1059] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:20.017398 19412 leader_election.cc:304] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:19.963707 19556 leader_election.cc:304] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:19.964941 22144 raft_consensus.cc:2749] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:19.991664 22153 raft_consensus.cc:493] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:20.020406 22153 raft_consensus.cc:515] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.023747 22153 leader_election.cc:290] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:20.024945 22144 raft_consensus.cc:2749] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:20.026185 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 62566.6us
I20260928 01:56:20.007776 22078 raft_consensus.cc:493] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:20.046446 22078 raft_consensus.cc:515] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:20.048775 19556 leader_election.cc:304] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.050699 19556 leader_election.cc:304] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.051813 19556 leader_election.cc:304] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.049606 22078 leader_election.cc:290] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:20.035269 22161 raft_consensus.cc:493] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:20.053037 22078 raft_consensus.cc:2749] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.053298 22161 raft_consensus.cc:515] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.055956 22161 leader_election.cc:290] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:20.052397 22153 raft_consensus.cc:2749] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.045791 22129 raft_consensus.cc:3055] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:20.056988 22129 raft_consensus.cc:740] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:20.057890 22129 consensus_queue.cc:260] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:20.067147 19890 tablet_bootstrap.cc:654] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:20.084446 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.093640 21961 raft_consensus.cc:2749] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:20.095419 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 78102.2us
I20260928 01:56:20.096128 19412 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:20.096699 19412 raft_consensus.cc:2686] T f709eccf4ab5413bbbd8b4746f185db4 P 37089d44fdba4b6488b5b5aea28af614: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:20.098456 19412 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.099423 19412 leader_election.cc:304] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.107384 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416ccc1323fe41b2a7783dc95bba8d84" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.110203 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 24) took 6569 ms. Trace:
I20260928 01:56:20.110574 21881 rpcz_store.cc:276] 0928 01:56:13.540877 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.540975 (+    98us) service_pool.cc:224] Handling call
0928 01:56:19.753597 (+6212622us) ts_tablet_manager.cc:1151] Deleting tablet 7602706a3fbc438d8d448c9ac057087c
0928 01:56:19.765298 (+ 11701us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:19.805004 (+ 39706us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:19.865190 (+ 60186us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:20.110116 (+244926us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3983,"spinlock_wait_cycles":5888,"tablet-delete.queue_time_us":6212023}
I20260928 01:56:20.112881 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 7602706a3fbc438d8d448c9ac057087c (table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]) successfully deleted
I20260928 01:56:20.113958 21961 raft_consensus.cc:2749] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.114476 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:56:20.114609 21961 raft_consensus.cc:493] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:20.115098 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:20.115007 21961 raft_consensus.cc:515] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:20.115835 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:20.119606 20029 tablet_bootstrap.cc:654] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:20.125133 22106 raft_consensus.cc:2804] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:20.125583 22106 raft_consensus.cc:493] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:20.125905 22106 raft_consensus.cc:3060] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:20.129608 19412 leader_election.cc:304] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.130481 22109 raft_consensus.cc:2749] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.131726 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:20.134373 22149 leader_election.cc:290] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:20.136237 21961 leader_election.cc:290] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:20.137369 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.138788 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.140271 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.141055 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.141716 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a73835e2854976b40b31fe752d1b1b" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.143076 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.144634 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b836e20d6b43cba8eaa08887afb076" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:20.080644 19621 raft_consensus.cc:2468] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:20.081820 22054 raft_consensus.cc:515] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:20.010481 22076 tablet.cc:1751] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
W20260928 01:56:20.080077 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 64063.2us
I20260928 01:56:20.148277 21881 tablet_replica.cc:333] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:20.157136 21881 raft_consensus.cc:2243] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:20.157769 21881 raft_consensus.cc:2272] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:20.158824 22054 leader_election.cc:290] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:20.084537 22129 raft_consensus.cc:3060] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:20.160022 21881 ts_tablet_manager.cc:1916] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:20.164405 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:20.164916 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156dae74ee748cd845b6dea1d3b8ea8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.166594 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
I20260928 01:56:20.166584 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:20.167248 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:20.167457 19762 raft_consensus.cc:2393] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:20.168408 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:20.168632 22109 consensus_queue.cc:1059] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:20.168995 19763 raft_consensus.cc:3060] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:20.169713 22109 raft_consensus.cc:3055] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:20.170034 22109 raft_consensus.cc:740] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:20.171017 22109 consensus_queue.cc:260] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.172135 22109 raft_consensus.cc:3060] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:20.175590 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 7ab79c6ad03e481a903a0f95ae0512e6 (table default.Table_501342eaebce40d1a76ace4b05f022fd [id=f5f0643fe0534f2e82e105f01832931f]) successfully deleted
I20260928 01:56:20.131774 19412 leader_election.cc:304] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.180009 21962 raft_consensus.cc:2749] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:20.180055 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 48363.1us
I20260928 01:56:20.182793 19412 leader_election.cc:304] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.184397 22106 raft_consensus.cc:515] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.185073 21962 raft_consensus.cc:2804] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:20.185431 21962 raft_consensus.cc:493] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:20.185801 21962 raft_consensus.cc:3060] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:20.186509 22106 leader_election.cc:290] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:20.202127 21961 consensus_queue.cc:1059] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:20.207216 22165 raft_consensus.cc:3055] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:20.207597 22165 raft_consensus.cc:740] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:20.208377 22165 consensus_queue.cc:260] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:20.209519 22165 raft_consensus.cc:3060] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:56:20.210374 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 53606.8us
I20260928 01:56:20.211330 22153 consensus_queue.cc:1059] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:20.212610 22145 raft_consensus.cc:3055] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260928 01:56:20.212991 22145 raft_consensus.cc:740] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:20.213881 22145 consensus_queue.cc:260] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:20.221534 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:20.168001 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:20.224130 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
I20260928 01:56:20.225324 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
W20260928 01:56:20.226841 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 44137.9us
I20260928 01:56:20.227074 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:20.227845 19412 leader_election.cc:304] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.229276 21909 raft_consensus.cc:2243] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:56:20.229360 19412 leader_election.cc:304] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.230113 21909 raft_consensus.cc:2272] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:20.230365 22167 raft_consensus.cc:2804] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:20.230700 22167 raft_consensus.cc:493] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:20.231010 22167 raft_consensus.cc:3060] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:20.233671 21909 ts_tablet_manager.cc:1916] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:20.235575 22161 consensus_queue.cc:1059] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:20.236443 22165 raft_consensus.cc:2749] T 7801c623930d4e4eaf24c5c424b06d26 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.236718 21948 raft_consensus.cc:3055] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:20.237072 21948 raft_consensus.cc:740] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:20.237820 21948 consensus_queue.cc:260] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.241454 22145 raft_consensus.cc:3060] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:20.243165 22167 raft_consensus.cc:515] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:20.245020 21948 raft_consensus.cc:3060] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:20.245317 22167 leader_election.cc:290] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:20.200150 19763 raft_consensus.cc:2468] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
W20260928 01:56:20.114939 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 63190us
I20260928 01:56:20.248952 19556 leader_election.cc:304] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.250144 19556 leader_election.cc:304] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.250860 22153 raft_consensus.cc:2749] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.251474 22153 raft_consensus.cc:2749] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.252683 19556 leader_election.cc:304] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:20.268155 19814 heartbeater.cc:646] Failed to heartbeat to 127.18.161.61:43775 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.18.161.61:43775 timed out after 1.000s (SENT)
I20260928 01:56:20.085984 22135 tablet.cc:1751] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:20.087278 22152 raft_consensus.cc:515] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:20.280769 19704 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.095069 19606 raft_consensus.cc:2468] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:20.115597 22143 raft_consensus.cc:2749] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:20.286959 22141 tablet.cc:1751] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 3
I20260928 01:56:20.291972 20029 tablet_bootstrap.cc:492] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:20.292477 20029 ts_tablet_manager.cc:1403] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.355s	user 0.010s	sys 0.004s
I20260928 01:56:20.300470 21858 raft_consensus.cc:2749] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.198761 21962 raft_consensus.cc:515] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:20.302140 19704 leader_election.cc:304] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.302858 21962 leader_election.cc:290] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:20.302970 21858 raft_consensus.cc:2749] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.305697 20029 raft_consensus.cc:359] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.306528 20029 raft_consensus.cc:385] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:20.306886 20029 raft_consensus.cc:740] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:20.307578 20029 consensus_queue.cc:260] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.309193 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:20.309523 22152 leader_election.cc:290] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:20.311168 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
W20260928 01:56:20.330950 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 91319.1us
W20260928 01:56:20.335988 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 104817us
I20260928 01:56:20.346119 20029 ts_tablet_manager.cc:1434] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.053s	user 0.002s	sys 0.004s
I20260928 01:56:20.346350 19890 tablet_bootstrap.cc:492] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:20.325204 19704 leader_election.cc:304] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.346835 19890 ts_tablet_manager.cc:1403] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.419s	user 0.012s	sys 0.000s
W20260928 01:56:20.326275 19703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.004s	sys 0.009s
W20260928 01:56:20.347630 19703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.004s	sys 0.009s
I20260928 01:56:20.347543 21858 raft_consensus.cc:2749] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260928 01:56:20.347980 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 603610us
I20260928 01:56:20.351929 19703 leader_election.cc:304] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.357306 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:20.362298 22158 raft_consensus.cc:2804] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:20.362857 22158 raft_consensus.cc:697] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:20.363863 22158 consensus_queue.cc:237] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.373657 20029 tablet_bootstrap.cc:492] T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:56:20.376616 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 147371us
I20260928 01:56:20.377566 19412 leader_election.cc:304] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.378918 19412 leader_election.cc:304] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.379240 22106 raft_consensus.cc:2749] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.379842 21962 raft_consensus.cc:2804] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:20.380591 21962 raft_consensus.cc:493] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:20.380949 21962 raft_consensus.cc:3060] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:20.382690 19701 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 123098us
I20260928 01:56:20.311981 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:20.394433 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
I20260928 01:56:20.397392 21881 ts_tablet_manager.cc:1929] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:20.408463 22153 raft_consensus.cc:2749] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:20.409610 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 157003us
I20260928 01:56:20.410447 19556 leader_election.cc:304] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.411186 22161 raft_consensus.cc:2749] T 10fa56df34ad44d88f1dd700c823d57c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:20.412848 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 81053.4us
I20260928 01:56:20.414186 22143 consensus_queue.cc:1048] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:20.422451 20029 tablet_bootstrap.cc:654] T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:20.428673 21909 ts_tablet_manager.cc:1929] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:20.429225 21909 log.cc:1199] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/158edf7a5d724c88992fecbadd2cedfa
I20260928 01:56:20.430343 21909 ts_tablet_manager.cc:1950] T 158edf7a5d724c88992fecbadd2cedfa P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:20.431699 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 21) took 6736 ms. Trace:
I20260928 01:56:20.397818 21881 log.cc:1199] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/49a73835e2854976b40b31fe752d1b1b
I20260928 01:56:20.441216 21881 ts_tablet_manager.cc:1950] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
W20260928 01:56:20.441087 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 62249.4us
I20260928 01:56:20.441901 19412 leader_election.cc:304] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.442505 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 25) took 6872 ms. Trace:
I20260928 01:56:20.442679 22165 raft_consensus.cc:2749] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.443078 19412 leader_election.cc:304] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.443768 22165 raft_consensus.cc:2749] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.467061 19890 raft_consensus.cc:359] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:20.444176 19412 leader_election.cc:304] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.473685 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.476087 19760 raft_consensus.cc:3060] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:20.476140 22109 raft_consensus.cc:2749] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:20.477360 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 109473us
I20260928 01:56:20.481947 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1710b95678440b1bff8a92080d43272" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:20.500648 19412 leader_election.cc:343] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:20.501245 19412 leader_election.cc:304] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.502713 19412 leader_election.cc:304] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.442840 21881 rpcz_store.cc:276] 0928 01:56:13.570266 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.573314 (+  3048us) service_pool.cc:224] Handling call
0928 01:56:20.111637 (+6538323us) ts_tablet_manager.cc:1151] Deleting tablet 49a73835e2854976b40b31fe752d1b1b
0928 01:56:20.148093 (+ 36456us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:20.322187 (+174094us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:20.397250 (+ 75063us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:20.442441 (+ 45191us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6537713}
I20260928 01:56:20.513290 21881 tablet_replica.cc:333] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:20.514266 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 49a73835e2854976b40b31fe752d1b1b (table default.Table_63f36a8d22184eac8a38565457441d09 [id=102958783e204ded94a67a96b0dec09b]) successfully deleted
W20260928 01:56:20.456898 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 115445us
I20260928 01:56:20.510900 19704 leader_election.cc:304] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.518447 21972 raft_consensus.cc:2749] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.519496 19704 leader_election.cc:304] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.520253 22158 raft_consensus.cc:2749] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.521430 20029 tablet_bootstrap.cc:492] T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:20.521898 20029 ts_tablet_manager.cc:1403] T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.148s	user 0.006s	sys 0.004s
I20260928 01:56:20.522600 22165 raft_consensus.cc:2749] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:20.523240 22165 raft_consensus.cc:2749] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.535148 22165 consensus_queue.cc:1059] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:20.536119 22106 raft_consensus.cc:3055] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:20.536525 22106 raft_consensus.cc:740] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:20.537344 22106 consensus_queue.cc:260] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:20.432090 21909 rpcz_store.cc:276] 0928 01:56:13.695541 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.696534 (+   993us) service_pool.cc:224] Handling call
0928 01:56:19.454135 (+5757601us) ts_tablet_manager.cc:1151] Deleting tablet 158edf7a5d724c88992fecbadd2cedfa
0928 01:56:19.468369 (+ 14234us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:20.318760 (+850391us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:20.428491 (+109731us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:20.431612 (+  3121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":759073,"tablet-delete.queue_time_us":5756481}
I20260928 01:56:20.544338 21909 tablet_replica.cc:333] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:20.547293 22106 raft_consensus.cc:3060] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:56:20.551508 19411 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260928 01:56:20.559078 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 56439.1us
I20260928 01:56:20.559846 19412 leader_election.cc:304] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.560423 19890 raft_consensus.cc:385] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:20.560773 19890 raft_consensus.cc:740] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:20.561020 22109 raft_consensus.cc:2749] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.561528 19890 consensus_queue.cc:260] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:20.563057 19890 ts_tablet_manager.cc:1434] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.216s	user 0.004s	sys 0.001s
I20260928 01:56:20.563935 19890 tablet_bootstrap.cc:492] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:20.484702 19556 leader_election.cc:304] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:20.564915 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 80314.5us
W20260928 01:56:20.565564 19556 leader_election.cc:343] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: e05925303152462e8ca25cd15f3bedff
I20260928 01:56:20.565914 19556 leader_election.cc:304] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.566855 22153 raft_consensus.cc:2749] T 1555e557370a4e92915a9c55107b573b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.567446 22153 raft_consensus.cc:2749] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.567943 20029 raft_consensus.cc:359] T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.568477 19556 leader_election.cc:304] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.569785 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:20.571149 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:20.536913 22152 raft_consensus.cc:493] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:20.576853 22152 raft_consensus.cc:515] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:20.586404 19409 leader_election.cc:343] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:20.588981 19409 leader_election.cc:304] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:20.592331 21881 raft_consensus.cc:2243] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:20.592032 21962 raft_consensus.cc:515] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:20.594287 21962 leader_election.cc:290] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:20.578876 22152 leader_election.cc:290] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:20.597798 19555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260928 01:56:20.604647 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 43814.8us
I20260928 01:56:20.605391 19412 leader_election.cc:304] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.606281 22153 raft_consensus.cc:2749] T 0287060a8d054b15b2252dcf280ca8c2 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.607141 22129 raft_consensus.cc:493] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:20.607613 22129 raft_consensus.cc:515] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:20.609992 22129 leader_election.cc:290] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:20.610702 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260928 01:56:20.611068 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260928 01:56:20.614669 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 46266us
I20260928 01:56:20.615844 19556 leader_election.cc:304] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:20.617261 19556 consensus_peers.cc:597] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:20.618295 19556 leader_election.cc:304] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.617683 22152 raft_consensus.cc:2804] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:20.619506 22152 raft_consensus.cc:493] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:20.619920 22152 raft_consensus.cc:3060] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:20.620383 20029 raft_consensus.cc:385] T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:20.620692 20029 raft_consensus.cc:740] T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:20.621315 20029 consensus_queue.cc:260] T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:20.583421 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 64008us
I20260928 01:56:20.601593 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:20.603545 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb014699060e4a6caf4caaf33c31710a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:20.624810 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bec2c4274497ea73872d0db233eac" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:20.628897 22143 raft_consensus.cc:493] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:20.629585 22143 raft_consensus.cc:515] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.631939 22143 leader_election.cc:290] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:20.637457 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ae3663fbe024a4e946e47339a4b9090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:57616
W20260928 01:56:20.640625 19185 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 278) took 3979 ms (client timeout 1000 ms). Trace:
I20260928 01:56:20.643564 21881 raft_consensus.cc:2272] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 01:56:20.641026 19185 rpcz_store.cc:269] 0928 01:56:16.661137 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:16.661270 (+   133us) service_pool.cc:224] Handling call
0928 01:56:20.640521 (+3979251us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:19.153861 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:19.154804 (+   943us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:19.154869 (+    65us) write_op.cc:435] Acquired schema lock
0928 01:56:19.154902 (+    33us) tablet.cc:662] Decoding operations
0928 01:56:19.155486 (+   584us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:19.155614 (+   128us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:19.155671 (+    57us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:19.156084 (+   413us) tablet.cc:701] Row locks acquired
0928 01:56:19.156116 (+    32us) write_op.cc:260] PREPARE: finished
0928 01:56:19.221390 (+ 65274us) write_op.cc:270] Start()
0928 01:56:19.221586 (+   196us) write_op.cc:276] Timestamp: P: 1790560579221242 usec, L: 0
0928 01:56:19.221609 (+    23us) op_driver.cc:348] REPLICATION: starting
0928 01:56:19.222834 (+  1225us) log.cc:844] Serialized 530 byte log entry
0928 01:56:19.439834 (+217000us) op_driver.cc:464] REPLICATION: finished
0928 01:56:19.470374 (+ 30540us) write_op.cc:301] APPLY: starting
0928 01:56:19.470451 (+    77us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:19.470562 (+   111us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:19.470692 (+   130us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:19.470953 (+   261us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:19.471149 (+   196us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:19.471199 (+    50us) write_op.cc:312] APPLY: finished
0928 01:56:19.471496 (+   297us) log.cc:844] Serialized 23 byte log entry
0928 01:56:19.471704 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:19.471772 (+    68us) write_op.cc:454] Released schema lock
0928 01:56:19.471813 (+    41us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:19.492984 (+ 21171us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:19.493122 (+   138us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":244820,"reported_tablets":117,"child_traces":[["op",{"apply.queue_time_us":30257,"apply.run_cpu_time_us":1855,"apply.run_wall_time_us":22365,"num_ops":1,"prepare.queue_time_us":78155,"prepare.run_cpu_time_us":5654,"prepare.run_wall_time_us":104341,"raft.queue_time_us":117,"raft.run_cpu_time_us":1348,"raft.run_wall_time_us":1347,"replication_time_us":199494,"spinlock_wait_cycles":1399040,"thread_start_us":143451,"threads_started":3,"wal-append.queue_time_us":11029,"wal-append.run_cpu_time_us":3499,"wal-append.run_wall_time_us":1238968}]]}
I20260928 01:56:20.646997 21881 ts_tablet_manager.cc:1916] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:20.648864 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:20.649562 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:20.650983 19462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
W20260928 01:56:20.651782 19410 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:20.652675 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:20.655304 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
W20260928 01:56:20.663125 19557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:20.668428 22165 raft_consensus.cc:2804] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:20.669174 22165 raft_consensus.cc:697] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:20.670521 22165 consensus_queue.cc:237] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:20.673641 19598 tablet_service.cc:1558] Processing DeleteTablet for tablet eac01fc222dd480cbed7cac37a0e6693 with delete_type TABLET_DATA_DELETED (replaced by tablet 522245da435b40ae84ae6dc5d19a2e95) from {username='slave'} at 127.0.0.1:57616
W20260928 01:56:20.675942 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 57712.6us
W20260928 01:56:20.700485 19556 leader_election.cc:343] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 0ae3663fbe024a4e946e47339a4b9090
I20260928 01:56:20.684633 19598 tablet_service.cc:1558] Processing DeleteTablet for tablet 22fc9eff28c4436fb383c3d7169171bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.686386 19594 tablet_service.cc:1558] Processing DeleteTablet for tablet 57a81b9455a340728fea713318e1e77a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.700886 22169 raft_consensus.cc:2749] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:20.691875 19557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260928 01:56:20.701998 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 96693.4us
I20260928 01:56:20.702817 19412 leader_election.cc:304] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.703588 22169 raft_consensus.cc:2749] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:20.706483 19555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:20.707762 19594 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ab79c6ad03e481a903a0f95ae0512e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:41 UTC) from {username='slave'} at 127.0.0.1:57616
W20260928 01:56:20.712919 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 123998us
I20260928 01:56:20.714088 19594 tablet_service.cc:1558] Processing DeleteTablet for tablet 158edf7a5d724c88992fecbadd2cedfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:57616
W20260928 01:56:20.717975 19409 leader_election.cc:343] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:20.718894 19409 leader_election.cc:343] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:20.693614 22179 tablet_replica.cc:333] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:20.676604 22129 raft_consensus.cc:2749] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:20.726204 19594 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ca0b52215454a99b6c5d1956088829a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.727141 19556 leader_election.cc:304] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.727236 19412 leader_election.cc:304] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.728044 22129 raft_consensus.cc:2749] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.728122 22169 raft_consensus.cc:2804] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:20.728662 22169 raft_consensus.cc:493] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:20.729247 22169 raft_consensus.cc:3060] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:20.737048 19594 tablet_service.cc:1558] Processing DeleteTablet for tablet e05925303152462e8ca25cd15f3bedff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.738638 19556 leader_election.cc:304] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.739595 22129 raft_consensus.cc:2749] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.739843 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:20.740959 19762 raft_consensus.cc:2393] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:20.741017 19556 leader_election.cc:304] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.741734 22129 raft_consensus.cc:2749] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.742111 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:20.742990 19556 leader_election.cc:304] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.743568 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.743733 22129 raft_consensus.cc:2804] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:20.744174 22129 raft_consensus.cc:493] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:20.745047 22129 raft_consensus.cc:3060] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:20.745371 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:20.748221 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 125805us
I20260928 01:56:20.752327 19412 leader_election.cc:304] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.753832 19594 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5e07078b2a4fe59d9293d9511cbb6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.754174 22106 raft_consensus.cc:2749] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.764942 19594 tablet_service.cc:1558] Processing DeleteTablet for tablet 7602706a3fbc438d8d448c9ac057087c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c6f4708c641414aa59f01703c86aaf1) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.766362 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:20.767720 19890 tablet_bootstrap.cc:654] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:20.769129 19594 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c6cfc9ff3344a48b09730dfde79d6cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.773137 19704 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:20.773924 21972 raft_consensus.cc:2804] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:20.774415 21972 raft_consensus.cc:697] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:20.775208 21972 consensus_queue.cc:237] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:20.776593 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:20.776160 22152 raft_consensus.cc:515] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.777213 19704 leader_election.cc:304] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:20.778795 22152 leader_election.cc:290] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:20.779326 20029 ts_tablet_manager.cc:1434] T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.257s	user 0.005s	sys 0.004s
I20260928 01:56:20.779280 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
I20260928 01:56:20.783821 22162 raft_consensus.cc:2804] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:20.784626 22162 raft_consensus.cc:697] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:20.785490 22162 consensus_queue.cc:237] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.788630 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]). Expected version 1 got 0
I20260928 01:56:20.792145 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
W20260928 01:56:20.798560 19703 connection.cc:256] RPC call timeout handler was delayed by -1.3218119290000914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1s for a response
I20260928 01:56:20.803340 20029 tablet_bootstrap.cc:492] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:20.804333 22158 raft_consensus.cc:493] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:20.804488 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:20.804786 22158 raft_consensus.cc:515] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.806726 22158 leader_election.cc:290] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:20.807250 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
W20260928 01:56:20.787492 19555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:20.788861 19594 tablet_service.cc:1558] Processing DeleteTablet for tablet 7daa1b799e0d408287edc03988f5b683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.789397 19598 tablet_service.cc:1558] Processing DeleteTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:35 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.790203 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 with delete_type TABLET_DATA_DELETED (replaced by tablet e43bec2c4274497ea73872d0db233eac) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.792550 19591 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73835e2854976b40b31fe752d1b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.793516 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f with delete_type TABLET_DATA_DELETED (replaced by tablet 6546cfe6f3a6405fab41a4ebdcffb288) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.794660 19596 tablet_service.cc:1558] Processing DeleteTablet for tablet 12c7284250084d6299cafe8310cfd257 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c395a6a87f4927b10973720aa4d868) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.795574 19599 tablet_service.cc:1558] Processing DeleteTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.796088 19595 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c61408724e4a70b39e5dbdab9a3e8a with delete_type TABLET_DATA_DELETED (replaced by tablet 8df69eb3a37445ed8a2be0ef3bf32cdb) from {username='slave'} at 127.0.0.1:57616
W20260928 01:56:20.796980 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 54068.5us
I20260928 01:56:20.797619 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet c1f73a301c84482f897990ac5e5dd162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:37 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:20.809624 19704 leader_election.cc:304] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:20.814904 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:20.816622 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:20.818126 19556 leader_election.cc:304] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.819265 22143 raft_consensus.cc:2804] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:20.819734 22143 raft_consensus.cc:697] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:20.820554 22143 consensus_queue.cc:237] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:20.823277 19556 leader_election.cc:304] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.824404 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:20.824764 22161 raft_consensus.cc:2749] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:20.825573 22158 raft_consensus.cc:2804] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:20.826157 22158 raft_consensus.cc:697] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:20.827275 19556 leader_election.cc:304] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.828009 22161 raft_consensus.cc:2804] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:20.828361 22161 raft_consensus.cc:493] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:20.828466 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:20.828675 22161 raft_consensus.cc:3060] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:20.830452 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
I20260928 01:56:20.831462 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
I20260928 01:56:20.827121 22158 consensus_queue.cc:237] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.836839 22161 raft_consensus.cc:515] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.839010 20029 tablet_bootstrap.cc:654] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:20.839659 22161 leader_election.cc:290] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:20.784106 22129 raft_consensus.cc:515] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.843654 22129 leader_election.cc:290] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:20.845583 22106 raft_consensus.cc:493] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:20.846132 22106 raft_consensus.cc:515] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.848527 22106 leader_election.cc:290] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:20.851016 22187 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:20.853058 19556 leader_election.cc:304] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.876499 19556 leader_election.cc:304] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.877251 22143 raft_consensus.cc:2749] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.878306 22143 raft_consensus.cc:2749] T 7979940c4a2e470bbecc40384edf38c9 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.865046 19890 tablet_bootstrap.cc:492] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:20.872139 22179 raft_consensus.cc:2243] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:20.879416 22179 raft_consensus.cc:2272] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:20.881939 22179 ts_tablet_manager.cc:1916] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:20.882266 21881 ts_tablet_manager.cc:1929] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:20.882655 21881 log.cc:1199] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/22606f012f1c44bd92c8e0341e9ca2b7
I20260928 01:56:20.883366 21881 ts_tablet_manager.cc:1950] T 22606f012f1c44bd92c8e0341e9ca2b7 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:20.884948 19890 ts_tablet_manager.cc:1403] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.321s	user 0.011s	sys 0.003s
W20260928 01:56:20.885311 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 131371us
W20260928 01:56:20.886044 19412 leader_election.cc:343] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:20.886417 19412 leader_election.cc:304] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:20.888056 21962 raft_consensus.cc:2749] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:20.851516 22187 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
W20260928 01:56:20.905251 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 75994.5us
I20260928 01:56:20.906116 22187 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:20.906224 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 358 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:20.908278 19890 raft_consensus.cc:359] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:20.908936 19890 raft_consensus.cc:385] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:20.909365 19890 raft_consensus.cc:740] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:20.909678 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:20.909982 19890 consensus_queue.cc:260] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:20.921357 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:20.923079 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
I20260928 01:56:20.925530 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
W20260928 01:56:20.925971 19409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:20.933987 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
I20260928 01:56:20.932406 19704 leader_election.cc:304] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:20.944950 22149 raft_consensus.cc:2804] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
W20260928 01:56:20.945089 19553 leader_election.cc:343] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:20.945788 22149 raft_consensus.cc:697] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:20.946827 22149 consensus_queue.cc:237] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:20.947489 19556 consensus_peers.cc:597] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eac01fc222dd480cbed7cac37a0e6693. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:20.949657 22054 consensus_queue.cc:1048] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:20.951035 19814 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:20.953377 19890 ts_tablet_manager.cc:1434] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.000s
W20260928 01:56:20.953167 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 43743.4us
I20260928 01:56:20.954475 19890 tablet_bootstrap.cc:492] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:20.963912 19556 leader_election.cc:304] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.967471 22143 raft_consensus.cc:2749] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.968698 19765 raft_consensus.cc:1275] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:56:20.968833 19556 leader_election.cc:304] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:20.971100 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d114d5ba862044b4b88eee27395db7e3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.973032 19762 raft_consensus.cc:1240] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:20.974741 22143 raft_consensus.cc:2804] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:20.975225 22143 raft_consensus.cc:697] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:20.976089 22143 consensus_queue.cc:237] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.980743 22054 consensus_queue.cc:1059] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:20.981464 21972 raft_consensus.cc:493] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:20.981859 22129 raft_consensus.cc:3055] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:20.982197 22129 raft_consensus.cc:740] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:20.981971 21972 raft_consensus.cc:515] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.983038 22129 consensus_queue.cc:260] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:20.985564 22129 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:20.989806 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6b59144fe14daab98b0965c7f8af02" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:20.993801 19760 raft_consensus.cc:1240] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:20.889228 19412 leader_election.cc:304] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:21.001328 19556 leader_election.cc:304] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:21.001425 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22606f012f1c44bd92c8e0341e9ca2b7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:21.008723 22054 raft_consensus.cc:2749] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:20.931002 22169 raft_consensus.cc:515] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.023231 19556 leader_election.cc:304] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:21.023840 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 158edf7a5d724c88992fecbadd2cedfa (table default.Table_0991384f9b0745a389ad95d24675e413 [id=1ee3d2a1f321486d90ab82e5cef8f3aa]) successfully deleted
I20260928 01:56:21.024327 22054 raft_consensus.cc:2749] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:21.024667 19522 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
W20260928 01:56:21.034641 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 145481us
I20260928 01:56:21.035356 22165 raft_consensus.cc:2804] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:21.036566 22165 raft_consensus.cc:493] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:21.037097 22165 raft_consensus.cc:3060] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:21.038825 19556 leader_election.cc:304] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:21.039588 22143 raft_consensus.cc:2749] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:21.040850 22179 ts_tablet_manager.cc:1929] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:21.041530 22179 log.cc:1199] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/0ae3663fbe024a4e946e47339a4b9090
I20260928 01:56:21.043329 22179 ts_tablet_manager.cc:1950] T 0ae3663fbe024a4e946e47339a4b9090 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:21.044102 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36076aa674b9401b9b76fbf066348d06" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:21.046751 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb014699060e4a6caf4caaf33c31710a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:21.048327 19461 raft_consensus.cc:2393] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:21.048360 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 0ae3663fbe024a4e946e47339a4b9090 (table default.Table_fa2cc70b96124fedb7f77c2fd58c9d89 [id=90e10f23ac7f4af489416a55f3287681]) successfully deleted
I20260928 01:56:21.050698 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cc307b127446958bd4199a1aa60adb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:21.053683 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7441c2d1a7fa4dc8a89c6717a80d3efb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:21.055121 19460 raft_consensus.cc:1275] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:56:20.983997 21972 leader_election.cc:290] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:21.059325 19890 tablet_bootstrap.cc:654] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:21.065121 19556 leader_election.cc:304] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:21.075752 22143 raft_consensus.cc:2804] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:21.068958 19606 raft_consensus.cc:1240] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:21.076375 22143 raft_consensus.cc:493] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:21.076858 22143 raft_consensus.cc:3060] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:21.075975 19618 raft_consensus.cc:1240] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 1. Current term is 2. Ops: []
W20260928 01:56:21.081061 19704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:21.067250 22129 consensus_queue.cc:1048] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:21.084120 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.087767 19556 leader_election.cc:304] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:21.089195 22054 raft_consensus.cc:2749] T c53d75604ee3405d83fe9ecaa824ea68 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:21.089318 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.089884 22054 consensus_queue.cc:1048] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:21.092103 19556 leader_election.cc:304] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:21.092887 22054 raft_consensus.cc:2749] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:21.092985 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 68108.2us
W20260928 01:56:21.094763 19703 leader_election.cc:343] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 89e1d60db21f4a8294792df3fadf5d90
I20260928 01:56:21.101100 19703 leader_election.cc:304] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:21.102276 19703 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:21.103125 21972 raft_consensus.cc:2749] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:21.103713 19703 leader_election.cc:304] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:21.103914 22016 raft_consensus.cc:2749] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260928 01:56:21.104702 21972 raft_consensus.cc:2749] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:21.105878 19703 leader_election.cc:304] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:21.106797 21972 raft_consensus.cc:2749] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:21.107389 19703 leader_election.cc:304] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:21.113207 19556 leader_election.cc:304] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:21.116288 19703 consensus_peers.cc:597] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7602706a3fbc438d8d448c9ac057087c. This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:21.114722 19556 leader_election.cc:343] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 3c6cfc9ff3344a48b09730dfde79d6cf
I20260928 01:56:21.117059 19556 leader_election.cc:304] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:21.112820 22149 raft_consensus.cc:2749] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:21.120280 22129 raft_consensus.cc:2749] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:21.121670 22179 tablet_replica.cc:333] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:21.123193 22179 raft_consensus.cc:2243] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:56:21.129704 22179 raft_consensus.cc:2272] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 01:56:21.144450 19553 leader_election.cc:343] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: 158edf7a5d724c88992fecbadd2cedfa
I20260928 01:56:21.142318 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:21.148144 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b836e20d6b43cba8eaa08887afb076" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:21.149147 19763 raft_consensus.cc:3060] T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:21.150381 19703 consensus_peers.cc:597] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49a73835e2854976b40b31fe752d1b1b. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:21.152611 22129 raft_consensus.cc:2749] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:21.159354 20029 tablet_bootstrap.cc:492] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
W20260928 01:56:21.148430 19556 consensus_peers.cc:597] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a5e07078b2a4fe59d9293d9511cbb6b. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:21.167160 20029 ts_tablet_manager.cc:1403] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.364s	user 0.011s	sys 0.004s
I20260928 01:56:21.173599 22129 consensus_queue.cc:1048] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:21.175189 22106 raft_consensus.cc:493] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:21.175704 22106 raft_consensus.cc:515] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.177667 22106 leader_election.cc:290] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:21.144515 22179 ts_tablet_manager.cc:1916] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:21.181200 22169 leader_election.cc:290] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:21.182518 19460 raft_consensus.cc:1240] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:21.184051 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:21.184630 19472 raft_consensus.cc:2468] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:21.186064 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:21.186610 19472 raft_consensus.cc:2468] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:21.188108 19472 raft_consensus.cc:1275] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:21.193691 22157 consensus_queue.cc:1059] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:21.195386 22149 raft_consensus.cc:3055] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:21.195755 22149 raft_consensus.cc:740] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:21.196604 22149 consensus_queue.cc:260] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.157610 22143 raft_consensus.cc:515] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:21.197935 22149 raft_consensus.cc:3060] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:21.201300 22143 leader_election.cc:290] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:21.217240 22165 raft_consensus.cc:515] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:21.218484 19461 raft_consensus.cc:2393] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:21.227118 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 26) took 7652 ms. Trace:
I20260928 01:56:21.227676 21881 rpcz_store.cc:276] 0928 01:56:13.574323 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.574417 (+    94us) service_pool.cc:224] Handling call
0928 01:56:20.513104 (+6938687us) ts_tablet_manager.cc:1151] Deleting tablet 22606f012f1c44bd92c8e0341e9ca2b7
0928 01:56:20.513176 (+    72us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:20.695857 (+182681us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:20.882129 (+186272us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:21.227036 (+344907us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127131,"tablet-delete.queue_time_us":6938185}
I20260928 01:56:21.229287 21881 tablet_replica.cc:333] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:21.236487 20029 raft_consensus.cc:359] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:21.237396 20029 raft_consensus.cc:385] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:21.237739 20029 raft_consensus.cc:740] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:21.238476 20029 consensus_queue.cc:260] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:21.210104 19553 leader_election.cc:343] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:21.218770 22129 raft_consensus.cc:493] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:21.253331 22129 raft_consensus.cc:515] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.256500 22145 consensus_queue.cc:1048] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:21.263060 22129 leader_election.cc:290] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:21.260700 19553 leader_election.cc:343] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:21.265595 22145 consensus_queue.cc:1059] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 01:56:21.267930 21948 raft_consensus.cc:3055] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:21.268424 21948 raft_consensus.cc:740] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:21.268580 22153 raft_consensus.cc:493] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:21.269296 22153 raft_consensus.cc:515] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:21.269599 21948 consensus_queue.cc:260] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:21.272675 22153 leader_election.cc:290] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:21.273356 21948 raft_consensus.cc:3060] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:21.275285 19607 raft_consensus.cc:1275] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260928 01:56:21.280121 19553 leader_election.cc:343] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: 57a81b9455a340728fea713318e1e77a
I20260928 01:56:21.286659 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 22606f012f1c44bd92c8e0341e9ca2b7 (table default.Table_593e8a23ad954f5b8b209830cbd7ccf9 [id=cb3f94a374cd4a21a132791410361924]) successfully deleted
I20260928 01:56:21.290371 22153 consensus_queue.cc:1059] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:21.292119 22145 raft_consensus.cc:3055] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:21.292588 19607 raft_consensus.cc:1275] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:21.292714 22145 raft_consensus.cc:740] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:21.294131 22145 consensus_queue.cc:260] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.295390 21881 raft_consensus.cc:2243] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:21.295955 21881 raft_consensus.cc:2272] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:21.297369 22145 raft_consensus.cc:3060] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:21.298270 21881 ts_tablet_manager.cc:1916] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:21.243047 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:21.288633 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 with delete_type TABLET_DATA_DELETED (replaced by tablet e43bec2c4274497ea73872d0db233eac) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:21.307192 19890 tablet_bootstrap.cc:492] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:21.307821 19890 ts_tablet_manager.cc:1403] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.354s	user 0.015s	sys 0.006s
I20260928 01:56:21.240417 22157 raft_consensus.cc:493] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:21.314838 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:21.314407 22157 raft_consensus.cc:515] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.318771 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f with delete_type TABLET_DATA_DELETED (replaced by tablet 6546cfe6f3a6405fab41a4ebdcffb288) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:21.253459 21972 consensus_queue.cc:1059] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:21.320614 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 7602706a3fbc438d8d448c9ac057087c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c6f4708c641414aa59f01703c86aaf1) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:21.320497 22153 raft_consensus.cc:493] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:21.320855 19461 raft_consensus.cc:1275] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:21.320915 21972 raft_consensus.cc:3055] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:21.321338 21972 raft_consensus.cc:740] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:21.321231 22153 raft_consensus.cc:515] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:21.322775 21972 consensus_queue.cc:260] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.324723 22153 leader_election.cc:290] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:21.324764 22157 leader_election.cc:290] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:21.327198 19703 consensus_peers.cc:597] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22606f012f1c44bd92c8e0341e9ca2b7. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:21.330062 21972 raft_consensus.cc:3060] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:21.338758 20029 ts_tablet_manager.cc:1434] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.166s	user 0.005s	sys 0.000s
I20260928 01:56:21.340062 20029 tablet_bootstrap.cc:492] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:21.345389 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.346033 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.346460 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.346720 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac01fc222dd480cbed7cac37a0e6693" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.315539 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:21.348708 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.348941 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416ccc1323fe41b2a7783dc95bba8d84" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.350677 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.344918 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.352905 19612 raft_consensus.cc:2393] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:21.354470 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.359104 19618 raft_consensus.cc:2468] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:21.370312 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:21.374890 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:21.375800 19762 raft_consensus.cc:2468] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:21.377161 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:21.378971 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2597de2c4304074977db5a3c0426814" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:21.381654 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:21.382225 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 82029.8us
I20260928 01:56:21.383383 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.384846 22162 consensus_queue.cc:1059] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:21.386860 22198 raft_consensus.cc:3055] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:21.387341 22198 raft_consensus.cc:740] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:21.387929 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a73835e2854976b40b31fe752d1b1b" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.388559 22198 consensus_queue.cc:260] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.390421 22145 raft_consensus.cc:493] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:21.390589 19703 leader_election.cc:304] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:56:21.397470 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:21.391394 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.401367 22145 raft_consensus.cc:515] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.421818 22165 leader_election.cc:290] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:21.434557 22198 raft_consensus.cc:3060] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:21.435053 19409 leader_election.cc:304] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:21.436612 21909 raft_consensus.cc:2243] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:56:21.408041 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cfc9ff3344a48b09730dfde79d6cf" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:21.430347 19667 heartbeater.cc:646] Failed to heartbeat to 127.18.161.61:43775 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.18.161.61:43775 timed out after 1.000s (SENT)
I20260928 01:56:21.437664 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b836e20d6b43cba8eaa08887afb076" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:21.440845 19667 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:21.440793 19615 raft_consensus.cc:2468] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:21.441464 19606 raft_consensus.cc:2393] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:21.267302 19763 raft_consensus.cc:2468] T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:21.443851 22145 leader_election.cc:290] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:21.444562 22149 raft_consensus.cc:2804] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:21.445034 22149 raft_consensus.cc:493] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:21.445420 22149 raft_consensus.cc:3060] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:21.448644 21909 raft_consensus.cc:2272] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:21.452507 21909 ts_tablet_manager.cc:1916] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:21.454268 22106 raft_consensus.cc:2804] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:21.454927 22106 raft_consensus.cc:493] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:21.455562 22106 raft_consensus.cc:3060] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
W20260928 01:56:21.459831 20456 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.555s (SENT) [suppressed 2 similar messages]
W20260928 01:56:21.460713 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 70203.2us
I20260928 01:56:21.461395 19703 leader_election.cc:304] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:56:21.462179 22158 raft_consensus.cc:2804] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:21.462646 22158 raft_consensus.cc:493] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:21.463155 22158 raft_consensus.cc:3060] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:21.412992 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
W20260928 01:56:21.480059 19409 leader_election.cc:343] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:21.479198 19190 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 253) took 4758 ms (client timeout 1000 ms). Trace:
W20260928 01:56:21.486879 19190 rpcz_store.cc:269] 0928 01:56:16.721151 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:16.721348 (+   197us) service_pool.cc:224] Handling call
0928 01:56:21.479088 (+4757740us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103148,"reported_tablets":112}
I20260928 01:56:21.491626 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:21.482370 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.479203 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:21.499461 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:21.500464 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:21.501312 19765 raft_consensus.cc:2393] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:21.503412 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:21.504194 19749 raft_consensus.cc:2393] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:21.503841 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:21.506558 19750 raft_consensus.cc:2393] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:21.510314 22203 tablet.cc:1751] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:21.512526 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
W20260928 01:56:21.512595 20456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 52862.1us
I20260928 01:56:21.518676 19890 raft_consensus.cc:359] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:21.519439 19890 raft_consensus.cc:385] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:21.519753 19890 raft_consensus.cc:740] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
W20260928 01:56:21.511893 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 50578.8us
I20260928 01:56:21.525936 19553 leader_election.cc:304] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:56:21.528703 19553 leader_election.cc:343] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:21.529299 22145 raft_consensus.cc:493] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:21.545940 22145 raft_consensus.cc:515] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:21.513460 19179 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e43bec2c4274497ea73872d0db233eac consensus state has no leader
I20260928 01:56:21.549754 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
I20260928 01:56:21.552318 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73835e2854976b40b31fe752d1b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:21.553424 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ae3663fbe024a4e946e47339a4b9090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:21.552126 22153 raft_consensus.cc:2804] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:21.554380 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet eac01fc222dd480cbed7cac37a0e6693 with delete_type TABLET_DATA_DELETED (replaced by tablet 522245da435b40ae84ae6dc5d19a2e95) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:21.555198 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cc307b127446958bd4199a1aa60adb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:21.552726 22157 raft_consensus.cc:493] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:21.556685 22157 raft_consensus.cc:515] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.558691 22157 leader_election.cc:290] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:21.561708 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:21.553068 22162 consensus_queue.cc:1048] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260928 01:56:21.562597 22016 consensus_queue.cc:1048] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:21.563071 22157 consensus_queue.cc:1048] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:21.568274 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:21.574512 19556 leader_election.cc:304] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:21.576299 19472 raft_consensus.cc:1275] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:21.567890 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
I20260928 01:56:21.573048 22153 raft_consensus.cc:697] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:21.611006 22106 raft_consensus.cc:515] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.611207 22153 consensus_queue.cc:237] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.602087 19890 consensus_queue.cc:260] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:21.623006 22207 tablet.cc:1751] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:56:21.629338 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
I20260928 01:56:21.630599 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:21.638751 19890 ts_tablet_manager.cc:1434] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.222s	user 0.007s	sys 0.000s
I20260928 01:56:21.639933 19890 tablet_bootstrap.cc:492] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:56:21.644400 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 69990us
I20260928 01:56:21.645481 19556 leader_election.cc:304] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:21.646723 19556 leader_election.cc:304] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:21.653800 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 96054.1us
I20260928 01:56:21.656466 19704 leader_election.cc:304] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:21.653043 22054 raft_consensus.cc:3060] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:21.653229 22143 raft_consensus.cc:2749] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:21.677511 22209 raft_consensus.cc:2804] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:21.678117 22209 raft_consensus.cc:493] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:21.678689 22209 raft_consensus.cc:3060] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:21.661106 20029 tablet_bootstrap.cc:654] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:21.655762 22197 consensus_queue.cc:1048] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260928 01:56:21.686862 19820 tablet.cc:2433] T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 01:56:21.706622 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:21.621364 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:56:21.623198 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 95057.6us
I20260928 01:56:21.716080 19461 raft_consensus.cc:2393] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
W20260928 01:56:21.717474 19409 leader_election.cc:343] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:21.660050 19412 leader_election.cc:304] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:21.719677 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 59720.5us
I20260928 01:56:21.720460 19412 leader_election.cc:304] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:21.721313 22169 raft_consensus.cc:2749] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:21.722169 22169 raft_consensus.cc:2804] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:21.722592 22169 raft_consensus.cc:493] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:21.723024 22169 raft_consensus.cc:3060] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:21.726420 22106 leader_election.cc:290] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:21.736605 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:21.737280 19763 raft_consensus.cc:3060] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
W20260928 01:56:21.713985 19411 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:21.744246 19412 leader_election.cc:304] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:21.749056 22197 consensus_queue.cc:1048] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:21.665597 22158 raft_consensus.cc:515] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:21.745473 19412 leader_election.cc:343] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Illegal state: Tablet not RUNNING: STOPPED
I20260928 01:56:21.754456 19412 leader_election.cc:304] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:21.759763 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 113112us
I20260928 01:56:21.669492 22149 raft_consensus.cc:515] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.770020 22149 leader_election.cc:290] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:21.770722 19765 raft_consensus.cc:1240] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 2. Current term is 3. Ops: [2.1-2.1]
I20260928 01:56:21.764412 22214 consensus_queue.cc:1048] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260928 01:56:21.776777 19760 raft_consensus.cc:1240] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:21.778260 22158 leader_election.cc:290] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:21.780968 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:21.739943 21881 ts_tablet_manager.cc:1929] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:21.781945 21881 log.cc:1199] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/12c7284250084d6299cafe8310cfd257
I20260928 01:56:21.782912 21881 ts_tablet_manager.cc:1950] T 12c7284250084d6299cafe8310cfd257 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
W20260928 01:56:21.784379 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 73450.8us
I20260928 01:56:21.791103 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:21.792327 19669 tablet.cc:2433] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 01:56:21.795267 19193 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
I20260928 01:56:21.764595 22143 raft_consensus.cc:2749] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:21.799185 22145 leader_election.cc:290] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:21.799378 21909 ts_tablet_manager.cc:1929] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:21.799822 21909 log.cc:1199] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/e05925303152462e8ca25cd15f3bedff
I20260928 01:56:21.784111 19890 tablet_bootstrap.cc:654] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:21.811419 21909 ts_tablet_manager.cc:1950] T e05925303152462e8ca25cd15f3bedff P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:21.814157 22179 ts_tablet_manager.cc:1929] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:21.814859 22179 log.cc:1199] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/eac01fc222dd480cbed7cac37a0e6693
I20260928 01:56:21.815923 22179 ts_tablet_manager.cc:1950] T eac01fc222dd480cbed7cac37a0e6693 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:21.817525 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 26) took 1157 ms. Trace:
W20260928 01:56:21.808475 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 101777us
I20260928 01:56:21.818362 22054 raft_consensus.cc:2749] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:56:21.842954 19703 leader_election.cc:343] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 3c6cfc9ff3344a48b09730dfde79d6cf
W20260928 01:56:21.850979 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 197455us
I20260928 01:56:21.824753 22179 rpcz_store.cc:276] 0928 01:56:20.659680 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.672891 (+ 13211us) service_pool.cc:224] Handling call
0928 01:56:21.121418 (+448527us) ts_tablet_manager.cc:1151] Deleting tablet eac01fc222dd480cbed7cac37a0e6693
0928 01:56:21.121496 (+    78us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:21.365319 (+243823us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:21.813994 (+448675us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:21.817410 (+  3416us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":447240}
I20260928 01:56:21.860019 22179 tablet_replica.cc:333] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
W20260928 01:56:21.850632 22203 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.333s	user 0.000s	sys 0.020s
I20260928 01:56:21.874202 20029 tablet_bootstrap.cc:492] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:21.874724 20029 ts_tablet_manager.cc:1403] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.535s	user 0.011s	sys 0.012s
I20260928 01:56:21.877600 19556 leader_election.cc:304] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:21.878521 20029 raft_consensus.cc:359] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:21.879244 20029 raft_consensus.cc:385] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:21.879521 20029 raft_consensus.cc:740] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:21.880123 20029 consensus_queue.cc:260] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:21.881867 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet eac01fc222dd480cbed7cac37a0e6693 (table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]) successfully deleted
I20260928 01:56:21.882819 22054 consensus_queue.cc:1059] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260928 01:56:21.886210 20029 ts_tablet_manager.cc:1434] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260928 01:56:21.883355 22213 consensus_queue.cc:1048] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260928 01:56:21.887271 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9690a224bb004152ba65d525cc10bd9f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:21.887332 22152 consensus_queue.cc:1059] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:21.908375 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ab79c6ad03e481a903a0f95ae0512e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:41 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:21.908384 22212 raft_consensus.cc:3055] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:21.908916 22212 raft_consensus.cc:740] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:21.909824 22212 consensus_queue.cc:260] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.911024 22212 raft_consensus.cc:3060] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:21.913733 22145 raft_consensus.cc:3055] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260928 01:56:21.914148 22145 raft_consensus.cc:740] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:21.914916 22145 consensus_queue.cc:260] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.916029 22145 raft_consensus.cc:3060] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
W20260928 01:56:21.924645 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 47129.6us
I20260928 01:56:21.925803 22153 raft_consensus.cc:3060] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:21.930330 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:21.932437 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:21.932574 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:21.933511 19618 raft_consensus.cc:2393] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:21.936880 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:21.937743 19620 raft_consensus.cc:2393] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:21.955641 19612 raft_consensus.cc:2410] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da for term 3 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260928 01:56:21.958933 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156dae74ee748cd845b6dea1d3b8ea8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:21.971225 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:56:21.980297 19412 raft_consensus.cc:2686] T eac01fc222dd480cbed7cac37a0e6693 P 37089d44fdba4b6488b5b5aea28af614: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:21.980414 22213 raft_consensus.cc:493] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:21.981186 22213 raft_consensus.cc:515] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:21.981974 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 236545us
I20260928 01:56:21.982743 19412 leader_election.cc:304] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:21.984166 22213 leader_election.cc:290] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:21.984272 19412 leader_election.cc:304] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:21.985474 19553 leader_election.cc:343] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:21.989101 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb014699060e4a6caf4caaf33c31710a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:21.998488 19890 tablet_bootstrap.cc:492] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:21.998946 19890 ts_tablet_manager.cc:1403] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.359s	user 0.017s	sys 0.002s
I20260928 01:56:22.001742 19890 raft_consensus.cc:359] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:22.002372 19890 raft_consensus.cc:385] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:22.002610 19890 raft_consensus.cc:740] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:22.003223 19890 consensus_queue.cc:260] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:21.745481 22106 raft_consensus.cc:2749] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:22.008186 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:22.008595 19412 leader_election.cc:304] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:22.009239 19620 raft_consensus.cc:2393] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:22.012156 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 27) took 8409 ms. Trace:
I20260928 01:56:22.012511 21881 rpcz_store.cc:276] 0928 01:56:13.575275 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.575376 (+   101us) service_pool.cc:224] Handling call
0928 01:56:21.229101 (+7653725us) ts_tablet_manager.cc:1151] Deleting tablet 12c7284250084d6299cafe8310cfd257
0928 01:56:21.229173 (+    72us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:21.628745 (+399572us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:21.739808 (+111063us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:21.984182 (+244374us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7653246}
I20260928 01:56:22.009478 22165 raft_consensus.cc:2749] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:22.020872 22165 raft_consensus.cc:2749] T 416ccc1323fe41b2a7783dc95bba8d84 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:22.021489 22165 raft_consensus.cc:2749] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:21.983971 22169 raft_consensus.cc:515] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:22.024005 22169 leader_election.cc:290] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:22.029300 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bec2c4274497ea73872d0db233eac" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:22.030068 19621 raft_consensus.cc:3060] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:22.035518 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:22.036582 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:22.037709 19620 raft_consensus.cc:2468] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:22.044414 22153 raft_consensus.cc:2749] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:22.047019 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2597de2c4304074977db5a3c0426814" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:22.064937 19618 raft_consensus.cc:2468] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:22.053555 19615 raft_consensus.cc:2468] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
W20260928 01:56:22.070976 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 62480.4us
I20260928 01:56:22.072089 19412 leader_election.cc:304] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:22.073055 22106 raft_consensus.cc:2749] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:22.074488 19412 leader_election.cc:304] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:22.075290 22106 raft_consensus.cc:3060] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:56:22.081045 20456 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.555s (SENT)
I20260928 01:56:22.081528 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:22.075969 19621 raft_consensus.cc:2468] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:22.094511 22212 raft_consensus.cc:493] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:22.094965 22106 raft_consensus.cc:2749] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:22.095044 22212 raft_consensus.cc:515] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:22.098589 22212 leader_election.cc:290] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:22.103360 19412 leader_election.cc:304] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:22.104513 19412 leader_election.cc:304] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:22.108976 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 303238us
W20260928 01:56:22.112704 19409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:21.791872 22209 raft_consensus.cc:515] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:21.803401 19763 raft_consensus.cc:2468] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:22.115177 22209 leader_election.cc:290] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:22.117688 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:22.118328 19472 raft_consensus.cc:3060] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:22.126803 19472 raft_consensus.cc:2468] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:22.162846 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]). Expected version 2 got 0
I20260928 01:56:22.164690 19460 raft_consensus.cc:1240] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:22.170380 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:22.171078 19472 raft_consensus.cc:3060] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:22.178958 19472 raft_consensus.cc:2468] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:22.168578 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 12c7284250084d6299cafe8310cfd257 (table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]) successfully deleted
I20260928 01:56:22.182255 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:22.188905 19890 ts_tablet_manager.cc:1434] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.190s	user 0.005s	sys 0.000s
I20260928 01:56:22.189985 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 158edf7a5d724c88992fecbadd2cedfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:22.190593 22179 raft_consensus.cc:2243] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:56:22.191644 22179 raft_consensus.cc:2272] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:22.196024 22179 ts_tablet_manager.cc:1916] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:22.201143 22153 raft_consensus.cc:493] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:22.201710 22153 raft_consensus.cc:515] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:22.203876 22153 leader_election.cc:290] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:22.210299 22158 raft_consensus.cc:493] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:22.210824 22158 raft_consensus.cc:515] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:22.212900 22158 leader_election.cc:290] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:22.214121 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cfc9ff3344a48b09730dfde79d6cf" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:22.214721 19621 raft_consensus.cc:3060] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:22.216322 19704 leader_election.cc:304] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:22.217007 21972 raft_consensus.cc:2804] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:22.217613 21972 raft_consensus.cc:697] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:22.218441 21972 consensus_queue.cc:237] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:22.205070 19615 raft_consensus.cc:1275] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:22.206030 19620 raft_consensus.cc:1275] T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:22.206126 19618 raft_consensus.cc:1275] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:22.207139 19606 raft_consensus.cc:1275] T ef752c3b4b22490ab42292f61278da52 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:22.230001 22153 raft_consensus.cc:493] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:22.230688 22153 raft_consensus.cc:515] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:22.238457 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:22.238766 22153 leader_election.cc:290] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:22.243719 19621 raft_consensus.cc:2468] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:22.269574 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:22.272120 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
W20260928 01:56:22.288074 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 443614us
I20260928 01:56:22.291229 19703 leader_election.cc:304] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:22.291968 22158 raft_consensus.cc:3060] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:22.292665 19703 consensus_peers.cc:597] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89e1d60db21f4a8294792df3fadf5d90. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:22.296725 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b520e89c364692af1aedde2a59c3da" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:22.298759 19763 raft_consensus.cc:3060] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:22.299629 22158 raft_consensus.cc:2749] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:22.302686 22224 raft_consensus.cc:2749] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:22.303380 22224 raft_consensus.cc:2804] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:22.303727 22224 raft_consensus.cc:493] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:22.304050 22224 raft_consensus.cc:3060] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:22.307576 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c755f16ea1496eb7fa26fb12e01708" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:22.308928 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:22.311489 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82d3233e4514813b22121f75d11eebc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:22.315717 19553 leader_election.cc:343] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:22.317308 22153 consensus_queue.cc:1048] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:56:22.317669 19553 leader_election.cc:343] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:22.316056 19409 leader_election.cc:304] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:22.320144 21962 raft_consensus.cc:493] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:22.327750 21962 raft_consensus.cc:515] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:22.329883 21962 leader_election.cc:290] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:22.327255 22218 raft_consensus.cc:2804] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:22.330966 22218 raft_consensus.cc:697] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [term 3 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:22.331787 22218 consensus_queue.cc:237] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:22.336905 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea6adefd15a4ea19011419949047e83" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:22.342998 22153 raft_consensus.cc:493] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:22.343739 22153 raft_consensus.cc:515] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:22.345636 20456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 264493us
I20260928 01:56:22.355197 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:22.358196 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:22.358947 19750 raft_consensus.cc:2468] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
W20260928 01:56:22.360314 19557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:22.361091 22213 raft_consensus.cc:493] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:22.361732 22213 raft_consensus.cc:515] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:22.365300 22212 consensus_queue.cc:1048] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:22.366385 22213 leader_election.cc:290] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:22.368764 22227 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:22.375530 22213 raft_consensus.cc:493] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:22.376039 22213 raft_consensus.cc:515] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:22.380120 22213 leader_election.cc:290] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:22.384327 22153 leader_election.cc:290] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:22.384497 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:22.390208 22239 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:22.395668 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca443386942e49d9a66143e1fde777c5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:22.409157 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 23) took 8712 ms. Trace:
I20260928 01:56:22.406329 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:22.410722 20029 tablet_bootstrap.cc:492] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:22.411198 21909 rpcz_store.cc:276] 0928 01:56:13.696243 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.697334 (+  1091us) service_pool.cc:224] Handling call
0928 01:56:20.543785 (+6846451us) ts_tablet_manager.cc:1151] Deleting tablet e05925303152462e8ca25cd15f3bedff
0928 01:56:20.543984 (+   199us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:21.693906 (+1149922us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:21.799202 (+105296us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:21.850556 (+ 51354us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b54001631a8. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a2164c1a1 00007f0a216d3f0c 00007f0a2233ed4b 00007f0a2236f960 00007f0a22355e6d 00007f0a22355e19 00007f0a22355da9 00007f0a22355d71 00007f0a22354f9d 00000000005bd4e4 00000000005bd319
0928 01:56:22.409064 (+558508us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":832643,"spinlock_wait_cycles":10507520,"tablet-delete.queue_time_us":6845574}
I20260928 01:56:22.418000 21909 tablet_replica.cc:333] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:22.430756 22239 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:22.432478 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:22.444190 19749 raft_consensus.cc:2393] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:22.448736 20029 tablet_bootstrap.cc:654] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:22.424016 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:22.461199 22145 consensus_queue.cc:1048] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:22.462890 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:22.467456 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:22.472298 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet e05925303152462e8ca25cd15f3bedff (table default.Table_21e19e0229e74ecba58c719d9d48d826 [id=73589cf1bbce4173ac1347c30cc2d811]) successfully deleted
I20260928 01:56:22.482658 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:22.485513 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:56:22.488371 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
I20260928 01:56:22.497114 22179 ts_tablet_manager.cc:1929] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:22.495136 22239 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:22.497709 22179 log.cc:1199] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/22fc9eff28c4436fb383c3d7169171bb
I20260928 01:56:22.498771 22179 ts_tablet_manager.cc:1950] T 22fc9eff28c4436fb383c3d7169171bb P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:22.499475 22239 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:22.502051 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 27) took 1827 ms. Trace:
W20260928 01:56:22.379443 19409 leader_election.cc:343] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:22.467728 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 363264us
I20260928 01:56:22.510337 19412 leader_election.cc:304] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:22.511169 22218 raft_consensus.cc:2749] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:22.377064 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 28) took 8800 ms. Trace:
W20260928 01:56:22.512029 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 132672us
I20260928 01:56:22.512769 21881 rpcz_store.cc:276] 0928 01:56:13.576238 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.576335 (+    97us) service_pool.cc:224] Handling call
0928 01:56:22.013421 (+8437086us) ts_tablet_manager.cc:1151] Deleting tablet 58c61408724e4a70b39e5dbdab9a3e8a
0928 01:56:22.376708 (+363287us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:22.376996 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8436607}
I20260928 01:56:22.515574 21881 tablet_replica.cc:333] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:22.349948 22224 raft_consensus.cc:515] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:22.514783 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 58c61408724e4a70b39e5dbdab9a3e8a because the tablet was not found. No further retry: Not found: Tablet not found: 58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:22.526005 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:22.528839 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:22.536732 22179 rpcz_store.cc:276] 0928 01:56:20.674773 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.684364 (+  9591us) service_pool.cc:224] Handling call
0928 01:56:21.859760 (+1175396us) ts_tablet_manager.cc:1151] Deleting tablet 22fc9eff28c4436fb383c3d7169171bb
0928 01:56:21.859844 (+    84us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:22.333315 (+473471us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:22.448076 (+114761us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:22.501954 (+ 53878us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":320598,"tablet-delete.queue_time_us":1158624}
I20260928 01:56:22.544530 22224 leader_election.cc:290] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:22.550725 22179 tablet_replica.cc:333] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:22.550822 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 22fc9eff28c4436fb383c3d7169171bb (table default.Table_9ee7221a3e36427e86752547f9beaecf [id=244840982471421db05cec7af71cad31]) successfully deleted
I20260928 01:56:22.554975 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
W20260928 01:56:22.564985 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 54716.4us
I20260928 01:56:22.567504 19412 leader_election.cc:304] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:22.568315 19409 leader_election.cc:304] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:22.568816 19412 leader_election.cc:304] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:22.555802 19703 leader_election.cc:304] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:56:22.571121 22218 raft_consensus.cc:2749] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:22.572340 22218 raft_consensus.cc:2804] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:22.572947 22218 raft_consensus.cc:493] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:22.573498 22218 raft_consensus.cc:3060] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:22.580744 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:22.585510 22162 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:22.586686 22162 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:22.592732 21909 raft_consensus.cc:2243] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:22.594980 22162 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:22.605647 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
W20260928 01:56:22.616416 19412 raft_consensus.cc:2686] T 49a73835e2854976b40b31fe752d1b1b P 37089d44fdba4b6488b5b5aea28af614: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:22.616624 22218 raft_consensus.cc:515] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:22.618110 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 49364.6us
I20260928 01:56:22.618867 19412 leader_election.cc:304] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:22.621380 22224 raft_consensus.cc:2749] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:22.626219 22218 leader_election.cc:290] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:22.547583 19188 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:53391 (request call id 256) took 9140 ms (client timeout 1000 ms). Trace:
W20260928 01:56:22.644513 19188 rpcz_store.cc:269] 0928 01:56:13.406871 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.407865 (+   994us) service_pool.cc:224] Handling call
0928 01:56:22.547303 (+9139438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118271,"reported_tablets":115}
I20260928 01:56:22.647992 22179 raft_consensus.cc:2243] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:22.649118 22179 raft_consensus.cc:2272] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 01:56:22.651664 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 95949.6us
I20260928 01:56:22.659556 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:22.673345 22145 raft_consensus.cc:493] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:22.674167 22145 raft_consensus.cc:515] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:22.675112 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:22.676040 19768 raft_consensus.cc:2393] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:22.676771 22153 raft_consensus.cc:493] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:22.677627 22153 raft_consensus.cc:515] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:22.679394 21909 raft_consensus.cc:2272] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:22.683773 21909 ts_tablet_manager.cc:1916] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:22.683739 22213 raft_consensus.cc:493] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:22.684298 22213 raft_consensus.cc:515] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:22.653455 22209 raft_consensus.cc:2804] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:22.687469 22213 leader_election.cc:290] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:22.697970 22228 consensus_queue.cc:1048] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:22.699214 22209 raft_consensus.cc:697] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:22.700450 22209 consensus_queue.cc:237] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:22.700948 22145 leader_election.cc:290] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:22.702930 22153 leader_election.cc:290] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:22.706175 22016 consensus_queue.cc:1048] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:22.707629 22179 ts_tablet_manager.cc:1916] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:22.708894 22016 consensus_queue.cc:1048] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:22.713750 21881 raft_consensus.cc:2243] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:22.714560 21881 raft_consensus.cc:2272] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:22.716966 21881 ts_tablet_manager.cc:1916] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:22.723513 22157 consensus_queue.cc:1048] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:22.727229 22157 consensus_queue.cc:1059] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260928 01:56:22.729981 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 77189us
I20260928 01:56:22.733458 22228 raft_consensus.cc:3055] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:22.733657 21972 raft_consensus.cc:493] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:22.734562 22228 raft_consensus.cc:740] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:22.735085 21972 raft_consensus.cc:515] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:22.736276 22228 consensus_queue.cc:260] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:22.738873 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12bafcc09ef4342bff89b0475f721af" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:22.748719 22228 raft_consensus.cc:3060] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:22.741652 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:22.747656 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:22.762137 19557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:22.755748 19765 raft_consensus.cc:2468] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:22.776109 19461 raft_consensus.cc:1275] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260928 01:56:22.779851 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 47326.2us
I20260928 01:56:22.781872 19704 leader_election.cc:304] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:22.790256 19461 raft_consensus.cc:3060] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:22.747797 21972 leader_election.cc:290] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:22.794154 19553 leader_election.cc:343] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:22.799765 19553 leader_election.cc:304] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:22.801144 22213 raft_consensus.cc:2804] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:22.801085 22162 raft_consensus.cc:2804] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:22.801487 22213 raft_consensus.cc:493] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:22.801783 22213 raft_consensus.cc:3060] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:22.806599 22162 raft_consensus.cc:697] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:22.809331 22162 consensus_queue.cc:237] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:22.779729 19760 raft_consensus.cc:2468] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:22.815439 19553 leader_election.cc:304] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:22.816431 22212 raft_consensus.cc:2804] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:22.816980 22212 raft_consensus.cc:493] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:22.817683 22212 raft_consensus.cc:3060] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:22.850114 22213 raft_consensus.cc:515] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:22.836584 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 217788us
I20260928 01:56:22.854884 19412 leader_election.cc:304] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:22.858865 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:22.864639 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
W20260928 01:56:22.870739 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 88924.6us
I20260928 01:56:22.873402 22212 raft_consensus.cc:515] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:22.875524 21962 raft_consensus.cc:2749] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:56:22.878249 19412 leader_election.cc:304] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:22.879096 21962 raft_consensus.cc:2749] T 5374596938d64cafb9621a1932ca1f68 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260928 01:56:22.880395 19411 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:22.890196 22256 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:22.890723 22256 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:22.890946 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:22.891844 19472 raft_consensus.cc:2368] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da for earlier term 1. Current term is 2.
I20260928 01:56:22.918951 22218 raft_consensus.cc:493] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:22.919639 22218 raft_consensus.cc:515] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:22.921425 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:22.922384 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:22.923717 22218 leader_election.cc:290] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:22.926128 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
W20260928 01:56:22.934589 22247 log.cc:927] Time spent T 12b836e20d6b43cba8eaa08887afb076 P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.052s	user 0.000s	sys 0.003s
I20260928 01:56:22.935604 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:22.937187 19751 raft_consensus.cc:2468] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:22.936499 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:22.940369 19766 raft_consensus.cc:3060] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:22.941354 19409 leader_election.cc:304] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:22.942521 22218 raft_consensus.cc:2804] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:22.943002 22218 raft_consensus.cc:493] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:22.943465 22218 raft_consensus.cc:3060] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:22.949460 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c7284250084d6299cafe8310cfd257" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:22.950405 19760 raft_consensus.cc:3060] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
W20260928 01:56:22.956676 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 53786.6us
I20260928 01:56:22.959249 22145 raft_consensus.cc:493] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:22.960340 22145 raft_consensus.cc:515] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:22.962747 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:22.963636 22145 leader_election.cc:290] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:22.972119 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:22.973109 19459 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:22.974264 22212 leader_election.cc:290] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:22.976759 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:22.974953 22256 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:22.979812 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156dae74ee748cd845b6dea1d3b8ea8" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:22.981756 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:22.982374 19765 raft_consensus.cc:2468] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
I20260928 01:56:22.985037 19553 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:22.986656 22256 raft_consensus.cc:2804] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 01:56:22.987138 22256 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:22.987721 22256 raft_consensus.cc:3060] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Advancing to term 4
W20260928 01:56:22.996345 20029 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.010s
W20260928 01:56:23.000988 20029 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.000s	sys 0.011s
I20260928 01:56:22.955924 19766 raft_consensus.cc:2468] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
W20260928 01:56:23.005846 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 127681us
I20260928 01:56:23.011210 19412 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:23.012970 21909 ts_tablet_manager.cc:1929] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:23.013655 21909 log.cc:1199] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/7daa1b799e0d408287edc03988f5b683
I20260928 01:56:23.014650 21909 ts_tablet_manager.cc:1950] T 7daa1b799e0d408287edc03988f5b683 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:23.017604 20029 tablet_bootstrap.cc:492] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:23.018072 20029 ts_tablet_manager.cc:1403] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.608s	user 0.009s	sys 0.015s
I20260928 01:56:23.021603 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:23.023708 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:23.024431 19621 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:23.030516 22179 ts_tablet_manager.cc:1929] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:23.051440 19465 raft_consensus.cc:1275] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:23.084229 21962 raft_consensus.cc:2749] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260928 01:56:23.085457 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 74329us
I20260928 01:56:23.102629 22218 raft_consensus.cc:515] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:23.033607 22213 leader_election.cc:290] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:23.068610 19553 leader_election.cc:304] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:56:23.105618 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:23.067843 22145 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:23.108618 22145 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:23.112702 22145 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:23.107117 22179 log.cc:1199] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/57a81b9455a340728fea713318e1e77a
I20260928 01:56:23.106101 22255 raft_consensus.cc:2804] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:23.123265 22255 raft_consensus.cc:697] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [term 3 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:23.124717 22255 consensus_queue.cc:237] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:23.129427 20029 raft_consensus.cc:359] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:23.130158 20029 raft_consensus.cc:385] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:23.130414 20029 raft_consensus.cc:740] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:23.131014 20029 consensus_queue.cc:260] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:23.135473 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 25) took 9438 ms. Trace:
I20260928 01:56:23.139961 20029 ts_tablet_manager.cc:1434] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.122s	user 0.001s	sys 0.006s
I20260928 01:56:23.135784 21909 rpcz_store.cc:276] 0928 01:56:13.696975 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.698219 (+  1244us) service_pool.cc:224] Handling call
0928 01:56:22.417763 (+8719544us) ts_tablet_manager.cc:1151] Deleting tablet 7daa1b799e0d408287edc03988f5b683
0928 01:56:22.417871 (+   108us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:22.934013 (+516142us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:23.012827 (+ 78814us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:23.135405 (+122578us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":328669,"tablet-delete.queue_time_us":8718885}
I20260928 01:56:23.141505 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 27) took 9443 ms. Trace:
I20260928 01:56:23.141781 21909 rpcz_store.cc:276] 0928 01:56:13.697626 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.699020 (+  1394us) service_pool.cc:224] Handling call
0928 01:56:23.141114 (+9442094us) ts_tablet_manager.cc:1151] Deleting tablet 57a81b9455a340728fea713318e1e77a
0928 01:56:23.141183 (+    69us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:23.141452 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9441443}
I20260928 01:56:23.143107 21909 tablet_replica.cc:333] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:23.144021 21909 raft_consensus.cc:2243] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Raft consensus shutting down.
I20260928 01:56:23.153700 21909 pending_rounds.cc:70] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da: Trying to abort 1 pending ops.
I20260928 01:56:23.154136 21909 pending_rounds.cc:77] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7334136147230384128 op_type: NO_OP noop_request { }
I20260928 01:56:23.154743 21909 raft_consensus.cc:2889] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:56:23.155654 21909 raft_consensus.cc:2272] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:23.161207 20029 tablet_bootstrap.cc:492] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:23.164740 19760 raft_consensus.cc:2468] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
I20260928 01:56:23.174698 22256 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:23.182081 21909 ts_tablet_manager.cc:1916] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:23.192895 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:23.076253 19461 raft_consensus.cc:1275] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260928 01:56:23.136803 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 50677.3us
I20260928 01:56:23.196290 19412 leader_election.cc:304] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:23.198462 22197 raft_consensus.cc:493] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:23.199154 21962 raft_consensus.cc:2749] T 2156dae74ee748cd845b6dea1d3b8ea8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:23.199156 22197 raft_consensus.cc:515] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:23.203383 22197 leader_election.cc:290] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:23.210640 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 7daa1b799e0d408287edc03988f5b683 (table default.Table_7b0eeaea0af144bf8165b6228c454e7e [id=a051e78b19ab4fe1be3db9e064eaf56d]) successfully deleted
W20260928 01:56:23.211589 19177 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 57a81b9455a340728fea713318e1e77a because the tablet was not found. No further retry: Not found: Tablet not found: 57a81b9455a340728fea713318e1e77a
I20260928 01:56:23.213133 21881 ts_tablet_manager.cc:1929] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:23.213562 21881 log.cc:1199] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/22fc9eff28c4436fb383c3d7169171bb
I20260928 01:56:23.216956 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:23.222972 19760 raft_consensus.cc:3060] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:23.225069 19412 leader_election.cc:304] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:23.225991 21962 raft_consensus.cc:2749] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:23.229065 19412 leader_election.cc:304] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:23.229918 21962 raft_consensus.cc:2749] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:56:23.232313 19412 leader_election.cc:304] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:23.233276 21962 raft_consensus.cc:2749] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:23.257612 19412 leader_election.cc:304] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:23.257736 19192 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:23.258610 21962 raft_consensus.cc:2749] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:23.263792 22256 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:23.272037 19763 raft_consensus.cc:1275] T 0e1ddfab489f4ace921d551c216039bd P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:23.274016 21962 consensus_queue.cc:1048] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:23.274719 19461 raft_consensus.cc:1275] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:23.284391 22218 leader_election.cc:290] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:23.285909 21881 ts_tablet_manager.cc:1950] T 22fc9eff28c4436fb383c3d7169171bb P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:23.296403 20029 tablet_bootstrap.cc:654] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:23.299072 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.287786 19192 catalog_manager.cc:5838] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 2, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 2 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:23.308084 19192 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:23.313325 19192 catalog_manager.cc:5838] T 522245da435b40ae84ae6dc5d19a2e95 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:23.328053 19192 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]). Expected version 1 got 0
W20260928 01:56:23.246606 22264 log.cc:927] Time spent T fc428ccbf88e4d5cbae197cb67e9a0a5 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260928 01:56:23.246850 19553 consensus_peers.cc:597] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7daa1b799e0d408287edc03988f5b683. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:23.334779 19192 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]). Expected version 1 got 0
W20260928 01:56:23.335258 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 88543.2us
I20260928 01:56:23.335821 19192 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]). Expected version 3 got 0
I20260928 01:56:23.186879 22179 ts_tablet_manager.cc:1950] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:23.337285 19192 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]). Expected version 1 got 0
I20260928 01:56:23.335880 19553 leader_election.cc:304] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:23.340823 19192 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]). Expected version 2 got 0
I20260928 01:56:23.313313 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:23.349376 19606 raft_consensus.cc:2393] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:23.350363 19192 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]). Expected version 1 got 0
I20260928 01:56:23.354012 22255 raft_consensus.cc:2804] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:23.348349 22228 raft_consensus.cc:493] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:23.357757 19192 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]). Expected version 1 got 0
I20260928 01:56:23.358665 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:23.360076 19751 raft_consensus.cc:3060] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:56:23.360674 19192 catalog_manager.cc:5838] T e927cd8a991f46278c2bb663cee7f753 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 2, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 2 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:23.357707 22228 raft_consensus.cc:515] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:23.367326 22255 raft_consensus.cc:697] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 3 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:23.372220 19192 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]). Expected version 2 got 0
I20260928 01:56:23.373385 19192 catalog_manager.cc:5838] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:23.371795 22255 consensus_queue.cc:237] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:23.380594 19192 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]). Expected version 1 got 0
I20260928 01:56:23.385612 22228 leader_election.cc:290] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:23.385635 19192 catalog_manager.cc:5838] T a01b795606604960bc7cafab4ff6f3d0 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:23.392692 19461 raft_consensus.cc:2393] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
W20260928 01:56:23.305968 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 48443.2us
I20260928 01:56:23.320647 19522 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:23.393927 19412 leader_election.cc:304] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:23.394698 21962 raft_consensus.cc:2804] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:23.395387 21962 raft_consensus.cc:697] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:23.396148 21962 consensus_queue.cc:237] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:23.376061 22218 raft_consensus.cc:493] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:23.400990 19412 leader_election.cc:304] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:23.403172 19606 raft_consensus.cc:1275] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260928 01:56:23.404349 19703 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 60536us
I20260928 01:56:23.405659 19751 raft_consensus.cc:2468] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 4.
I20260928 01:56:23.420895 22256 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:23.421736 22256 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:23.436188 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 28) took 2750 ms. Trace:
I20260928 01:56:23.437412 22179 rpcz_store.cc:276] 0928 01:56:20.685448 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.685715 (+   267us) service_pool.cc:224] Handling call
0928 01:56:22.550449 (+1864734us) ts_tablet_manager.cc:1151] Deleting tablet 57a81b9455a340728fea713318e1e77a
0928 01:56:22.550508 (+    59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:22.855261 (+304753us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:23.030344 (+175083us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:23.436056 (+405712us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89954,"tablet-delete.queue_time_us":1848990}
I20260928 01:56:23.442214 22179 tablet_replica.cc:333] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:23.448776 22267 raft_consensus.cc:2804] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:23.449707 22267 raft_consensus.cc:697] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:23.450928 22267 consensus_queue.cc:237] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:23.400535 22218 raft_consensus.cc:515] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:23.458367 22256 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:23.472376 22179 raft_consensus.cc:2243] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 01:56:23.473208 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 51804.1us
I20260928 01:56:23.473428 22179 raft_consensus.cc:2272] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:23.475873 22179 ts_tablet_manager.cc:1916] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:23.476713 22218 leader_election.cc:290] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:23.414422 22162 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:56:23.443504 19703 leader_election.cc:343] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 3c6cfc9ff3344a48b09730dfde79d6cf
I20260928 01:56:23.444255 22198 consensus_queue.cc:1048] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260928 01:56:23.486438 22162 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:23.490437 22162 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:23.494837 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 57a81b9455a340728fea713318e1e77a (table default.Table_a3ed770c6c6f410ba1b6c0db32c665bc [id=49662aab8c5046d2a1f6b7d363da8ada]) successfully deleted
I20260928 01:56:23.498204 20029 tablet_bootstrap.cc:492] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:23.498980 20029 ts_tablet_manager.cc:1403] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.338s	user 0.008s	sys 0.004s
I20260928 01:56:23.502279 19760 raft_consensus.cc:2468] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:23.506824 19667 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:23.512540 19703 leader_election.cc:400] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Vote denied by peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) with higher term. Message: Invalid argument: T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da for earlier term 1. Current term is 2.
I20260928 01:56:23.520466 19703 leader_election.cc:403] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
W20260928 01:56:23.521792 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 120886us
I20260928 01:56:23.524863 19704 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:23.526705 22228 raft_consensus.cc:2804] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:23.527113 22228 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:23.527439 22228 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:23.523726 19461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1710b95678440b1bff8a92080d43272" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.540629 19461 raft_consensus.cc:2468] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:23.540720 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.543306 19460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:23.544920 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:23.545727 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b836e20d6b43cba8eaa08887afb076" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:23.546305 19465 raft_consensus.cc:2393] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:23.547034 19466 raft_consensus.cc:2393] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:23.548120 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d114d5ba862044b4b88eee27395db7e3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.549057 19476 raft_consensus.cc:2468] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:23.548137 19462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:23.553516 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.554224 19473 raft_consensus.cc:2468] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:23.564742 19475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:56:23.570170 19557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260928 01:56:23.571595 19704 leader_election.cc:343] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:23.575465 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:23.576493 19751 raft_consensus.cc:2468] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:23.596475 19470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.610116 19469 raft_consensus.cc:1240] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 01:56:23.566128 19460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6b59144fe14daab98b0965c7f8af02" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.566143 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:23.566994 22273 raft_consensus.cc:493] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:23.566829 22277 raft_consensus.cc:493] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:23.628635 20029 raft_consensus.cc:359] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:23.632912 20029 raft_consensus.cc:385] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:23.637306 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:23.578660 19553 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:23.661628 22256 raft_consensus.cc:2804] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader election won for term 4
I20260928 01:56:23.662278 22256 raft_consensus.cc:697] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [term 4 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:23.664430 22153 raft_consensus.cc:493] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:23.665189 22153 raft_consensus.cc:515] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:23.670987 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:23.671757 19620 raft_consensus.cc:2468] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:23.674584 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:23.675323 19621 raft_consensus.cc:2468] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
W20260928 01:56:23.659960 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 81400.7us
I20260928 01:56:23.678596 19553 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:23.686627 22145 raft_consensus.cc:2804] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:23.687142 22145 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:23.687659 22145 raft_consensus.cc:3060] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:23.663676 22256 consensus_queue.cc:237] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:23.700872 22153 leader_election.cc:290] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:23.706758 19556 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.1:41953 timed out after 4.380s (SENT)
I20260928 01:56:23.656499 20029 raft_consensus.cc:740] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:23.726794 20029 consensus_queue.cc:260] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:23.741227 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9690a224bb004152ba65d525cc10bd9f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.600173 22285 tablet.cc:1751] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:23.742089 19469 raft_consensus.cc:2468] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:23.609470 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.657079 19464 raft_consensus.cc:3060] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:23.763195 22282 tablet.cc:1751] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:23.744031 19470 raft_consensus.cc:1240] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 2. Current term is 3. Ops: [2.1-2.1]
I20260928 01:56:23.768136 19471 raft_consensus.cc:2468] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
W20260928 01:56:23.767973 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 264817us
W20260928 01:56:23.770722 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 64043.6us
I20260928 01:56:23.782793 22198 raft_consensus.cc:3060] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:23.795845 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.799679 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 29) took 10222 ms. Trace:
I20260928 01:56:23.800146 21881 rpcz_store.cc:276] 0928 01:56:13.577176 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.577265 (+    89us) service_pool.cc:224] Handling call
0928 01:56:22.515384 (+8938119us) ts_tablet_manager.cc:1151] Deleting tablet 22fc9eff28c4436fb383c3d7169171bb
0928 01:56:22.515459 (+    75us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:23.071570 (+556111us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:23.212989 (+141419us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:23.799582 (+586593us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196999,"tablet-delete.queue_time_us":8937528}
I20260928 01:56:23.737272 22277 raft_consensus.cc:515] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:23.814193 22228 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:23.815178 22277 leader_election.cc:290] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:23.828869 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 229085us
I20260928 01:56:23.835961 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 31) took 5031 ms. Trace:
I20260928 01:56:23.836874 21881 rpcz_store.cc:276] 0928 01:56:18.804582 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:18.804857 (+   275us) service_pool.cc:224] Handling call
0928 01:56:23.806622 (+5001765us) ts_tablet_manager.cc:1151] Deleting tablet eac01fc222dd480cbed7cac37a0e6693
0928 01:56:23.806671 (+    49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:23.835893 (+ 29222us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5000339}
I20260928 01:56:23.659089 22273 raft_consensus.cc:515] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:23.841859 22228 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:23.848675 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 32) took 5031 ms. Trace:
I20260928 01:56:23.849308 21881 rpcz_store.cc:276] 0928 01:56:18.817293 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:18.817432 (+   139us) service_pool.cc:224] Handling call
0928 01:56:23.838555 (+5021123us) ts_tablet_manager.cc:1151] Deleting tablet 0ae3663fbe024a4e946e47339a4b9090
0928 01:56:23.838606 (+    51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:23.848567 (+  9961us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5020311}
I20260928 01:56:23.849973 22213 raft_consensus.cc:493] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:23.851003 22213 raft_consensus.cc:515] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:23.863065 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 92646.3us
I20260928 01:56:23.881878 22255 raft_consensus.cc:493] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:23.882686 22255 raft_consensus.cc:515] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:23.899514 21909 ts_tablet_manager.cc:1929] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260928 01:56:23.902153 21909 log.cc:1199] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/3c6cfc9ff3344a48b09730dfde79d6cf
I20260928 01:56:23.901578 20029 ts_tablet_manager.cc:1434] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.402s	user 0.009s	sys 0.011s
I20260928 01:56:23.905972 20029 tablet_bootstrap.cc:492] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:23.910609 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b520e89c364692af1aedde2a59c3da" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.911342 19459 raft_consensus.cc:2468] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:23.921888 22273 leader_election.cc:290] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:23.922791 22290 raft_consensus.cc:493] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:23.922901 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f6ce7612d4463ebe95e07557bca4e7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.923440 22290 raft_consensus.cc:515] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:23.926262 22290 leader_election.cc:290] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:23.919128 19460 raft_consensus.cc:1240] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:23.930199 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82d3233e4514813b22121f75d11eebc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.919440 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c755f16ea1496eb7fa26fb12e01708" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.932392 19458 raft_consensus.cc:2468] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:23.939131 19460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.940788 19460 raft_consensus.cc:2368] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 for earlier term 2. Current term is 3.
I20260928 01:56:23.942903 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea6adefd15a4ea19011419949047e83" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:23.942584 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca443386942e49d9a66143e1fde777c5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.947257 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12bafcc09ef4342bff89b0475f721af" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.949911 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.952314 22292 tablet.cc:1751] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:23.955732 21909 ts_tablet_manager.cc:1950] T 3c6cfc9ff3344a48b09730dfde79d6cf P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:23.957871 19471 raft_consensus.cc:2468] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:23.968947 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:23.969347 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.969647 19466 raft_consensus.cc:3060] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 3
I20260928 01:56:23.970171 19465 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:23.971837 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.973359 19460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2156dae74ee748cd845b6dea1d3b8ea8" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.974684 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:23.975344 19471 raft_consensus.cc:2468] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
W20260928 01:56:23.981491 19703 leader_election.cc:343] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:23.982234 22299 consensus_queue.cc:1048] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:23.985836 22198 raft_consensus.cc:2749] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) with higher term. Message: Invalid argument: T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da for earlier term 1. Current term is 2.
I20260928 01:56:23.986164 22281 tablet.cc:1751] T 897503329be649e38473561cea1fdaf1 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:23.996513 19703 leader_election.cc:304] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:24.007059 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 22fc9eff28c4436fb383c3d7169171bb (table default.Table_9ee7221a3e36427e86752547f9beaecf [id=244840982471421db05cec7af71cad31]) successfully deleted
W20260928 01:56:23.886313 19557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:23.909242 22213 leader_election.cc:290] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.019366 22306 raft_consensus.cc:493] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:24.024641 22197 consensus_queue.cc:1048] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:24.027506 22223 consensus_queue.cc:1048] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:24.026423 22198 raft_consensus.cc:2749] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:24.034614 19704 leader_election.cc:304] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:24.037274 22162 raft_consensus.cc:2804] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:24.037735 22162 raft_consensus.cc:493] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:24.038193 22162 raft_consensus.cc:3060] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:24.053509 20029 tablet_bootstrap.cc:654] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:24.066454 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:24.067524 19465 raft_consensus.cc:3060] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 4
I20260928 01:56:24.084371 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 33) took 5255 ms. Trace:
I20260928 01:56:24.084982 21881 rpcz_store.cc:276] 0928 01:56:18.829378 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:18.829527 (+   149us) service_pool.cc:224] Handling call
0928 01:56:23.876168 (+5046641us) ts_tablet_manager.cc:1151] Deleting tablet 7ab79c6ad03e481a903a0f95ae0512e6
0928 01:56:23.915260 (+ 39092us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b5800000f98. stack: 00007fc19ed9f323 00007fc19ed9f220 00007fc19e943574 0000000000516964 00000000005168f9 00007fc19ec558a1 00007fc19ed99b51 00007fc19ed9a182 00007fc1a7d0d2c9 00007fc1a6f1e918 00007fc1a6fe52c9 00007fc1a6fe58c3 00007fc1a7016960 00007fc1a6ffce6d 00007fc1a6ffce19 00007fc1a6ffcda9
0928 01:56:24.016512 (+101252us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.084299 (+ 67787us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85943168,"tablet-delete.queue_time_us":5045832}
W20260928 01:56:24.088320 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet eac01fc222dd480cbed7cac37a0e6693 because the tablet was not found. No further retry: Not found: Tablet not found: eac01fc222dd480cbed7cac37a0e6693
W20260928 01:56:24.090031 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 0ae3663fbe024a4e946e47339a4b9090 because the tablet was not found. No further retry: Not found: Tablet not found: 0ae3663fbe024a4e946e47339a4b9090
I20260928 01:56:24.059001 22299 consensus_queue.cc:1048] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:24.076644 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:24.078663 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:24.108693 19760 raft_consensus.cc:2468] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:24.112375 22306 raft_consensus.cc:515] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:24.113821 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 43904.8us
I20260928 01:56:24.070712 22256 raft_consensus.cc:493] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:24.115619 22256 raft_consensus.cc:515] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.119338 22256 leader_election.cc:290] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.110351 22255 leader_election.cc:290] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.068578 19466 raft_consensus.cc:2468] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
W20260928 01:56:24.132299 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 95295.4us
I20260928 01:56:24.133230 19704 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:24.135025 22228 raft_consensus.cc:2804] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:24.135582 22228 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:24.136168 22228 raft_consensus.cc:3060] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:24.142128 19471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:24.142508 22197 raft_consensus.cc:493] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:24.143041 22197 raft_consensus.cc:515] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.145367 22197 leader_election.cc:290] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.146906 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:24.147435 22286 raft_consensus.cc:493] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:24.147893 22286 raft_consensus.cc:515] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:24.149065 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea6adefd15a4ea19011419949047e83" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:24.150388 22286 leader_election.cc:290] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:24.150687 19459 raft_consensus.cc:2393] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
W20260928 01:56:24.162782 19409 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.005s	sys 0.005s
I20260928 01:56:24.055922 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 26) took 10358 ms. Trace:
I20260928 01:56:24.173733 21909 rpcz_store.cc:276] 0928 01:56:13.697298 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.700427 (+  3129us) service_pool.cc:224] Handling call
0928 01:56:23.142922 (+9442495us) ts_tablet_manager.cc:1151] Deleting tablet 3c6cfc9ff3344a48b09730dfde79d6cf
0928 01:56:23.142990 (+    68us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:23.590851 (+447861us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:23.899348 (+308497us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:24.055759 (+156411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95251,"tablet-delete.queue_time_us":9441905}
I20260928 01:56:24.129536 19464 raft_consensus.cc:2468] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
W20260928 01:56:24.184350 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 69724us
I20260928 01:56:24.189005 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 34) took 5347 ms. Trace:
I20260928 01:56:24.189707 19763 raft_consensus.cc:1240] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:24.189491 21881 rpcz_store.cc:276] 0928 01:56:18.842087 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:18.842226 (+   139us) service_pool.cc:224] Handling call
0928 01:56:24.182486 (+5340260us) ts_tablet_manager.cc:1151] Deleting tablet e05925303152462e8ca25cd15f3bedff
0928 01:56:24.182540 (+    54us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.188941 (+  6401us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5325584}
I20260928 01:56:24.190877 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 36) took 5324 ms. Trace:
I20260928 01:56:24.191325 21881 rpcz_store.cc:276] 0928 01:56:18.866789 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:18.867593 (+   804us) service_pool.cc:224] Handling call
0928 01:56:24.190599 (+5323006us) ts_tablet_manager.cc:1151] Deleting tablet 3c6cfc9ff3344a48b09730dfde79d6cf
0928 01:56:24.190644 (+    45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.190821 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5322055}
I20260928 01:56:24.063617 22162 raft_consensus.cc:515] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:24.207177 22162 leader_election.cc:290] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:24.210186 21909 tablet_replica.cc:333] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:24.213393 19703 leader_election.cc:304] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:24.215535 22253 raft_consensus.cc:3060] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:24.224100 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7ab79c6ad03e481a903a0f95ae0512e6 because the tablet was not found. No further retry: Not found: Tablet not found: 7ab79c6ad03e481a903a0f95ae0512e6
I20260928 01:56:24.225566 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf1b727e86a43b08bd464647fa529a3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:24.227248 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet e05925303152462e8ca25cd15f3bedff because the tablet was not found. No further retry: Not found: Tablet not found: e05925303152462e8ca25cd15f3bedff
I20260928 01:56:24.116302 22306 leader_election.cc:290] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.231607 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:24.232412 19621 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:24.237576 22179 ts_tablet_manager.cc:1929] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:24.238384 22179 log.cc:1199] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/7ab79c6ad03e481a903a0f95ae0512e6
I20260928 01:56:24.239511 22179 ts_tablet_manager.cc:1950] T 7ab79c6ad03e481a903a0f95ae0512e6 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:24.244134 19621 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:24.267652 20029 tablet_bootstrap.cc:492] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:24.268553 20029 ts_tablet_manager.cc:1403] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.365s	user 0.015s	sys 0.000s
I20260928 01:56:24.281704 22228 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:24.163643 19409 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.006s	sys 0.005s
I20260928 01:56:24.192879 19457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:24.294059 19457 raft_consensus.cc:2468] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
W20260928 01:56:24.200176 22282 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.436s	user 0.000s	sys 0.012s
W20260928 01:56:24.200619 22292 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.246s	user 0.000s	sys 0.006s
W20260928 01:56:24.184779 22285 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.332s	user 0.001s	sys 0.005s
I20260928 01:56:24.309652 19409 leader_election.cc:304] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:24.310489 22218 raft_consensus.cc:2804] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:24.311045 22218 raft_consensus.cc:697] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 3 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:24.311941 22218 consensus_queue.cc:237] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.225629 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf1b727e86a43b08bd464647fa529a3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:56:24.231491 22281 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.244s	user 0.000s	sys 0.003s
W20260928 01:56:24.336755 22320 log.cc:927] Time spent T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260928 01:56:24.245705 19465 raft_consensus.cc:2468] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 4.
I20260928 01:56:24.361271 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 35) took 5496 ms. Trace:
I20260928 01:56:24.364683 21881 rpcz_store.cc:276] 0928 01:56:18.865003 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:18.865175 (+   172us) service_pool.cc:224] Handling call
0928 01:56:24.349537 (+5484362us) ts_tablet_manager.cc:1151] Deleting tablet 8a5e07078b2a4fe59d9293d9511cbb6b
0928 01:56:24.360942 (+ 11405us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.361192 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5480531}
I20260928 01:56:24.374547 22228 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:24.381141 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 3c6cfc9ff3344a48b09730dfde79d6cf because the tablet was not found. No further retry: Not found: Tablet not found: 3c6cfc9ff3344a48b09730dfde79d6cf
I20260928 01:56:24.390100 19814 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:24.406208 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]). Expected version 1 got 0
I20260928 01:56:24.417932 22253 raft_consensus.cc:2749] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:24.271806 20029 raft_consensus.cc:359] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:24.420938 20029 raft_consensus.cc:385] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:24.421408 20029 raft_consensus.cc:740] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:24.422281 20029 consensus_queue.cc:260] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:24.423098 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 39) took 5510 ms. Trace:
I20260928 01:56:24.423542 21881 rpcz_store.cc:276] 0928 01:56:18.913043 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:18.913219 (+   176us) service_pool.cc:224] Handling call
0928 01:56:24.422628 (+5509409us) ts_tablet_manager.cc:1151] Deleting tablet 7daa1b799e0d408287edc03988f5b683
0928 01:56:24.422717 (+    89us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.423014 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5508535}
I20260928 01:56:24.425086 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 38) took 5514 ms. Trace:
I20260928 01:56:24.425446 21881 rpcz_store.cc:276] 0928 01:56:18.910822 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:18.920351 (+  9529us) service_pool.cc:224] Handling call
0928 01:56:24.424761 (+5504410us) ts_tablet_manager.cc:1151] Deleting tablet 89e1d60db21f4a8294792df3fadf5d90
0928 01:56:24.424806 (+    45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.425025 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5503479}
I20260928 01:56:24.426890 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 43) took 3139 ms. Trace:
I20260928 01:56:24.427184 21881 rpcz_store.cc:276] 0928 01:56:21.287450 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:21.288404 (+   954us) service_pool.cc:224] Handling call
0928 01:56:24.426510 (+3138106us) ts_tablet_manager.cc:1151] Deleting tablet f709eccf4ab5413bbbd8b4746f185db4
0928 01:56:24.426561 (+    51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.426826 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3125949}
I20260928 01:56:24.368374 22289 raft_consensus.cc:493] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:24.428535 22289 raft_consensus.cc:515] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:24.435204 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 3c6cfc9ff3344a48b09730dfde79d6cf (table default.Table_919e392236f9437fb1c2f9fee1f94f84 [id=e8373f635df4445ca4acdbab7cdeb448]) successfully deleted
I20260928 01:56:24.384742 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:24.443588 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:24.444172 19763 raft_consensus.cc:2468] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:24.446359 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:24.447108 19763 raft_consensus.cc:2393] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:24.450275 22289 leader_election.cc:290] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:24.469141 22329 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:24.472023 19190 catalog_manager.cc:5838] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:24.472740 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:24.473475 19463 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
W20260928 01:56:24.246515 22145 consensus_meta.cc:287] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0: Time spent flushing consensus metadata: real 0.555s	user 0.013s	sys 0.001s
I20260928 01:56:24.493582 22145 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.499368 22145 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:24.260910 19553 leader_election.cc:343] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:24.263408 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cc307b127446958bd4199a1aa60adb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:24.310508 19606 raft_consensus.cc:1275] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 1. (term mismatch)
I20260928 01:56:24.500407 19606 pending_rounds.cc:85] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0: Aborting all ops after (but not including) 0
I20260928 01:56:24.500655 19606 pending_rounds.cc:107] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20260928 01:56:24.500895 19606 raft_consensus.cc:2889] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 01:56:24.315225 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:24.352687 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 29) took 3646 ms. Trace:
I20260928 01:56:24.502732 22179 rpcz_store.cc:276] 0928 01:56:20.707403 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.707548 (+   145us) service_pool.cc:224] Handling call
0928 01:56:23.441842 (+2734294us) ts_tablet_manager.cc:1151] Deleting tablet 7ab79c6ad03e481a903a0f95ae0512e6
0928 01:56:23.441912 (+    70us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:23.879121 (+437209us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:24.237424 (+358303us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:24.352572 (+115148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27019,"tablet-delete.queue_time_us":2733296}
I20260928 01:56:24.504773 22179 tablet_replica.cc:333] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:24.412705 22256 raft_consensus.cc:493] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:24.436738 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22606f012f1c44bd92c8e0341e9ca2b7" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:24.505766 19611 raft_consensus.cc:2468] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:24.507090 22256 raft_consensus.cc:515] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.508428 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:24.509171 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:24.509166 19618 raft_consensus.cc:2468] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:24.509747 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:24.510761 22256 leader_election.cc:290] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.437871 22306 raft_consensus.cc:493] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:24.511507 22306 raft_consensus.cc:515] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.513979 22306 leader_election.cc:290] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.440367 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1710b95678440b1bff8a92080d43272" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:24.515377 19612 raft_consensus.cc:2468] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
W20260928 01:56:24.504658 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 243821us
W20260928 01:56:24.402355 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 61904.5us
I20260928 01:56:24.523694 19556 leader_election.cc:304] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:24.511905 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:24.534775 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:24.546041 20029 ts_tablet_manager.cc:1434] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.277s	user 0.007s	sys 0.000s
I20260928 01:56:24.541431 19190 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
I20260928 01:56:24.549760 19465 raft_consensus.cc:1275] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 1. (index mismatch)
I20260928 01:56:24.550583 19190 catalog_manager.cc:5838] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 2 to 3, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } }
I20260928 01:56:24.469874 22329 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:24.572063 21909 raft_consensus.cc:2243] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Raft consensus shutting down.
I20260928 01:56:24.572813 21909 raft_consensus.cc:2272] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:24.574589 22287 raft_consensus.cc:493] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:24.575201 22287 raft_consensus.cc:515] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.576831 21909 ts_tablet_manager.cc:1916] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:24.578004 22287 leader_election.cc:290] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:24.604691 19457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:24.605854 19457 raft_consensus.cc:2468] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:24.606825 22256 raft_consensus.cc:2804] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:24.607316 22256 raft_consensus.cc:493] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:24.607723 22256 raft_consensus.cc:3060] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:24.549450 19553 leader_election.cc:304] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:24.587911 22179 raft_consensus.cc:2243] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:24.613057 22179 raft_consensus.cc:2272] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:24.616808 22179 ts_tablet_manager.cc:1916] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:24.594277 22307 raft_consensus.cc:493] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:24.617758 22307 raft_consensus.cc:515] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.621776 22307 leader_election.cc:290] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.597930 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:24.622834 19611 raft_consensus.cc:2393] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 3: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:24.594043 22331 raft_consensus.cc:493] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:24.624469 22331 raft_consensus.cc:515] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.595952 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:24.627089 19612 raft_consensus.cc:3060] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:24.637176 22306 raft_consensus.cc:2804] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:24.638231 22306 raft_consensus.cc:493] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:24.638834 22306 raft_consensus.cc:3060] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
W20260928 01:56:24.640591 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 91304.9us
I20260928 01:56:24.642073 22213 consensus_queue.cc:1059] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:24.644562 22153 raft_consensus.cc:3055] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:24.645087 22153 raft_consensus.cc:740] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:24.645907 22153 consensus_queue.cc:260] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:24.647360 22153 raft_consensus.cc:3060] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:24.650223 22331 leader_election.cc:290] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:24.656786 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 133167us
I20260928 01:56:24.658812 19556 leader_election.cc:304] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:24.669144 20029 tablet_bootstrap.cc:492] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:56:24.672693 19553 leader_election.cc:343] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: e05925303152462e8ca25cd15f3bedff
W20260928 01:56:24.681412 19555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:24.685317 19612 raft_consensus.cc:2468] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:24.690263 22292 tablet.cc:1751] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:24.704527 22253 raft_consensus.cc:493] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:24.705643 22253 raft_consensus.cc:515] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.709021 22253 leader_election.cc:290] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.716583 20029 tablet_bootstrap.cc:654] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:24.723194 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:24.726311 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:24.727129 19760 raft_consensus.cc:2468] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
W20260928 01:56:24.744727 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 86057.2us
I20260928 01:56:24.745713 22213 raft_consensus.cc:2749] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 01:56:24.746088 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 72569.1us
I20260928 01:56:24.748543 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 7ab79c6ad03e481a903a0f95ae0512e6 (table default.Table_501342eaebce40d1a76ace4b05f022fd [id=f5f0643fe0534f2e82e105f01832931f]) successfully deleted
W20260928 01:56:24.751490 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:24.759042 22306 raft_consensus.cc:515] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:24.745859 19556 leader_election.cc:343] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 22606f012f1c44bd92c8e0341e9ca2b7
I20260928 01:56:24.760753 19556 leader_election.cc:304] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:24.761962 22145 raft_consensus.cc:2749] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:24.764148 19556 leader_election.cc:304] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:24.765404 22145 raft_consensus.cc:2749] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 01:56:24.767944 19556 leader_election.cc:343] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 57a81b9455a340728fea713318e1e77a
I20260928 01:56:24.768653 19556 leader_election.cc:304] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:24.769459 19556 raft_consensus.cc:2686] T 57a81b9455a340728fea713318e1e77a P a3ee288ca1464d20a715673422a214a0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:24.757892 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 44) took 3439 ms. Trace:
I20260928 01:56:24.782166 21881 rpcz_store.cc:276] 0928 01:56:21.318397 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:21.318554 (+   157us) service_pool.cc:224] Handling call
0928 01:56:24.757539 (+3438985us) ts_tablet_manager.cc:1151] Deleting tablet c320eb2ca2ac4ac68293ef8f7400b45f
0928 01:56:24.757593 (+    54us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.757797 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3108867}
W20260928 01:56:24.790812 19701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:24.795626 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1710b95678440b1bff8a92080d43272" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:24.796326 19464 raft_consensus.cc:2468] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:24.777436 22331 raft_consensus.cc:493] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:24.813845 22331 raft_consensus.cc:515] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.817477 22331 leader_election.cc:290] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:24.819820 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 51990.1us
I20260928 01:56:24.821019 19556 leader_election.cc:304] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:24.780907 22256 raft_consensus.cc:515] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:24.824119 22256 leader_election.cc:290] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.812942 22306 leader_election.cc:290] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.826599 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 361 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:24.829980 22329 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:24.831645 21909 ts_tablet_manager.cc:1929] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260928 01:56:24.832278 21909 log.cc:1199] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/89e1d60db21f4a8294792df3fadf5d90
I20260928 01:56:24.868376 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 46) took 3549 ms. Trace:
I20260928 01:56:24.868999 21881 rpcz_store.cc:276] 0928 01:56:21.319075 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:21.319928 (+   853us) service_pool.cc:224] Handling call
0928 01:56:24.783465 (+3463537us) ts_tablet_manager.cc:1151] Deleting tablet 7602706a3fbc438d8d448c9ac057087c
0928 01:56:24.783536 (+    71us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.783838 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3462357}
I20260928 01:56:24.870059 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:24.871282 19763 raft_consensus.cc:2393] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 3: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:24.875911 20029 tablet_bootstrap.cc:492] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:24.876619 20029 ts_tablet_manager.cc:1403] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.208s	user 0.011s	sys 0.003s
I20260928 01:56:24.880760 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:24.881533 19763 raft_consensus.cc:2468] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:24.901979 22331 raft_consensus.cc:2804] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:24.902518 22331 raft_consensus.cc:493] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:24.903117 22331 raft_consensus.cc:3060] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:24.871552 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 47) took 3319 ms. Trace:
I20260928 01:56:24.904875 21881 rpcz_store.cc:276] 0928 01:56:21.551862 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:21.552046 (+   184us) service_pool.cc:224] Handling call
0928 01:56:24.870990 (+3318944us) ts_tablet_manager.cc:1151] Deleting tablet 49a73835e2854976b40b31fe752d1b1b
0928 01:56:24.871067 (+    77us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.871410 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3318122}
I20260928 01:56:24.907140 21881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50444 (request call id 48) took 3354 ms. Trace:
W20260928 01:56:24.893724 22292 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.202s	user 0.003s	sys 0.000s
I20260928 01:56:24.879449 19463 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
W20260928 01:56:24.914584 19557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:24.916882 22331 raft_consensus.cc:515] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:24.919278 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:24.922559 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:24.923334 19760 raft_consensus.cc:1275] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:24.924141 19185 catalog_manager.cc:5838] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:24.925858 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:24.926582 19760 raft_consensus.cc:2468] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:24.879853 20029 raft_consensus.cc:359] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:24.944836 19185 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:24.950649 19185 catalog_manager.cc:5838] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:24.953687 22256 raft_consensus.cc:493] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:24.954282 22256 raft_consensus.cc:515] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.956596 22256 leader_election.cc:290] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.956699 19185 catalog_manager.cc:5838] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:24.961185 22256 raft_consensus.cc:493] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:24.961815 22256 raft_consensus.cc:515] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.964893 22306 raft_consensus.cc:493] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:24.965463 22306 raft_consensus.cc:515] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:24.967947 22306 leader_election.cc:290] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.970916 22256 leader_election.cc:290] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:24.972710 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 71271.1us
I20260928 01:56:24.976311 21881 rpcz_store.cc:276] 0928 01:56:21.552279 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:21.561515 (+  9236us) service_pool.cc:224] Handling call
0928 01:56:24.906464 (+3344949us) ts_tablet_manager.cc:1151] Deleting tablet 22606f012f1c44bd92c8e0341e9ca2b7
0928 01:56:24.906551 (+    87us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.907012 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3343988}
I20260928 01:56:24.950476 21909 ts_tablet_manager.cc:1950] T 89e1d60db21f4a8294792df3fadf5d90 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
W20260928 01:56:24.988337 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 167505us
I20260928 01:56:24.989454 22306 raft_consensus.cc:493] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:24.971973 20029 raft_consensus.cc:385] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:24.991412 20029 raft_consensus.cc:740] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:24.991292 22306 raft_consensus.cc:515] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:24.994129 22306 leader_election.cc:290] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:24.995019 22331 leader_election.cc:290] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:24.996042 19556 leader_election.cc:304] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:24.992101 20029 consensus_queue.cc:260] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:25.003028 19556 leader_election.cc:304] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:25.006424 19704 leader_election.cc:304] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:25.008417 22256 raft_consensus.cc:2749] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:25.004623 22306 raft_consensus.cc:2804] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:25.009284 22306 raft_consensus.cc:493] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:25.009719 22306 raft_consensus.cc:3060] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:25.012879 20029 ts_tablet_manager.cc:1434] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.136s	user 0.007s	sys 0.000s
I20260928 01:56:25.013576 22256 raft_consensus.cc:493] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:25.014012 22256 raft_consensus.cc:515] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.015750 22256 leader_election.cc:290] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:25.017302 19704 leader_election.cc:304] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:25.007754 22331 raft_consensus.cc:493] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:25.017976 22331 raft_consensus.cc:515] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.023386 22331 leader_election.cc:290] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:25.026811 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:25.027419 19768 raft_consensus.cc:3060] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:25.026453 19556 leader_election.cc:304] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:25.033880 22331 raft_consensus.cc:2749] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:25.020171 22299 raft_consensus.cc:493] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:25.035095 22299 raft_consensus.cc:515] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:25.037343 22253 raft_consensus.cc:2804] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:25.037746 22253 raft_consensus.cc:493] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:25.038061 22253 raft_consensus.cc:3060] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:25.043783 19765 raft_consensus.cc:1275] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260928 01:56:25.026685 22286 raft_consensus.cc:2804] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:25.048370 22286 raft_consensus.cc:493] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:25.049669 19768 raft_consensus.cc:2468] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
I20260928 01:56:25.048712 22286 raft_consensus.cc:3060] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:25.053314 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:25.057483 19751 raft_consensus.cc:1275] T 8b48eacc1cec49baabe2d87bdd06cd5c P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:25.024806 22290 consensus_queue.cc:1048] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260928 01:56:25.090879 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1710b95678440b1bff8a92080d43272" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:25.091343 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:25.091917 20029 tablet_bootstrap.cc:492] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:25.094201 19188 catalog_manager.cc:5838] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 2, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:25.105957 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 24) took 11409 ms. Trace:
I20260928 01:56:25.106374 21909 rpcz_store.cc:276] 0928 01:56:13.696655 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.701226 (+  4571us) service_pool.cc:224] Handling call
0928 01:56:24.175318 (+10474092us) ts_tablet_manager.cc:1151] Deleting tablet 89e1d60db21f4a8294792df3fadf5d90
0928 01:56:24.210031 (+ 34713us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.675512 (+465481us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:24.831471 (+155959us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:25.105866 (+274395us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":360732,"tablet-delete.queue_time_us":10473558}
I20260928 01:56:25.107941 21909 tablet_replica.cc:333] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:25.110177 19188 catalog_manager.cc:5838] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 2, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:25.114554 22299 leader_election.cc:290] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:25.117102 19188 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:25.120739 19188 catalog_manager.cc:5838] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 2, leader changed from 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:25.123805 22286 raft_consensus.cc:515] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.125941 22286 leader_election.cc:290] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:25.127489 20029 tablet_bootstrap.cc:654] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:25.128887 19188 catalog_manager.cc:5838] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 2, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:25.134413 19188 catalog_manager.cc:5838] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 2, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:25.145884 20029 tablet_bootstrap.cc:492] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:25.146351 20029 ts_tablet_manager.cc:1403] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260928 01:56:25.146492 22253 raft_consensus.cc:515] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:25.147645 19751 raft_consensus.cc:2393] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:25.152475 20029 raft_consensus.cc:359] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:25.153599 20029 raft_consensus.cc:385] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:25.154045 20029 raft_consensus.cc:740] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:25.155071 20029 consensus_queue.cc:260] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:25.159467 20029 ts_tablet_manager.cc:1434] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260928 01:56:25.160605 20029 tablet_bootstrap.cc:492] T e43bec2c4274497ea73872d0db233eac P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:25.171700 22253 leader_election.cc:290] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:25.176883 20029 tablet_bootstrap.cc:654] T e43bec2c4274497ea73872d0db233eac P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:25.183861 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36076aa674b9401b9b76fbf066348d06" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:25.035657 22179 ts_tablet_manager.cc:1929] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:25.041751 22153 raft_consensus.cc:493] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:25.216566 22153 raft_consensus.cc:515] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.218950 22153 leader_election.cc:290] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:25.082834 19557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:25.220479 22179 log.cc:1199] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/158edf7a5d724c88992fecbadd2cedfa
I20260928 01:56:25.221490 22179 ts_tablet_manager.cc:1950] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:25.223043 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 31) took 4511 ms. Trace:
I20260928 01:56:25.223410 22179 rpcz_store.cc:276] 0928 01:56:20.711163 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.711291 (+   128us) service_pool.cc:224] Handling call
0928 01:56:24.504167 (+3792876us) ts_tablet_manager.cc:1151] Deleting tablet 158edf7a5d724c88992fecbadd2cedfa
0928 01:56:24.504618 (+   451us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:24.833212 (+328594us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:25.035504 (+202292us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:25.222950 (+187446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81942,"tablet-delete.queue_time_us":3789347}
I20260928 01:56:25.225790 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 158edf7a5d724c88992fecbadd2cedfa (table default.Table_0991384f9b0745a389ad95d24675e413 [id=1ee3d2a1f321486d90ab82e5cef8f3aa]) successfully deleted
I20260928 01:56:25.226225 22179 tablet_replica.cc:333] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:25.227387 22179 raft_consensus.cc:2243] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:25.228127 22179 raft_consensus.cc:2272] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:25.231182 22179 ts_tablet_manager.cc:1916] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:25.185606 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 151978us
I20260928 01:56:25.240854 19556 leader_election.cc:304] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:25.241761 22153 raft_consensus.cc:3060] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:25.241537 19189 catalog_manager.cc:5838] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:25.252092 22153 raft_consensus.cc:2749] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:25.254271 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3b9ec9f88342c0aa77c0fc92d26205" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:25.259603 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]). Expected version 1 got 0
I20260928 01:56:25.263132 22306 raft_consensus.cc:515] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:25.263545 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]). Expected version 1 got 0
I20260928 01:56:25.267191 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]). Expected version 1 got 0
W20260928 01:56:25.268935 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 251690us
I20260928 01:56:25.269901 19704 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:25.271759 22286 raft_consensus.cc:2804] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:25.272281 22286 raft_consensus.cc:697] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:25.273175 22286 consensus_queue.cc:237] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.275498 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cacb4a90a54cd3b5b3e7a9310e06ed" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:25.279413 19189 catalog_manager.cc:5838] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:25.281942 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:25.282860 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:25.283749 19189 catalog_manager.cc:5838] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:25.286321 19189 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]). Expected version 1 got 0
I20260928 01:56:25.292615 22197 raft_consensus.cc:493] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:25.293195 22197 raft_consensus.cc:515] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.295382 22197 leader_election.cc:290] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:25.295151 19409 leader_election.cc:304] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:56:25.339848 19703 leader_election.cc:343] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: f709eccf4ab5413bbbd8b4746f185db4
W20260928 01:56:25.340162 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 8a5e07078b2a4fe59d9293d9511cbb6b because the tablet was not found. No further retry: Not found: Tablet not found: 8a5e07078b2a4fe59d9293d9511cbb6b
I20260928 01:56:25.344578 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cc307b127446958bd4199a1aa60adb" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:25.349367 19457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:25.350592 19457 raft_consensus.cc:2468] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:25.351219 19458 raft_consensus.cc:2393] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:25.353925 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1710b95678440b1bff8a92080d43272" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:25.354722 19458 raft_consensus.cc:3060] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:25.373365 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:25.384758 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d114d5ba862044b4b88eee27395db7e3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:25.385459 19763 raft_consensus.cc:3060] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:25.392448 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 120443us
I20260928 01:56:25.394449 19704 leader_election.cc:304] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:25.396940 22306 leader_election.cc:290] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:25.381990 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 141246us
I20260928 01:56:25.402980 20029 tablet_bootstrap.cc:492] T e43bec2c4274497ea73872d0db233eac P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:25.403507 20029 ts_tablet_manager.cc:1403] T e43bec2c4274497ea73872d0db233eac P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.243s	user 0.038s	sys 0.044s
I20260928 01:56:25.406781 22294 raft_consensus.cc:2804] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:25.392405 22331 raft_consensus.cc:493] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:25.407492 22294 raft_consensus.cc:697] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:25.408357 22294 consensus_queue.cc:237] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:25.409986 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:25.410642 19751 raft_consensus.cc:2468] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:25.410009 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:25.412066 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:25.412151 19760 raft_consensus.cc:2468] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:25.415565 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:25.416500 19762 raft_consensus.cc:2393] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:25.424636 19191 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:25.435521 19191 catalog_manager.cc:5838] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 2 to 3, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:25.436723 22273 raft_consensus.cc:2804] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:25.436892 19191 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:25.438745 22299 raft_consensus.cc:493] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:25.439327 22299 raft_consensus.cc:515] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.441634 22299 leader_election.cc:290] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:25.444249 19191 catalog_manager.cc:5838] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 2, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:25.447849 19192 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7] alter complete (version 1)
I20260928 01:56:25.461140 19615 raft_consensus.cc:1275] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:25.437275 22273 raft_consensus.cc:493] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:25.476536 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:25.468596 22273 raft_consensus.cc:3060] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
W20260928 01:56:25.480523 19702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:25.485662 19193 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6] alter complete (version 2)
I20260928 01:56:25.495692 20029 raft_consensus.cc:359] T e43bec2c4274497ea73872d0db233eac P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:25.496644 20029 raft_consensus.cc:385] T e43bec2c4274497ea73872d0db233eac P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:25.497062 20029 raft_consensus.cc:740] T e43bec2c4274497ea73872d0db233eac P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:25.406867 19556 leader_election.cc:304] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:25.507546 21909 raft_consensus.cc:2243] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:56:25.509490 21909 raft_consensus.cc:2272] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:25.512105 21909 ts_tablet_manager.cc:1916] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:25.531785 19555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:25.536309 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 89e1d60db21f4a8294792df3fadf5d90 (table default.Table_3ce866b8da2a4181bedfe396a59a2b76 [id=2e72bf3c803b4352af5b9d6300abbd35]) successfully deleted
I20260928 01:56:25.543265 22179 ts_tablet_manager.cc:1929] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:25.546590 19193 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9] alter complete (version 1)
I20260928 01:56:25.547482 22179 log.cc:1199] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/9ca0b52215454a99b6c5d1956088829a
I20260928 01:56:25.548494 22179 ts_tablet_manager.cc:1950] T 9ca0b52215454a99b6c5d1956088829a P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:25.554399 19189 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435] alter complete (version 1)
I20260928 01:56:25.572824 19763 raft_consensus.cc:2468] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:25.578590 22273 raft_consensus.cc:515] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:25.581103 19703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:25.595736 21909 ts_tablet_manager.cc:1929] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:25.596314 21909 log.cc:1199] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/9ca0b52215454a99b6c5d1956088829a
I20260928 01:56:25.597205 21909 ts_tablet_manager.cc:1950] T 9ca0b52215454a99b6c5d1956088829a P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:25.600585 19458 raft_consensus.cc:2468] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
W20260928 01:56:25.603207 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7daa1b799e0d408287edc03988f5b683 because the tablet was not found. No further retry: Not found: Tablet not found: 7daa1b799e0d408287edc03988f5b683
W20260928 01:56:25.603935 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 89e1d60db21f4a8294792df3fadf5d90 because the tablet was not found. No further retry: Not found: Tablet not found: 89e1d60db21f4a8294792df3fadf5d90
W20260928 01:56:25.604560 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet f709eccf4ab5413bbbd8b4746f185db4 because the tablet was not found. No further retry: Not found: Tablet not found: f709eccf4ab5413bbbd8b4746f185db4
W20260928 01:56:25.508704 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 210964us
W20260928 01:56:25.619765 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet c320eb2ca2ac4ac68293ef8f7400b45f because the tablet was not found. No further retry: Not found: Tablet not found: c320eb2ca2ac4ac68293ef8f7400b45f
W20260928 01:56:25.623474 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7602706a3fbc438d8d448c9ac057087c because the tablet was not found. No further retry: Not found: Tablet not found: 7602706a3fbc438d8d448c9ac057087c
W20260928 01:56:25.625038 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 49a73835e2854976b40b31fe752d1b1b because the tablet was not found. No further retry: Not found: Tablet not found: 49a73835e2854976b40b31fe752d1b1b
I20260928 01:56:25.407595 22331 raft_consensus.cc:515] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:25.626358 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 22606f012f1c44bd92c8e0341e9ca2b7 because the tablet was not found. No further retry: Not found: Tablet not found: 22606f012f1c44bd92c8e0341e9ca2b7
I20260928 01:56:25.630904 19188 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b] alter complete (version 2)
W20260928 01:56:25.633460 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 143427us
I20260928 01:56:25.633721 22273 leader_election.cc:290] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:25.635867 20029 consensus_queue.cc:260] T e43bec2c4274497ea73872d0db233eac P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:25.641938 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01cc307b127446958bd4199a1aa60adb" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:25.642714 19612 raft_consensus.cc:2393] T 01cc307b127446958bd4199a1aa60adb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
W20260928 01:56:25.642772 22351 log.cc:927] Time spent T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260928 01:56:25.643577 19553 leader_election.cc:304] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:25.635948 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:25.644904 19606 raft_consensus.cc:2468] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:25.657008 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 22) took 11961 ms. Trace:
I20260928 01:56:25.660557 22306 raft_consensus.cc:493] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:25.661101 22306 raft_consensus.cc:515] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.663170 22306 leader_election.cc:290] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:25.657537 21909 rpcz_store.cc:276] 0928 01:56:13.695913 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.701947 (+  6034us) service_pool.cc:224] Handling call
0928 01:56:25.107752 (+11405805us) ts_tablet_manager.cc:1151] Deleting tablet 9ca0b52215454a99b6c5d1956088829a
0928 01:56:25.107822 (+    70us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:25.570867 (+463045us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:25.595592 (+ 24725us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:25.656930 (+ 61338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390664,"tablet-delete.queue_time_us":11405141}
I20260928 01:56:25.666785 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2597de2c4304074977db5a3c0426814" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:25.667521 19467 raft_consensus.cc:2468] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:25.668301 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1710b95678440b1bff8a92080d43272" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:25.669430 19621 raft_consensus.cc:2393] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:25.670303 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22606f012f1c44bd92c8e0341e9ca2b7" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:25.670871 19612 raft_consensus.cc:3060] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:25.679152 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 32) took 4953 ms. Trace:
I20260928 01:56:25.679592 22179 rpcz_store.cc:276] 0928 01:56:20.725865 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.725996 (+   131us) service_pool.cc:224] Handling call
0928 01:56:25.226029 (+4500033us) ts_tablet_manager.cc:1151] Deleting tablet 9ca0b52215454a99b6c5d1956088829a
0928 01:56:25.226095 (+    66us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:25.465600 (+239505us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:25.543119 (+ 77519us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:25.679073 (+135954us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89892,"tablet-delete.queue_time_us":4499059}
I20260928 01:56:25.681146 22179 tablet_replica.cc:333] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:25.687253 22256 raft_consensus.cc:2804] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:25.687760 22256 raft_consensus.cc:493] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:25.688167 22256 raft_consensus.cc:3060] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:25.697749 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2597de2c4304074977db5a3c0426814" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:25.698419 19621 raft_consensus.cc:2468] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:25.700762 22331 leader_election.cc:290] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:25.702018 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 295231us
I20260928 01:56:25.703162 19556 leader_election.cc:304] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:25.706360 22306 raft_consensus.cc:2804] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:25.707628 22306 raft_consensus.cc:493] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:25.708990 22306 raft_consensus.cc:3060] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:25.648787 22286 raft_consensus.cc:493] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:25.725026 21909 tablet_replica.cc:333] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:25.703029 22299 raft_consensus.cc:493] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:25.725930 22299 raft_consensus.cc:515] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.726390 21909 raft_consensus.cc:2243] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:25.726971 21909 raft_consensus.cc:2272] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:25.701547 20029 ts_tablet_manager.cc:1434] T e43bec2c4274497ea73872d0db233eac P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.298s	user 0.006s	sys 0.003s
I20260928 01:56:25.723657 22286 raft_consensus.cc:515] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:25.729060 20029 tablet_bootstrap.cc:492] T 9690a224bb004152ba65d525cc10bd9f P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:25.733544 22299 leader_election.cc:290] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:25.735555 22286 leader_election.cc:290] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:25.759265 22286 consensus_queue.cc:1048] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:25.707422 22153 consensus_queue.cc:1048] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:56:25.714021 19553 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
W20260928 01:56:25.768328 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 54357.1us
I20260928 01:56:25.768962 19553 leader_election.cc:304] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:25.715056 22213 raft_consensus.cc:2749] T 4e6b59144fe14daab98b0965c7f8af02 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:25.770684 22213 raft_consensus.cc:2804] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:25.771071 22213 raft_consensus.cc:493] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:25.771451 22213 raft_consensus.cc:3060] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:25.745330 22331 consensus_queue.cc:1048] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:25.782094 22256 raft_consensus.cc:515] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.785421 19612 raft_consensus.cc:2468] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:25.790637 22213 raft_consensus.cc:515] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.801734 22213 leader_election.cc:290] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:25.804802 20456 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.566s (SENT)
I20260928 01:56:25.805357 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:25.796240 22331 raft_consensus.cc:493] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:25.811740 22153 consensus_queue.cc:1048] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 01:56:25.829888 22331 raft_consensus.cc:515] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:25.830310 19188 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12] alter complete (version 1)
I20260928 01:56:25.832154 22331 leader_election.cc:290] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:25.812973 19553 leader_election.cc:304] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:25.833180 21909 ts_tablet_manager.cc:1916] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:25.833660 22331 raft_consensus.cc:2804] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:25.834431 22331 raft_consensus.cc:697] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [term 3 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:25.835271 22331 consensus_queue.cc:237] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.839691 22363 consensus_queue.cc:1048] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260928 01:56:25.842299 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 139217us
I20260928 01:56:25.843482 19556 leader_election.cc:304] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:25.844291 22153 raft_consensus.cc:2804] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:25.844733 22153 raft_consensus.cc:493] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:25.845197 22153 raft_consensus.cc:3060] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:56:25.848685 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 230484us
I20260928 01:56:25.849431 22366 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:25.855655 19409 leader_election.cc:304] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:25.856487 22218 raft_consensus.cc:2804] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:25.856886 22218 raft_consensus.cc:493] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:25.856745 22153 raft_consensus.cc:515] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:25.857323 22218 raft_consensus.cc:3060] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:25.819231 22256 leader_election.cc:290] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:25.869419 19409 consensus_peers.cc:597] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:25.872354 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 269210us
I20260928 01:56:25.899215 20029 tablet_bootstrap.cc:654] T 9690a224bb004152ba65d525cc10bd9f P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:25.899334 22306 raft_consensus.cc:515] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:25.926081 22306 leader_election.cc:290] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:25.907876 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 64476.2us
W20260928 01:56:25.944832 19556 leader_election.cc:343] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 158edf7a5d724c88992fecbadd2cedfa
I20260928 01:56:25.945379 19556 leader_election.cc:304] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:25.946063 19556 raft_consensus.cc:2686] T 158edf7a5d724c88992fecbadd2cedfa P a3ee288ca1464d20a715673422a214a0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:25.946537 22256 raft_consensus.cc:493] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:25.947212 22256 raft_consensus.cc:515] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:25.858860 22153 leader_election.cc:290] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:25.949528 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:25.960841 21909 ts_tablet_manager.cc:1929] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:25.968259 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:25.969141 21909 log.cc:1199] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/22fc9eff28c4436fb383c3d7169171bb
I20260928 01:56:25.970081 21909 ts_tablet_manager.cc:1950] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
W20260928 01:56:25.971166 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 76305us
I20260928 01:56:25.972282 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 29) took 12225 ms. Trace:
I20260928 01:56:25.972712 21909 rpcz_store.cc:276] 0928 01:56:13.746653 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.746788 (+   135us) service_pool.cc:224] Handling call
0928 01:56:25.724799 (+11978011us) ts_tablet_manager.cc:1151] Deleting tablet 22fc9eff28c4436fb383c3d7169171bb
0928 01:56:25.724870 (+    71us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:25.921844 (+196974us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:25.960670 (+ 38826us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:25.972191 (+ 11521us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11976685}
I20260928 01:56:25.974159 21909 tablet_replica.cc:333] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:25.990002 22286 raft_consensus.cc:493] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:25.990538 22286 raft_consensus.cc:515] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:25.993578 19763 raft_consensus.cc:1240] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:25.995563 19186 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:25.995496 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:25.996387 19762 raft_consensus.cc:3060] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:25.997277 19186 catalog_manager.cc:5838] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:25.999680 19186 catalog_manager.cc:5838] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:26.005604 22286 leader_election.cc:290] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:26.007753 19762 raft_consensus.cc:2468] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:26.009136 19704 leader_election.cc:304] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:26.010987 22228 raft_consensus.cc:2804] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:26.011336 22228 raft_consensus.cc:493] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:26.011657 22228 raft_consensus.cc:3060] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:26.013034 19186 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:26.028039 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:26.030725 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb014699060e4a6caf4caaf33c31710a" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:26.035111 19188 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780] alter complete (version 1)
I20260928 01:56:26.034641 19184 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305] alter complete (version 2)
I20260928 01:56:26.036614 22289 consensus_queue.cc:1048] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:26.038297 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67be39a8cae04ff9ae99c2c3b02713cd" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:26.040364 19185 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7] alter complete (version 1)
I20260928 01:56:26.042918 22256 leader_election.cc:290] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:26.043547 22362 log.cc:927] Time spent T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.205s	user 0.000s	sys 0.004s
I20260928 01:56:26.062987 20029 tablet_bootstrap.cc:492] T 9690a224bb004152ba65d525cc10bd9f P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:26.063474 20029 ts_tablet_manager.cc:1403] T 9690a224bb004152ba65d525cc10bd9f P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.335s	user 0.010s	sys 0.003s
W20260928 01:56:26.040097 19704 leader_election.cc:343] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 22fc9eff28c4436fb383c3d7169171bb
I20260928 01:56:26.020165 22228 raft_consensus.cc:515] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.068636 22228 leader_election.cc:290] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:26.070811 19762 raft_consensus.cc:3060] T e43bec2c4274497ea73872d0db233eac P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:26.080307 22345 raft_consensus.cc:493] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:26.080936 22345 raft_consensus.cc:515] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:26.084101 22361 raft_consensus.cc:493] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:26.084671 22361 raft_consensus.cc:515] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:26.092497 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 56068.9us
I20260928 01:56:26.094789 19412 leader_election.cc:304] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.095559 22289 raft_consensus.cc:2804] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:26.096341 22289 raft_consensus.cc:697] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:26.097241 22289 consensus_queue.cc:237] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:26.103060 19704 leader_election.cc:304] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:26.104954 22162 raft_consensus.cc:2804] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:26.105360 22162 raft_consensus.cc:493] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:26.105724 22162 raft_consensus.cc:3060] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:26.106343 19189 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0] alter complete (version 1)
I20260928 01:56:26.115218 22162 raft_consensus.cc:515] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.117483 22162 leader_election.cc:290] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:26.118317 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 72141.3us
I20260928 01:56:26.120616 22253 consensus_queue.cc:1048] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:26.123490 19703 leader_election.cc:304] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:56:26.128553 22179 raft_consensus.cc:2243] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:26.134619 19814 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:26.065248 22218 raft_consensus.cc:515] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.138412 22218 leader_election.cc:290] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:26.083433 22345 leader_election.cc:290] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:26.087325 22361 leader_election.cc:290] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:26.152473 22179 raft_consensus.cc:2272] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:26.154973 22179 ts_tablet_manager.cc:1916] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:26.168923 20029 raft_consensus.cc:359] T 9690a224bb004152ba65d525cc10bd9f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:26.169727 20029 raft_consensus.cc:385] T 9690a224bb004152ba65d525cc10bd9f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 01:56:26.172318 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 48903.9us
W20260928 01:56:26.173244 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 225063us
I20260928 01:56:26.173610 22286 raft_consensus.cc:2764] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260928 01:56:26.174398 19556 leader_election.cc:304] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.175961 19191 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331] alter complete (version 1)
W20260928 01:56:26.176822 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 206243us
W20260928 01:56:26.179380 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 75201us
W20260928 01:56:26.185420 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 90756.1us
W20260928 01:56:26.188861 19556 consensus_peers.cc:597] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c320eb2ca2ac4ac68293ef8f7400b45f. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:26.189587 19556 leader_election.cc:304] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:26.197283 19701 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 66777.7us
I20260928 01:56:26.175400 22363 raft_consensus.cc:2749] T f7b78eb499d6418f8877bf3b59bbbec2 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:26.213953 22213 raft_consensus.cc:2804] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:26.214366 22213 raft_consensus.cc:493] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:26.214682 22213 raft_consensus.cc:3060] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:26.217178 19556 leader_election.cc:304] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.213263 19553 leader_election.cc:304] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:26.230882 19191 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d] alter complete (version 3)
W20260928 01:56:26.232343 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 58936.5us
W20260928 01:56:26.233146 19703 leader_election.cc:343] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 22606f012f1c44bd92c8e0341e9ca2b7
W20260928 01:56:26.236709 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 52844.6us
I20260928 01:56:26.237612 19704 leader_election.cc:304] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:26.265662 19191 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee] alter complete (version 1)
I20260928 01:56:26.286854 19191 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5] alter complete (version 1)
I20260928 01:56:26.290823 22289 consensus_queue.cc:1059] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:26.291714 22289 consensus_queue.cc:1243] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer 8373bfae1f384c36b5e4c5ca26b208da log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260928 01:56:26.292387 22218 raft_consensus.cc:3055] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:26.293035 22218 raft_consensus.cc:740] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:26.294934 22218 consensus_queue.cc:260] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:26.301944 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:26.302872 19763 raft_consensus.cc:2368] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:26.170040 20029 raft_consensus.cc:740] T 9690a224bb004152ba65d525cc10bd9f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:26.304898 20029 consensus_queue.cc:260] T 9690a224bb004152ba65d525cc10bd9f P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:26.309342 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 71807.1us
I20260928 01:56:26.310021 22162 raft_consensus.cc:2804] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
W20260928 01:56:26.311139 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 76461.9us
W20260928 01:56:26.269712 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 52617.9us
I20260928 01:56:26.316427 19556 leader_election.cc:304] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.317579 19556 leader_election.cc:304] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.329114 22162 raft_consensus.cc:697] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:26.330217 22162 consensus_queue.cc:237] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.342063 19763 raft_consensus.cc:1275] T 81c205176cb94d9f861cc140560944d4 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:26.268385 22363 raft_consensus.cc:2804] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260928 01:56:26.277532 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 52571.2us
I20260928 01:56:26.359122 19553 leader_election.cc:304] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:26.361223 19553 leader_election.cc:304] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:26.331931 22179 ts_tablet_manager.cc:1929] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:26.362303 22179 log.cc:1199] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/e05925303152462e8ca25cd15f3bedff
I20260928 01:56:26.363080 22179 ts_tablet_manager.cc:1950] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:26.363991 20029 ts_tablet_manager.cc:1434] T 9690a224bb004152ba65d525cc10bd9f P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.300s	user 0.005s	sys 0.003s
I20260928 01:56:26.366844 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 9ca0b52215454a99b6c5d1956088829a (table default.Table_d8fa3c5311e74d20aa00d9acb400810f [id=500a88f7dfbc403f9a04f06f9f6f95bf]) successfully deleted
I20260928 01:56:26.276615 22372 raft_consensus.cc:2749] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:26.370414 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 35) took 5633 ms. Trace:
W20260928 01:56:26.370972 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 80389.9us
I20260928 01:56:26.370759 22179 rpcz_store.cc:276] 0928 01:56:20.736738 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.736858 (+   120us) service_pool.cc:224] Handling call
0928 01:56:25.680940 (+4944082us) ts_tablet_manager.cc:1151] Deleting tablet e05925303152462e8ca25cd15f3bedff
0928 01:56:25.681008 (+    68us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:26.222598 (+541590us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:26.331788 (+109190us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:26.370355 (+ 38567us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":446222,"tablet-delete.queue_time_us":4943041}
I20260928 01:56:26.372017 22179 tablet_replica.cc:333] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:26.372985 22179 raft_consensus.cc:2243] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:56:26.357995 22331 raft_consensus.cc:2749] T a82d3233e4514813b22121f75d11eebc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:26.377213 20029 tablet_bootstrap.cc:492] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:26.381423 22306 raft_consensus.cc:2804] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:26.381821 22306 raft_consensus.cc:493] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:26.382122 22306 raft_consensus.cc:3060] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:26.369879 22371 raft_consensus.cc:2804] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:26.385594 22371 raft_consensus.cc:493] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:26.386041 22371 raft_consensus.cc:3060] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:26.386194 19188 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4] alter complete (version 1)
I20260928 01:56:26.369959 22256 raft_consensus.cc:2804] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:26.388581 22256 raft_consensus.cc:697] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:26.389467 22256 consensus_queue.cc:237] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:26.358197 22363 raft_consensus.cc:493] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:26.392998 22363 raft_consensus.cc:3060] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:26.401579 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 9ca0b52215454a99b6c5d1956088829a (table default.Table_d8fa3c5311e74d20aa00d9acb400810f [id=500a88f7dfbc403f9a04f06f9f6f95bf]) successfully deleted
I20260928 01:56:26.375761 22218 raft_consensus.cc:3060] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:26.268185 22213 raft_consensus.cc:515] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:26.417726 19605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:26.418408 19605 raft_consensus.cc:2468] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:26.419219 22213 leader_election.cc:290] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:26.419548 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb014699060e4a6caf4caaf33c31710a" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:26.420431 19617 raft_consensus.cc:2393] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:26.423449 22179 raft_consensus.cc:2272] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:26.427526 19409 leader_election.cc:304] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:56:26.405206 19703 leader_election.cc:343] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 22fc9eff28c4436fb383c3d7169171bb
I20260928 01:56:26.432518 19703 leader_election.cc:304] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:26.433717 19703 raft_consensus.cc:2686] T 22fc9eff28c4436fb383c3d7169171bb P 8373bfae1f384c36b5e4c5ca26b208da: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:26.422040 19761 raft_consensus.cc:3060] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:26.449055 22273 raft_consensus.cc:2804] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:26.451025 19188 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6] alter complete (version 1)
I20260928 01:56:26.466728 22363 raft_consensus.cc:515] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.469195 22363 leader_election.cc:290] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:26.477963 19185 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 280) took 4002 ms (client timeout 1000 ms). Trace:
W20260928 01:56:26.479910 19188 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:53391 (request call id 258) took 3568 ms (client timeout 1000 ms). Trace:
W20260928 01:56:26.484664 19191 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:53391 (request call id 259) took 1873 ms (client timeout 1000 ms). Trace:
I20260928 01:56:26.494765 22273 raft_consensus.cc:697] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [term 3 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:26.497213 22273 consensus_queue.cc:237] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:26.509675 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 22fc9eff28c4436fb383c3d7169171bb (table default.Table_9ee7221a3e36427e86752547f9beaecf [id=244840982471421db05cec7af71cad31]) successfully deleted
W20260928 01:56:26.518567 19189 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 257) took 2113 ms (client timeout 1000 ms). Trace:
W20260928 01:56:26.524317 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 138024us
I20260928 01:56:26.525116 19703 leader_election.cc:304] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:26.526253 19703 leader_election.cc:343] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 22606f012f1c44bd92c8e0341e9ca2b7
W20260928 01:56:26.531945 19104 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 29bf124261034ebf8595eeaae9d96d73 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 29bf124261034ebf8595eeaae9d96d73 consensus state has no leader
I20260928 01:56:26.471109 22371 raft_consensus.cc:515] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.533514 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 12c7284250084d6299cafe8310cfd257 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c395a6a87f4927b10973720aa4d868) from {username='slave'} at 127.0.0.1:50444
W20260928 01:56:26.534823 19702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:26.534936 19594 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ab79c6ad03e481a903a0f95ae0512e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:41 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:26.535492 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 22fc9eff28c4436fb383c3d7169171bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.534875 22371 leader_election.cc:290] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:26.474617 22179 ts_tablet_manager.cc:1916] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:26.496115 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 178602us
I20260928 01:56:26.526117 19667 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:26.527458 19600 tablet_service.cc:1558] Processing DeleteTablet for tablet eac01fc222dd480cbed7cac37a0e6693 with delete_type TABLET_DATA_DELETED (replaced by tablet 522245da435b40ae84ae6dc5d19a2e95) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:26.530840 19596 tablet_service.cc:1558] Processing DeleteTablet for tablet 22fc9eff28c4436fb383c3d7169171bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:26.540360 22385 raft_consensus.cc:493] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:26.531378 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 57a81b9455a340728fea713318e1e77a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:26.531822 19591 tablet_service.cc:1558] Processing DeleteTablet for tablet 158edf7a5d724c88992fecbadd2cedfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:26.532423 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ca0b52215454a99b6c5d1956088829a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:26.540977 22385 raft_consensus.cc:515] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:26.541781 19556 leader_election.cc:343] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 12c7284250084d6299cafe8310cfd257
I20260928 01:56:26.542917 19556 leader_election.cc:400] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) with higher term. Message: Invalid argument: T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 for earlier term 2. Current term is 3.
I20260928 01:56:26.543286 19556 leader_election.cc:403] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260928 01:56:26.544283 19556 leader_election.cc:304] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.479472 22306 raft_consensus.cc:515] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:26.545786 19556 leader_election.cc:304] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.546466 22213 raft_consensus.cc:3060] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 3
I20260928 01:56:26.546864 19556 leader_election.cc:304] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.554328 22213 raft_consensus.cc:2749] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) with higher term. Message: Invalid argument: T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 for earlier term 2. Current term is 3.
I20260928 01:56:26.555121 22289 raft_consensus.cc:493] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:26.555856 22289 raft_consensus.cc:515] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.558544 22289 leader_election.cc:290] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:26.556432 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 54250.4us
I20260928 01:56:26.566183 22306 leader_election.cc:290] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:26.566820 22382 raft_consensus.cc:493] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:26.567435 22382 raft_consensus.cc:515] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:26.520637 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet e05925303152462e8ca25cd15f3bedff (table default.Table_21e19e0229e74ecba58c719d9d48d826 [id=73589cf1bbce4173ac1347c30cc2d811]) successfully deleted
W20260928 01:56:26.584586 19180 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 63971.8us
W20260928 01:56:26.565189 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 12c7284250084d6299cafe8310cfd257 because the tablet was not found. No further retry: Not found: Tablet not found: 12c7284250084d6299cafe8310cfd257
W20260928 01:56:26.585991 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 22fc9eff28c4436fb383c3d7169171bb because the tablet was not found. No further retry: Not found: Tablet not found: 22fc9eff28c4436fb383c3d7169171bb
W20260928 01:56:26.478366 19185 rpcz_store.cc:269] 0928 01:56:22.475699 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:22.475921 (+   222us) service_pool.cc:224] Handling call
0928 01:56:26.477870 (+4001949us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:24.963865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:24.964405 (+   540us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:24.964436 (+    31us) write_op.cc:435] Acquired schema lock
0928 01:56:24.964448 (+    12us) tablet.cc:662] Decoding operations
0928 01:56:24.964969 (+   521us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:24.965017 (+    48us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:24.965053 (+    36us) tablet.cc:685] Acquiring locks for 3 operations
0928 01:56:24.965390 (+   337us) tablet.cc:701] Row locks acquired
0928 01:56:24.965411 (+    21us) write_op.cc:260] PREPARE: finished
0928 01:56:24.965552 (+   141us) write_op.cc:270] Start()
0928 01:56:24.965655 (+   103us) write_op.cc:276] Timestamp: P: 1790560584965499 usec, L: 0
0928 01:56:24.965675 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:56:24.966362 (+   687us) log.cc:844] Serialized 1284 byte log entry
0928 01:56:24.979085 (+ 12723us) op_driver.cc:464] REPLICATION: finished
0928 01:56:24.979447 (+   362us) write_op.cc:301] APPLY: starting
0928 01:56:24.979508 (+    61us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:24.979629 (+   121us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:24.979731 (+   102us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:24.980144 (+   413us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:24.980305 (+   161us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0928 01:56:24.980348 (+    43us) write_op.cc:312] APPLY: finished
0928 01:56:24.980561 (+   213us) log.cc:844] Serialized 35 byte log entry
0928 01:56:24.980737 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:24.980824 (+    87us) write_op.cc:454] Released schema lock
0928 01:56:24.980885 (+    61us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:24.981161 (+   276us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:24.981194 (+    33us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:25.834255 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:25.834763 (+   508us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:25.834793 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:56:25.834809 (+    16us) tablet.cc:662] Decoding operations
0928 01:56:25.835183 (+   374us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:25.835241 (+    58us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:25.835269 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:25.835461 (+   192us) tablet.cc:701] Row locks acquired
0928 01:56:25.835474 (+    13us) write_op.cc:260] PREPARE: finished
0928 01:56:25.835623 (+   149us) write_op.cc:270] Start()
0928 01:56:25.835719 (+    96us) write_op.cc:276] Timestamp: P: 1790560585835555 usec, L: 0
0928 01:56:25.835738 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:25.836347 (+   609us) log.cc:844] Serialized 356 byte log entry
0928 01:56:25.857220 (+ 20873us) op_driver.cc:464] REPLICATION: finished
0928 01:56:25.859320 (+  2100us) write_op.cc:301] APPLY: starting
0928 01:56:25.859394 (+    74us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:25.859501 (+   107us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:25.859633 (+   132us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:25.859854 (+   221us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:25.860006 (+   152us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:25.860047 (+    41us) write_op.cc:312] APPLY: finished
0928 01:56:25.860282 (+   235us) log.cc:844] Serialized 23 byte log entry
0928 01:56:25.860990 (+   708us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.861064 (+    74us) write_op.cc:454] Released schema lock
0928 01:56:25.861097 (+    33us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:25.861330 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.861353 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":168104,"reported_tablets":115,"child_traces":[["op",{"apply.queue_time_us":203,"apply.run_cpu_time_us":1668,"apply.run_wall_time_us":1661,"num_ops":3,"prepare.queue_time_us":134,"prepare.run_cpu_time_us":2858,"prepare.run_wall_time_us":2858,"raft.queue_time_us":1707,"raft.run_cpu_time_us":873,"raft.run_wall_time_us":874,"replication_time_us":13297}],["op",{"apply.queue_time_us":1903,"apply.run_cpu_time_us":1436,"apply.run_wall_time_us":1983,"num_ops":1,"prepare.queue_time_us":17046,"prepare.run_cpu_time_us":2314,"prepare.run_wall_time_us":2341,"replication_time_us":21375}]]}
W20260928 01:56:26.483709 19188 rpcz_store.cc:269] 0928 01:56:22.911173 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:22.913158 (+  1985us) service_pool.cc:224] Handling call
0928 01:56:26.479809 (+3566651us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:25.155214 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:25.155798 (+   584us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:25.155830 (+    32us) write_op.cc:435] Acquired schema lock
0928 01:56:25.155846 (+    16us) tablet.cc:662] Decoding operations
0928 01:56:25.156531 (+   685us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:25.156584 (+    53us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:25.156611 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0928 01:56:25.157203 (+   592us) tablet.cc:701] Row locks acquired
0928 01:56:25.157219 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:56:25.157366 (+   147us) write_op.cc:270] Start()
0928 01:56:25.157467 (+   101us) write_op.cc:276] Timestamp: P: 1790560585157312 usec, L: 0
0928 01:56:25.157484 (+    17us) op_driver.cc:348] REPLICATION: starting
0928 01:56:25.158124 (+   640us) log.cc:844] Serialized 2039 byte log entry
0928 01:56:25.168468 (+ 10344us) op_driver.cc:464] REPLICATION: finished
0928 01:56:25.168824 (+   356us) write_op.cc:301] APPLY: starting
0928 01:56:25.168887 (+    63us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:25.169066 (+   179us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:25.169169 (+   103us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:25.169787 (+   618us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:25.169951 (+   164us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0928 01:56:25.169999 (+    48us) write_op.cc:312] APPLY: finished
0928 01:56:25.170233 (+   234us) log.cc:844] Serialized 47 byte log entry
0928 01:56:25.170395 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.170599 (+   204us) write_op.cc:454] Released schema lock
0928 01:56:25.170635 (+    36us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:25.170882 (+   247us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.170907 (+    25us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:25.612170 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:25.612709 (+   539us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:25.612738 (+    29us) write_op.cc:435] Acquired schema lock
0928 01:56:25.612754 (+    16us) tablet.cc:662] Decoding operations
0928 01:56:25.613058 (+   304us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:25.613102 (+    44us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:25.613134 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:25.613303 (+   169us) tablet.cc:701] Row locks acquired
0928 01:56:25.613320 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:56:25.613609 (+   289us) write_op.cc:270] Start()
0928 01:56:25.613715 (+   106us) write_op.cc:276] Timestamp: P: 1790560585613404 usec, L: 0
0928 01:56:25.613731 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:56:25.614356 (+   625us) log.cc:844] Serialized 356 byte log entry
0928 01:56:25.627812 (+ 13456us) op_driver.cc:464] REPLICATION: finished
0928 01:56:25.628330 (+   518us) write_op.cc:301] APPLY: starting
0928 01:56:25.628406 (+    76us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:25.628503 (+    97us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:25.628602 (+    99us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:25.628850 (+   248us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:25.628983 (+   133us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:25.629037 (+    54us) write_op.cc:312] APPLY: finished
0928 01:56:25.629231 (+   194us) log.cc:844] Serialized 23 byte log entry
0928 01:56:25.629395 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.629470 (+    75us) write_op.cc:454] Released schema lock
0928 01:56:25.629501 (+    31us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:25.629732 (+   231us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.629757 (+    25us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:25.735395 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:25.735991 (+   596us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:25.736020 (+    29us) write_op.cc:435] Acquired schema lock
0928 01:56:25.736033 (+    13us) tablet.cc:662] Decoding operations
0928 01:56:25.736369 (+   336us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:25.736419 (+    50us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:25.736445 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:25.736618 (+   173us) tablet.cc:701] Row locks acquired
0928 01:56:25.736636 (+    18us) write_op.cc:260] PREPARE: finished
0928 01:56:25.736783 (+   147us) write_op.cc:270] Start()
0928 01:56:25.736884 (+   101us) write_op.cc:276] Timestamp: P: 1790560585736715 usec, L: 0
0928 01:56:25.736903 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:25.737581 (+   678us) log.cc:844] Serialized 356 byte log entry
0928 01:56:25.823605 (+ 86024us) op_driver.cc:464] REPLICATION: finished
0928 01:56:25.823885 (+   280us) write_op.cc:301] APPLY: starting
0928 01:56:25.823946 (+    61us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:25.824073 (+   127us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:25.824193 (+   120us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:25.824700 (+   507us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:25.824825 (+   125us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:25.824865 (+    40us) write_op.cc:312] APPLY: finished
0928 01:56:25.825062 (+   197us) log.cc:844] Serialized 23 byte log entry
0928 01:56:25.825213 (+   151us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.825288 (+    75us) write_op.cc:454] Released schema lock
0928 01:56:25.825319 (+    31us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:25.825556 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.825579 (+    23us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:25.851811 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:25.862782 (+ 10971us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:25.862812 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:56:25.862831 (+    19us) tablet.cc:662] Decoding operations
0928 01:56:25.863145 (+   314us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:25.863193 (+    48us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:25.863219 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:25.863405 (+   186us) tablet.cc:701] Row locks acquired
0928 01:56:25.863423 (+    18us) write_op.cc:260] PREPARE: finished
0928 01:56:25.863567 (+   144us) write_op.cc:270] Start()
0928 01:56:25.863655 (+    88us) write_op.cc:276] Timestamp: P: 1790560585863502 usec, L: 0
0928 01:56:25.863674 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:25.864307 (+   633us) log.cc:844] Serialized 356 byte log entry
0928 01:56:25.872941 (+  8634us) op_driver.cc:464] REPLICATION: finished
0928 01:56:25.874999 (+  2058us) write_op.cc:301] APPLY: starting
0928 01:56:25.875069 (+    70us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:25.875181 (+   112us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:25.875284 (+   103us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:25.875474 (+   190us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:25.875620 (+   146us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:25.875662 (+    42us) write_op.cc:312] APPLY: finished
0928 01:56:25.875866 (+   204us) log.cc:844] Serialized 23 byte log entry
0928 01:56:25.876741 (+   875us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.876811 (+    70us) write_op.cc:454] Released schema lock
0928 01:56:25.876841 (+    30us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:25.897399 (+ 20558us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.897429 (+    30us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:26.359546 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:26.360025 (+   479us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:26.360053 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:56:26.360065 (+    12us) tablet.cc:662] Decoding operations
0928 01:56:26.360400 (+   335us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:26.360450 (+    50us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:26.360474 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:26.360650 (+   176us) tablet.cc:701] Row locks acquired
0928 01:56:26.360668 (+    18us) write_op.cc:260] PREPARE: finished
0928 01:56:26.360806 (+   138us) write_op.cc:270] Start()
0928 01:56:26.360916 (+   110us) write_op.cc:276] Timestamp: P: 1790560586360748 usec, L: 0
0928 01:56:26.360934 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:26.361512 (+   578us) log.cc:844] Serialized 356 byte log entry
0928 01:56:26.383137 (+ 21625us) op_driver.cc:464] REPLICATION: finished
0928 01:56:26.383620 (+   483us) write_op.cc:301] APPLY: starting
0928 01:56:26.383685 (+    65us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:26.383809 (+   124us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:26.383925 (+   116us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:26.384104 (+   179us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:26.384325 (+   221us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:26.384367 (+    42us) write_op.cc:312] APPLY: finished
0928 01:56:26.384546 (+   179us) log.cc:844] Serialized 23 byte log entry
0928 01:56:26.384703 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.384765 (+    62us) write_op.cc:454] Released schema lock
0928 01:56:26.384795 (+    30us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:26.385050 (+   255us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.385083 (+    33us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:26.422103 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:26.422587 (+   484us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:26.422617 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:56:26.422786 (+   169us) tablet.cc:662] Decoding operations
0928 01:56:26.423185 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:26.423231 (+    46us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:26.423258 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:26.423436 (+   178us) tablet.cc:701] Row locks acquired
0928 01:56:26.423453 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:56:26.423597 (+   144us) write_op.cc:270] Start()
0928 01:56:26.423692 (+    95us) write_op.cc:276] Timestamp: P: 1790560586423533 usec, L: 0
0928 01:56:26.423711 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:26.424364 (+   653us) log.cc:844] Serialized 356 byte log entry
0928 01:56:26.447990 (+ 23626us) op_driver.cc:464] REPLICATION: finished
0928 01:56:26.448313 (+   323us) write_op.cc:301] APPLY: starting
0928 01:56:26.448396 (+    83us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:26.448541 (+   145us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:26.448670 (+   129us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:26.448902 (+   232us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:26.449056 (+   154us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:26.449120 (+    64us) write_op.cc:312] APPLY: finished
0928 01:56:26.449321 (+   201us) log.cc:844] Serialized 23 byte log entry
0928 01:56:26.449489 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.449562 (+    73us) write_op.cc:454] Released schema lock
0928 01:56:26.449594 (+    32us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:26.449869 (+   275us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.449893 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":79539,"reported_tablets":111,"child_traces":[["op",{"apply.queue_time_us":210,"apply.run_cpu_time_us":2013,"apply.run_wall_time_us":2012,"num_ops":5,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":3433,"prepare.run_wall_time_us":11817,"raft.queue_time_us":105,"raft.run_cpu_time_us":904,"raft.run_wall_time_us":905,"replication_time_us":10868}],["op",{"apply.queue_time_us":310,"apply.run_cpu_time_us":1374,"apply.run_wall_time_us":1374,"num_ops":1,"prepare.queue_time_us":32029,"prepare.run_cpu_time_us":2434,"prepare.run_wall_time_us":5433,"raft.queue_time_us":483,"raft.run_cpu_time_us":763,"raft.run_wall_time_us":763,"replication_time_us":13957}],["op",{"apply.queue_time_us":119,"apply.run_cpu_time_us":1363,"apply.run_wall_time_us":1623,"num_ops":1,"prepare.queue_time_us":8372,"prepare.run_cpu_time_us":2468,"prepare.run_wall_time_us":2468,"replication_time_us":86573}],["op",{"apply.queue_time_us":1882,"apply.run_cpu_time_us":1361,"apply.run_wall_time_us":2056,"num_ops":1,"prepare.queue_time_us":6773,"prepare.run_cpu_time_us":2530,"prepare.run_wall_time_us":45579,"raft.queue_time_us":92,"raft.run_cpu_time_us":837,"raft.run_wall_time_us":1246,"replication_time_us":9143}],["op",{"apply.queue_time_us":220,"apply.run_cpu_time_us":1418,"apply.run_wall_time_us":1420,"num_ops":1,"prepare.queue_time_us":126,"prepare.run_cpu_time_us":2267,"prepare.run_wall_time_us":2268,"raft.queue_time_us":1347,"raft.run_cpu_time_us":693,"raft.run_wall_time_us":694,"replication_time_us":22095}],["op",{"apply.queue_time_us":100,"apply.run_cpu_time_us":1513,"apply.run_wall_time_us":1513,"num_ops":1,"prepare.queue_time_us":11710,"prepare.run_cpu_time_us":2609,"prepare.run_wall_time_us":2609,"raft.queue_time_us":1570,"raft.run_cpu_time_us":770,"raft.run_wall_time_us":770,"replication_time_us":24155}]]}
I20260928 01:56:26.588722 19605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:26.589440 19605 raft_consensus.cc:2468] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
W20260928 01:56:26.576332 19190 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 256) took 4255 ms (client timeout 1000 ms). Trace:
I20260928 01:56:26.591544 19605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:26.592130 19605 raft_consensus.cc:3060] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
W20260928 01:56:26.590644 19190 rpcz_store.cc:269] 0928 01:56:22.321113 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:22.321295 (+   182us) service_pool.cc:224] Handling call
0928 01:56:26.569029 (+4247734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:24.585849 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:24.586562 (+   713us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:24.586593 (+    31us) write_op.cc:435] Acquired schema lock
0928 01:56:24.586611 (+    18us) tablet.cc:662] Decoding operations
0928 01:56:24.587063 (+   452us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:24.587120 (+    57us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:24.587148 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:56:24.587493 (+   345us) tablet.cc:701] Row locks acquired
0928 01:56:24.587507 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:56:24.607520 (+ 20013us) write_op.cc:270] Start()
0928 01:56:24.607665 (+   145us) write_op.cc:276] Timestamp: P: 1790560584607459 usec, L: 0
0928 01:56:24.607689 (+    24us) op_driver.cc:348] REPLICATION: starting
0928 01:56:24.608687 (+   998us) log.cc:844] Serialized 907 byte log entry
0928 01:56:24.699721 (+ 91034us) op_driver.cc:464] REPLICATION: finished
0928 01:56:24.711041 (+ 11320us) write_op.cc:301] APPLY: starting
0928 01:56:24.711121 (+    80us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:24.711262 (+   141us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:24.711386 (+   124us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:24.711719 (+   333us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:24.711875 (+   156us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:56:24.711918 (+    43us) write_op.cc:312] APPLY: finished
0928 01:56:24.712173 (+   255us) log.cc:844] Serialized 29 byte log entry
0928 01:56:24.728455 (+ 16282us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:24.728542 (+    87us) write_op.cc:454] Released schema lock
0928 01:56:24.728598 (+    56us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:24.732746 (+  4148us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:24.732847 (+   101us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":243814,"reported_tablets":99,"child_traces":[["op",{"apply.queue_time_us":11065,"apply.run_cpu_time_us":2021,"apply.run_wall_time_us":21611,"num_ops":2,"prepare.queue_time_us":5960,"prepare.run_cpu_time_us":3489,"prepare.run_wall_time_us":23167,"replication_time_us":74331,"spinlock_wait_cycles":75648,"thread_start_us":15384,"threads_started":2}]]}
I20260928 01:56:26.602154 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:26.602801 19612 raft_consensus.cc:2468] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:26.604287 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:26.605043 19612 raft_consensus.cc:2393] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:26.607671 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2597de2c4304074977db5a3c0426814" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:26.608284 19612 raft_consensus.cc:3060] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 3
I20260928 01:56:26.613119 19621 raft_consensus.cc:1275] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:26.629041 22363 raft_consensus.cc:2804] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:26.629750 22363 raft_consensus.cc:493] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:26.630462 22363 raft_consensus.cc:3060] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:26.586391 19189 rpcz_store.cc:269] 0928 01:56:24.404864 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:24.405076 (+   212us) service_pool.cc:224] Handling call
0928 01:56:24.714989 (+309913us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b5400030554. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbb5c0 00007f2fcdc5a6fa 00007f2fcf9cbd8c 00007f2fcfaca01e 00007f2fcd66efb4 00007f2fcd66ef42 00007f2fcd66ee71 00007f2fcd66edec 00007f2fcd66e0a2 00007f2fcb92009c 00007f2fcb91f4d6
0928 01:56:25.340309 (+625320us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.340337 (+    28us) write_op.cc:454] Released schema lock
0928 01:56:25.484354 (+144017us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.484381 (+    27us) write_op.cc:454] Released schema lock
0928 01:56:26.518325 (+1033944us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:25.303227 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:25.303717 (+   490us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:25.303745 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:56:25.303759 (+    14us) tablet.cc:662] Decoding operations
0928 01:56:25.304295 (+   536us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:25.304341 (+    46us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:25.304372 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0928 01:56:25.304676 (+   304us) tablet.cc:701] Row locks acquired
0928 01:56:25.304694 (+    18us) write_op.cc:260] PREPARE: finished
0928 01:56:25.304835 (+   141us) write_op.cc:270] Start()
0928 01:56:25.304955 (+   120us) write_op.cc:276] Timestamp: P: 1790560585304772 usec, L: 0
0928 01:56:25.304975 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:56:25.305620 (+   645us) log.cc:844] Serialized 1284 byte log entry
0928 01:56:25.322983 (+ 17363us) op_driver.cc:464] REPLICATION: finished
0928 01:56:25.323343 (+   360us) write_op.cc:301] APPLY: starting
0928 01:56:25.323400 (+    57us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:25.323543 (+   143us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:25.323639 (+    96us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:25.324043 (+   404us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:25.324227 (+   184us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0928 01:56:25.324267 (+    40us) write_op.cc:312] APPLY: finished
0928 01:56:25.324478 (+   211us) log.cc:844] Serialized 35 byte log entry
0928 01:56:25.324638 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.324715 (+    77us) write_op.cc:454] Released schema lock
0928 01:56:25.324754 (+    39us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0928 01:56:25.461763 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:25.462249 (+   486us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:25.462277 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:56:25.462293 (+    16us) tablet.cc:662] Decoding operations
0928 01:56:25.462597 (+   304us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:25.462640 (+    43us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:25.462666 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:25.462829 (+   163us) tablet.cc:701] Row locks acquired
0928 01:56:25.462846 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:56:25.462992 (+   146us) write_op.cc:270] Start()
0928 01:56:25.463083 (+    91us) write_op.cc:276] Timestamp: P: 1790560585462925 usec, L: 0
0928 01:56:25.463102 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:25.463674 (+   572us) log.cc:844] Serialized 356 byte log entry
0928 01:56:25.474328 (+ 10654us) op_driver.cc:464] REPLICATION: finished
0928 01:56:25.474691 (+   363us) write_op.cc:301] APPLY: starting
0928 01:56:25.474752 (+    61us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:25.474853 (+   101us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:25.474961 (+   108us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:25.475172 (+   211us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:25.475306 (+   134us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:25.475356 (+    50us) write_op.cc:312] APPLY: finished
0928 01:56:25.475541 (+   185us) log.cc:844] Serialized 23 byte log entry
0928 01:56:25.475698 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.475765 (+    67us) write_op.cc:454] Released schema lock
0928 01:56:25.475795 (+    30us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0928 01:56:26.063186 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:26.063727 (+   541us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:26.063758 (+    31us) write_op.cc:435] Acquired schema lock
0928 01:56:26.063778 (+    20us) tablet.cc:662] Decoding operations
0928 01:56:26.064097 (+   319us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:26.064146 (+    49us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:26.064188 (+    42us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:26.066123 (+  1935us) tablet.cc:701] Row locks acquired
0928 01:56:26.066139 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:56:26.066285 (+   146us) write_op.cc:270] Start()
0928 01:56:26.066394 (+   109us) write_op.cc:276] Timestamp: P: 1790560586066242 usec, L: 0
0928 01:56:26.066410 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:56:26.067022 (+   612us) log.cc:844] Serialized 356 byte log entry
0928 01:56:26.103054 (+ 36032us) op_driver.cc:464] REPLICATION: finished
0928 01:56:26.103432 (+   378us) write_op.cc:301] APPLY: starting
0928 01:56:26.103507 (+    75us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:26.103606 (+    99us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:26.103692 (+    86us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:26.103904 (+   212us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:26.104056 (+   152us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:26.104098 (+    42us) write_op.cc:312] APPLY: finished
0928 01:56:26.104311 (+   213us) log.cc:844] Serialized 23 byte log entry
0928 01:56:26.104470 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.104534 (+    64us) write_op.cc:454] Released schema lock
0928 01:56:26.104565 (+    31us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:26.104785 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.104807 (+    22us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":205516,"reported_tablets":97,"spinlock_wait_cycles":66913664,"child_traces":[["op",{"apply.queue_time_us":215,"apply.run_cpu_time_us":1626,"apply.run_wall_time_us":1626,"num_ops":3,"prepare.queue_time_us":132,"prepare.run_cpu_time_us":2719,"prepare.run_wall_time_us":2718,"raft.queue_time_us":1549,"raft.run_cpu_time_us":795,"raft.run_wall_time_us":796,"replication_time_us":17894}],["op",{"apply.queue_time_us":212,"apply.run_cpu_time_us":1295,"apply.run_wall_time_us":1295,"num_ops":1,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":2220,"prepare.run_wall_time_us":2221,"raft.queue_time_us":1318,"raft.run_cpu_time_us":801,"raft.run_wall_time_us":802,"replication_time_us":11113}],["op",{"apply.queue_time_us":217,"apply.run_cpu_time_us":1317,"apply.run_wall_time_us":1317,"num_ops":1,"prepare.queue_time_us":588,"prepare.run_cpu_time_us":2397,"prepare.run_wall_time_us":4082,"replication_time_us":36513}]]}
I20260928 01:56:26.636569 22378 raft_consensus.cc:2749] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:26.636831 22256 raft_consensus.cc:2749] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:26.638993 21909 raft_consensus.cc:2243] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 01:56:26.639174 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 92371.1us
W20260928 01:56:26.639892 19556 leader_election.cc:343] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 12c7284250084d6299cafe8310cfd257
I20260928 01:56:26.640861 19556 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.641597 22306 raft_consensus.cc:2804] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:26.642045 22306 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:26.642632 22361 raft_consensus.cc:3060] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:26.649736 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb014699060e4a6caf4caaf33c31710a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:26.650695 22306 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
W20260928 01:56:26.648471 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 120984us
I20260928 01:56:26.657898 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ae3663fbe024a4e946e47339a4b9090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:38 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:26.658488 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet e05925303152462e8ca25cd15f3bedff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:57616
W20260928 01:56:26.672618 19186 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 281) took 1653 ms (client timeout 1000 ms). Trace:
I20260928 01:56:26.639710 22385 leader_election.cc:290] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:26.674723 20029 tablet_bootstrap.cc:700] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent opening tablet: real 0.155s	user 0.000s	sys 0.003s
I20260928 01:56:26.675730 19605 raft_consensus.cc:2468] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
W20260928 01:56:26.485016 19191 rpcz_store.cc:269] 0928 01:56:24.610889 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:24.611085 (+   196us) service_pool.cc:224] Handling call
0928 01:56:26.484580 (+1873495us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:25.569199 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:25.569860 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:25.569891 (+    31us) write_op.cc:435] Acquired schema lock
0928 01:56:25.569904 (+    13us) tablet.cc:662] Decoding operations
0928 01:56:25.570278 (+   374us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:25.570325 (+    47us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:25.570356 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:56:25.570693 (+   337us) tablet.cc:701] Row locks acquired
0928 01:56:25.570712 (+    19us) write_op.cc:260] PREPARE: finished
0928 01:56:25.570850 (+   138us) write_op.cc:270] Start()
0928 01:56:25.570958 (+   108us) write_op.cc:276] Timestamp: P: 1790560585570797 usec, L: 0
0928 01:56:25.570976 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:25.571629 (+   653us) log.cc:844] Serialized 907 byte log entry
0928 01:56:25.597843 (+ 26214us) op_driver.cc:464] REPLICATION: finished
0928 01:56:25.598236 (+   393us) write_op.cc:301] APPLY: starting
0928 01:56:25.598296 (+    60us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:25.598420 (+   124us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:25.598530 (+   110us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:25.598808 (+   278us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:25.598968 (+   160us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:56:25.599012 (+    44us) write_op.cc:312] APPLY: finished
0928 01:56:25.599218 (+   206us) log.cc:844] Serialized 29 byte log entry
0928 01:56:25.599380 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.599586 (+   206us) write_op.cc:454] Released schema lock
0928 01:56:25.599626 (+    40us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:25.599885 (+   259us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.599908 (+    23us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:26.088982 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:26.090441 (+  1459us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:26.090473 (+    32us) write_op.cc:435] Acquired schema lock
0928 01:56:26.090489 (+    16us) tablet.cc:662] Decoding operations
0928 01:56:26.090807 (+   318us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:26.090847 (+    40us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:26.090915 (+    68us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:26.091092 (+   177us) tablet.cc:701] Row locks acquired
0928 01:56:26.091109 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:56:26.091241 (+   132us) write_op.cc:270] Start()
0928 01:56:26.091350 (+   109us) write_op.cc:276] Timestamp: P: 1790560586091201 usec, L: 0
0928 01:56:26.091369 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:26.091933 (+   564us) log.cc:844] Serialized 356 byte log entry
0928 01:56:26.173259 (+ 81326us) op_driver.cc:464] REPLICATION: finished
0928 01:56:26.173663 (+   404us) write_op.cc:301] APPLY: starting
0928 01:56:26.173721 (+    58us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:26.173836 (+   115us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:26.173940 (+   104us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:26.174130 (+   190us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:26.174259 (+   129us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:26.174301 (+    42us) write_op.cc:312] APPLY: finished
0928 01:56:26.174491 (+   190us) log.cc:844] Serialized 23 byte log entry
0928 01:56:26.174650 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.174714 (+    64us) write_op.cc:454] Released schema lock
0928 01:56:26.174747 (+    33us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:26.174979 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.175004 (+    25us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:26.178818 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:26.179299 (+   481us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:26.179332 (+    33us) write_op.cc:435] Acquired schema lock
0928 01:56:26.179350 (+    18us) tablet.cc:662] Decoding operations
0928 01:56:26.179661 (+   311us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:26.179711 (+    50us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:26.179741 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:26.180011 (+   270us) tablet.cc:701] Row locks acquired
0928 01:56:26.180025 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:56:26.180164 (+   139us) write_op.cc:270] Start()
0928 01:56:26.180285 (+   121us) write_op.cc:276] Timestamp: P: 1790560586180118 usec, L: 0
0928 01:56:26.180301 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:56:26.180915 (+   614us) log.cc:844] Serialized 356 byte log entry
0928 01:56:26.228853 (+ 47938us) op_driver.cc:464] REPLICATION: finished
0928 01:56:26.229185 (+   332us) write_op.cc:301] APPLY: starting
0928 01:56:26.229244 (+    59us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:26.229335 (+    91us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:26.229424 (+    89us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:26.229621 (+   197us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:26.229750 (+   129us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:26.229793 (+    43us) write_op.cc:312] APPLY: finished
0928 01:56:26.229981 (+   188us) log.cc:844] Serialized 23 byte log entry
0928 01:56:26.230131 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.230196 (+    65us) write_op.cc:454] Released schema lock
0928 01:56:26.230226 (+    30us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:26.230460 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.230489 (+    29us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:26.236305 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:26.236796 (+   491us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:26.236826 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:56:26.236841 (+    15us) tablet.cc:662] Decoding operations
0928 01:56:26.237268 (+   427us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:26.237315 (+    47us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:26.237342 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:26.237516 (+   174us) tablet.cc:701] Row locks acquired
0928 01:56:26.237542 (+    26us) write_op.cc:260] PREPARE: finished
0928 01:56:26.237678 (+   136us) write_op.cc:270] Start()
0928 01:56:26.237774 (+    96us) write_op.cc:276] Timestamp: P: 1790560586237628 usec, L: 0
0928 01:56:26.237794 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:56:26.238445 (+   651us) log.cc:844] Serialized 356 byte log entry
0928 01:56:26.261522 (+ 23077us) op_driver.cc:464] REPLICATION: finished
0928 01:56:26.264156 (+  2634us) write_op.cc:301] APPLY: starting
0928 01:56:26.264241 (+    85us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:26.264340 (+    99us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:26.264473 (+   133us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:26.264663 (+   190us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:26.264799 (+   136us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:26.264844 (+    45us) write_op.cc:312] APPLY: finished
0928 01:56:26.265037 (+   193us) log.cc:844] Serialized 23 byte log entry
0928 01:56:26.265188 (+   151us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.265281 (+    93us) write_op.cc:454] Released schema lock
0928 01:56:26.265313 (+    32us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:26.265558 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.265582 (+    24us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:26.269739 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:26.270236 (+   497us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:26.270271 (+    35us) write_op.cc:435] Acquired schema lock
0928 01:56:26.270293 (+    22us) tablet.cc:662] Decoding operations
0928 01:56:26.270629 (+   336us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:26.270680 (+    51us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:26.270706 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:26.270884 (+   178us) tablet.cc:701] Row locks acquired
0928 01:56:26.270898 (+    14us) write_op.cc:260] PREPARE: finished
0928 01:56:26.271040 (+   142us) write_op.cc:270] Start()
0928 01:56:26.271138 (+    98us) write_op.cc:276] Timestamp: P: 1790560586270986 usec, L: 0
0928 01:56:26.271158 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:56:26.271761 (+   603us) log.cc:844] Serialized 356 byte log entry
0928 01:56:26.281510 (+  9749us) op_driver.cc:464] REPLICATION: finished
0928 01:56:26.281958 (+   448us) write_op.cc:301] APPLY: starting
0928 01:56:26.282015 (+    57us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:26.282121 (+   106us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:26.282226 (+   105us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:26.282419 (+   193us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:26.282578 (+   159us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:26.282623 (+    45us) write_op.cc:312] APPLY: finished
0928 01:56:26.282833 (+   210us) log.cc:844] Serialized 23 byte log entry
0928 01:56:26.282991 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.283058 (+    67us) write_op.cc:454] Released schema lock
0928 01:56:26.283090 (+    32us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:26.283337 (+   247us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.283363 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35494,"reported_tablets":108,"child_traces":[["op",{"apply.queue_time_us":230,"apply.run_cpu_time_us":1614,"apply.run_wall_time_us":1613,"num_ops":2,"prepare.queue_time_us":3134,"prepare.run_cpu_time_us":2841,"prepare.run_wall_time_us":6260,"raft.queue_time_us":276,"raft.run_cpu_time_us":752,"raft.run_wall_time_us":754,"replication_time_us":26749}],["op",{"apply.queue_time_us":236,"apply.run_cpu_time_us":1296,"apply.run_wall_time_us":1296,"num_ops":1,"prepare.queue_time_us":144,"prepare.run_cpu_time_us":2313,"prepare.run_wall_time_us":4365,"replication_time_us":81782}],["op",{"apply.queue_time_us":195,"apply.run_cpu_time_us":1226,"apply.run_wall_time_us":1226,"num_ops":1,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":2325,"prepare.run_wall_time_us":3540,"replication_time_us":48434}],["op",{"apply.queue_time_us":2451,"apply.run_cpu_time_us":1373,"apply.run_wall_time_us":1373,"num_ops":1,"prepare.queue_time_us":426,"prepare.run_cpu_time_us":2229,"prepare.run_wall_time_us":3467,"replication_time_us":23625}],["op",{"apply.queue_time_us":285,"apply.run_cpu_time_us":1331,"apply.run_wall_time_us":1331,"num_ops":1,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":2400,"prepare.run_wall_time_us":2399,"raft.queue_time_us":734,"raft.run_cpu_time_us":11,"raft.run_wall_time_us":12,"replication_time_us":10243,"spinlock_wait_cycles":63232}]]}
I20260928 01:56:26.690187 22363 raft_consensus.cc:515] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:26.675275 19186 rpcz_store.cc:269] 0928 01:56:25.019573 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:25.020214 (+   641us) service_pool.cc:224] Handling call
0928 01:56:26.672537 (+1652323us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:26.040440 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:26.040910 (+   470us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:26.040939 (+    29us) write_op.cc:435] Acquired schema lock
0928 01:56:26.040954 (+    15us) tablet.cc:662] Decoding operations
0928 01:56:26.041302 (+   348us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:26.041350 (+    48us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:26.041375 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:56:26.041669 (+   294us) tablet.cc:701] Row locks acquired
0928 01:56:26.041685 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:56:26.041820 (+   135us) write_op.cc:270] Start()
0928 01:56:26.041935 (+   115us) write_op.cc:276] Timestamp: P: 1790560586041782 usec, L: 0
0928 01:56:26.041957 (+    22us) op_driver.cc:348] REPLICATION: starting
0928 01:56:26.042552 (+   595us) log.cc:844] Serialized 907 byte log entry
0928 01:56:26.071215 (+ 28663us) op_driver.cc:464] REPLICATION: finished
0928 01:56:26.071624 (+   409us) write_op.cc:301] APPLY: starting
0928 01:56:26.071687 (+    63us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:26.071816 (+   129us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:26.071918 (+   102us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:26.072267 (+   349us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:26.072409 (+   142us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:56:26.072454 (+    45us) write_op.cc:312] APPLY: finished
0928 01:56:26.072664 (+   210us) log.cc:844] Serialized 29 byte log entry
0928 01:56:26.072821 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.072892 (+    71us) write_op.cc:454] Released schema lock
0928 01:56:26.072929 (+    37us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:26.073173 (+   244us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:26.073196 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":329046,"reported_tablets":112,"child_traces":[["op",{"apply.queue_time_us":248,"apply.run_cpu_time_us":1518,"apply.run_wall_time_us":1517,"num_ops":2,"prepare.queue_time_us":757,"prepare.run_cpu_time_us":2439,"prepare.run_wall_time_us":2433,"raft.queue_time_us":1438,"raft.run_cpu_time_us":764,"raft.run_wall_time_us":768,"replication_time_us":29121}]]}
I20260928 01:56:26.696265 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 7daa1b799e0d408287edc03988f5b683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.698099 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:35 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.698834 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f with delete_type TABLET_DATA_DELETED (replaced by tablet 6546cfe6f3a6405fab41a4ebdcffb288) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.577049 22382 leader_election.cc:290] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:26.700232 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 with delete_type TABLET_DATA_DELETED (replaced by tablet e43bec2c4274497ea73872d0db233eac) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.698009 22273 raft_consensus.cc:493] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
W20260928 01:56:26.701690 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 137337us
I20260928 01:56:26.700044 22382 raft_consensus.cc:493] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:26.702845 19443 tablet_service.cc:1558] Processing DeleteTablet for tablet 7602706a3fbc438d8d448c9ac057087c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c6f4708c641414aa59f01703c86aaf1) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.703998 19445 tablet_service.cc:1558] Processing DeleteTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.724028 22382 raft_consensus.cc:515] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.704142 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73835e2854976b40b31fe752d1b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.704855 22273 raft_consensus.cc:515] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.705530 19446 tablet_service.cc:1558] Processing DeleteTablet for tablet 12c7284250084d6299cafe8310cfd257 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c395a6a87f4927b10973720aa4d868) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.706264 19441 tablet_service.cc:1558] Processing DeleteTablet for tablet 22fc9eff28c4436fb383c3d7169171bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.710707 22381 raft_consensus.cc:493] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:26.726287 22382 leader_election.cc:290] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:26.726652 22381 raft_consensus.cc:515] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.728775 22381 leader_election.cc:290] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:26.729079 22273 leader_election.cc:290] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:26.731385 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9690a224bb004152ba65d525cc10bd9f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:26.732064 19764 raft_consensus.cc:3060] T 9690a224bb004152ba65d525cc10bd9f P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:26.731483 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:26.732913 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:26.733774 19749 raft_consensus.cc:2393] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
W20260928 01:56:26.695957 19192 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 279) took 6202 ms (client timeout 1000 ms). Trace:
W20260928 01:56:26.706887 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7daa1b799e0d408287edc03988f5b683 because the tablet was not found. No further retry: Not found: Tablet not found: 7daa1b799e0d408287edc03988f5b683
I20260928 01:56:26.739372 21909 raft_consensus.cc:2272] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 01:56:26.739722 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 89e1d60db21f4a8294792df3fadf5d90 because the tablet was not found. No further retry: Not found: Tablet not found: 89e1d60db21f4a8294792df3fadf5d90
I20260928 01:56:26.642607 19556 leader_election.cc:304] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:26.740538 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet c320eb2ca2ac4ac68293ef8f7400b45f because the tablet was not found. No further retry: Not found: Tablet not found: c320eb2ca2ac4ac68293ef8f7400b45f
W20260928 01:56:26.740690 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 98154.2us
W20260928 01:56:26.741125 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet f709eccf4ab5413bbbd8b4746f185db4 because the tablet was not found. No further retry: Not found: Tablet not found: f709eccf4ab5413bbbd8b4746f185db4
I20260928 01:56:26.741118 22380 raft_consensus.cc:2749] T 2156dae74ee748cd845b6dea1d3b8ea8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:26.742738 19556 leader_election.cc:304] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.743016 22371 consensus_queue.cc:1048] T 12b836e20d6b43cba8eaa08887afb076 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:26.743785 19556 leader_election.cc:304] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:26.744172 19187 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 254) took 8926 ms (client timeout 1000 ms). Trace:
I20260928 01:56:26.745116 22371 raft_consensus.cc:2749] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:26.746268 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:26.745301 19187 rpcz_store.cc:269] 0928 01:56:17.805800 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:17.805917 (+   117us) service_pool.cc:224] Handling call
0928 01:56:26.732027 (+8926110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":266878,"reported_tablets":106}
I20260928 01:56:26.752349 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:26.753768 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b520e89c364692af1aedde2a59c3da" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:26.755784 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:26.757326 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:26.753046 19751 raft_consensus.cc:2468] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
W20260928 01:56:26.741644 19192 rpcz_store.cc:269] 0928 01:56:20.493738 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.493934 (+   196us) service_pool.cc:224] Handling call
0928 01:56:26.695858 (+6201924us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:23.426196 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:23.427186 (+   990us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:23.427380 (+   194us) write_op.cc:435] Acquired schema lock
0928 01:56:23.427516 (+   136us) tablet.cc:662] Decoding operations
0928 01:56:23.431172 (+  3656us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:23.431263 (+    91us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:23.431293 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0928 01:56:23.431960 (+   667us) tablet.cc:701] Row locks acquired
0928 01:56:23.431982 (+    22us) write_op.cc:260] PREPARE: finished
0928 01:56:23.432192 (+   210us) write_op.cc:270] Start()
0928 01:56:23.432378 (+   186us) write_op.cc:276] Timestamp: P: 1790560583432107 usec, L: 0
0928 01:56:23.432395 (+    17us) op_driver.cc:348] REPLICATION: starting
0928 01:56:23.433270 (+   875us) log.cc:844] Serialized 2039 byte log entry
0928 01:56:23.817085 (+383815us) op_driver.cc:464] REPLICATION: finished
0928 01:56:23.840544 (+ 23459us) write_op.cc:301] APPLY: starting
0928 01:56:23.840608 (+    64us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:23.840973 (+   365us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:23.841290 (+   317us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:23.842884 (+  1594us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:23.843328 (+   444us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0928 01:56:23.843397 (+    69us) write_op.cc:312] APPLY: finished
0928 01:56:23.843818 (+   421us) log.cc:844] Serialized 47 byte log entry
0928 01:56:23.866740 (+ 22922us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:23.866902 (+   162us) write_op.cc:454] Released schema lock
0928 01:56:23.866941 (+    39us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:23.931097 (+ 64156us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:23.931126 (+    29us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:23.891762 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:23.892551 (+   789us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:23.892580 (+    29us) write_op.cc:435] Acquired schema lock
0928 01:56:23.892593 (+    13us) tablet.cc:662] Decoding operations
0928 01:56:23.893007 (+   414us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:23.893057 (+    50us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:23.893085 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:23.893311 (+   226us) tablet.cc:701] Row locks acquired
0928 01:56:23.893330 (+    19us) write_op.cc:260] PREPARE: finished
0928 01:56:23.893500 (+   170us) write_op.cc:270] Start()
0928 01:56:23.893600 (+   100us) write_op.cc:276] Timestamp: P: 1790560583893421 usec, L: 0
0928 01:56:23.893673 (+    73us) op_driver.cc:348] REPLICATION: starting
0928 01:56:23.894558 (+   885us) log.cc:844] Serialized 356 byte log entry
0928 01:56:23.910517 (+ 15959us) op_driver.cc:464] REPLICATION: finished
0928 01:56:23.931724 (+ 21207us) write_op.cc:301] APPLY: starting
0928 01:56:23.931797 (+    73us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:23.931895 (+    98us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:23.932017 (+   122us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:23.932346 (+   329us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:23.932598 (+   252us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:23.932646 (+    48us) write_op.cc:312] APPLY: finished
0928 01:56:23.932855 (+   209us) log.cc:844] Serialized 23 byte log entry
0928 01:56:23.952100 (+ 19245us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:23.954311 (+  2211us) write_op.cc:454] Released schema lock
0928 01:56:23.954405 (+    94us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:23.955185 (+   780us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:23.955294 (+   109us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":197456,"reported_tablets":116,"child_traces":[["op",{"apply.queue_time_us":3107,"apply.run_cpu_time_us":4407,"apply.run_wall_time_us":90571,"num_ops":5,"prepare.queue_time_us":19841,"prepare.run_cpu_time_us":5436,"prepare.run_wall_time_us":27969,"raft.queue_time_us":112,"raft.run_cpu_time_us":1128,"raft.run_wall_time_us":1127,"replication_time_us":384547,"thread_start_us":32172,"threads_started":2}],["op",{"apply.queue_time_us":20953,"apply.run_cpu_time_us":2138,"apply.run_wall_time_us":23364,"num_ops":1,"prepare.queue_time_us":309,"prepare.run_cpu_time_us":3239,"prepare.run_wall_time_us":4992,"raft.queue_time_us":412,"raft.run_cpu_time_us":1063,"raft.run_wall_time_us":2353,"replication_time_us":16724,"thread_start_us":43341,"threads_started":1}]]}
I20260928 01:56:26.789546 21909 ts_tablet_manager.cc:1916] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:26.800385 22363 leader_election.cc:290] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:26.800266 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7441c2d1a7fa4dc8a89c6717a80d3efb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:26.803916 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 80252.3us
I20260928 01:56:26.805425 22390 consensus_queue.cc:1048] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:26.807690 19409 leader_election.cc:400] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Vote denied by peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) with higher term. Message: Invalid argument: T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:26.808147 19409 leader_election.cc:403] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260928 01:56:26.808935 22390 raft_consensus.cc:3060] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:26.823482 22361 raft_consensus.cc:2749] T 01cc307b127446958bd4199a1aa60adb P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:26.825626 19612 raft_consensus.cc:2468] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:26.829907 22389 raft_consensus.cc:493] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:26.830536 22389 raft_consensus.cc:515] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.833412 22389 leader_election.cc:290] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:26.834065 22389 raft_consensus.cc:493] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:26.834619 22389 raft_consensus.cc:515] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.836895 22389 leader_election.cc:290] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:26.839056 22389 raft_consensus.cc:493] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:26.839625 22389 raft_consensus.cc:515] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.842645 22389 leader_election.cc:290] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:26.819129 19179 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 78011.1us
W20260928 01:56:26.848621 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7602706a3fbc438d8d448c9ac057087c because the tablet was not found. No further retry: Not found: Tablet not found: 7602706a3fbc438d8d448c9ac057087c
W20260928 01:56:26.849277 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 22606f012f1c44bd92c8e0341e9ca2b7 because the tablet was not found. No further retry: Not found: Tablet not found: 22606f012f1c44bd92c8e0341e9ca2b7
I20260928 01:56:26.849334 22390 raft_consensus.cc:2749] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) with higher term. Message: Invalid argument: T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
W20260928 01:56:26.849843 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 49a73835e2854976b40b31fe752d1b1b because the tablet was not found. No further retry: Not found: Tablet not found: 49a73835e2854976b40b31fe752d1b1b
W20260928 01:56:26.850430 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 12c7284250084d6299cafe8310cfd257 because the tablet was not found. No further retry: Not found: Tablet not found: 12c7284250084d6299cafe8310cfd257
W20260928 01:56:26.850965 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 22fc9eff28c4436fb383c3d7169171bb because the tablet was not found. No further retry: Not found: Tablet not found: 22fc9eff28c4436fb383c3d7169171bb
W20260928 01:56:26.846027 19193 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:53391 (request call id 257) took 8914 ms (client timeout 1000 ms). Trace:
I20260928 01:56:26.856659 22363 raft_consensus.cc:2749] T a23b494afa1f45988d447519356d2b03 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:26.856801 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 113086us
I20260928 01:56:26.857626 19556 leader_election.cc:304] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.858608 22363 raft_consensus.cc:3060] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:26.858722 19556 leader_election.cc:343] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: f709eccf4ab5413bbbd8b4746f185db4
I20260928 01:56:26.869211 19556 leader_election.cc:304] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.842581 22306 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:26.873642 19441 tablet_service.cc:1558] Processing DeleteTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 with delete_type TABLET_DATA_DELETED (replaced by tablet e43bec2c4274497ea73872d0db233eac) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.873574 22213 raft_consensus.cc:2804] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:26.874142 22213 raft_consensus.cc:697] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:26.874424 19446 tablet_service.cc:1558] Processing DeleteTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f with delete_type TABLET_DATA_DELETED (replaced by tablet 6546cfe6f3a6405fab41a4ebdcffb288) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.875154 22213 consensus_queue.cc:237] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:26.881711 22306 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:26.885221 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 77720.6us
I20260928 01:56:26.886842 22390 consensus_queue.cc:1048] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:26.895697 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet 7602706a3fbc438d8d448c9ac057087c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c6f4708c641414aa59f01703c86aaf1) from {username='slave'} at 127.0.0.1:50444
W20260928 01:56:26.901158 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet f709eccf4ab5413bbbd8b4746f185db4 because the tablet was not found. No further retry: Not found: Tablet not found: f709eccf4ab5413bbbd8b4746f185db4
W20260928 01:56:26.902040 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet c320eb2ca2ac4ac68293ef8f7400b45f because the tablet was not found. No further retry: Not found: Tablet not found: c320eb2ca2ac4ac68293ef8f7400b45f
W20260928 01:56:26.853207 19193 rpcz_store.cc:269] 0928 01:56:17.931784 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:17.932326 (+   542us) service_pool.cc:224] Handling call
0928 01:56:17.970712 (+ 38386us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5400030554. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbb5c0 00007f2fcdc5a6fa 00007f2fcf9cbd8c 00007f2fcfaca01e 00007f2fcd66efb4 00007f2fcd66ef42 00007f2fcd66ee71 00007f2fcd66edec 00007f2fcd66e0a2 00007f2fcb92009c 00007f2fcb91f4d6
0928 01:56:26.845947 (+8875235us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:22.079014 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:22.079659 (+   645us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:22.079689 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:56:22.079706 (+    17us) tablet.cc:662] Decoding operations
0928 01:56:22.080005 (+   299us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:22.080068 (+    63us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:22.080099 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:22.080286 (+   187us) tablet.cc:701] Row locks acquired
0928 01:56:22.080302 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:56:22.080444 (+   142us) write_op.cc:270] Start()
0928 01:56:22.080541 (+    97us) write_op.cc:276] Timestamp: P: 1790560582080392 usec, L: 0
0928 01:56:22.080556 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:56:22.081243 (+   687us) log.cc:844] Serialized 356 byte log entry
0928 01:56:22.374315 (+293072us) op_driver.cc:464] REPLICATION: finished
0928 01:56:22.463602 (+ 89287us) write_op.cc:301] APPLY: starting
0928 01:56:22.463702 (+   100us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:22.463813 (+   111us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:22.463954 (+   141us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:22.464236 (+   282us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:22.464399 (+   163us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:22.464441 (+    42us) write_op.cc:312] APPLY: finished
0928 01:56:22.464766 (+   325us) log.cc:844] Serialized 23 byte log entry
0928 01:56:22.465548 (+   782us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:22.465615 (+    67us) write_op.cc:454] Released schema lock
0928 01:56:22.465660 (+    45us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0928 01:56:25.499100 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:25.499601 (+   501us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:25.499631 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:56:25.499648 (+    17us) tablet.cc:662] Decoding operations
0928 01:56:25.499980 (+   332us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:25.500035 (+    55us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:25.500062 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:25.500266 (+   204us) tablet.cc:701] Row locks acquired
0928 01:56:25.500281 (+    15us) write_op.cc:260] PREPARE: finished
0928 01:56:25.500425 (+   144us) write_op.cc:270] Start()
0928 01:56:25.500529 (+   104us) write_op.cc:276] Timestamp: P: 1790560585500352 usec, L: 0
0928 01:56:25.500545 (+    16us) op_driver.cc:348] REPLICATION: starting
0928 01:56:25.501186 (+   641us) log.cc:844] Serialized 356 byte log entry
0928 01:56:25.537501 (+ 36315us) op_driver.cc:464] REPLICATION: finished
0928 01:56:25.537826 (+   325us) write_op.cc:301] APPLY: starting
0928 01:56:25.537882 (+    56us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:25.537977 (+    95us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:25.538087 (+   110us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:25.538287 (+   200us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:25.538436 (+   149us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:25.538481 (+    45us) write_op.cc:312] APPLY: finished
0928 01:56:25.538657 (+   176us) log.cc:844] Serialized 23 byte log entry
0928 01:56:25.538801 (+   144us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.538865 (+    64us) write_op.cc:454] Released schema lock
0928 01:56:25.538897 (+    32us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:25.539116 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.539141 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":94026,"reported_tablets":115,"spinlock_wait_cycles":24690944,"child_traces":[["op",{"apply.queue_time_us":89026,"apply.run_cpu_time_us":1758,"apply.run_wall_time_us":2443,"num_ops":1,"prepare.queue_time_us":32908,"prepare.run_cpu_time_us":3201,"prepare.run_wall_time_us":76657,"raft.queue_time_us":4825,"raft.run_cpu_time_us":1291,"raft.run_wall_time_us":1291,"replication_time_us":293633,"thread_start_us":195280,"threads_started":3,"wal-append.queue_time_us":55734}],["op",{"apply.queue_time_us":179,"apply.run_cpu_time_us":1253,"apply.run_wall_time_us":1252,"num_ops":1,"prepare.queue_time_us":3090,"prepare.run_cpu_time_us":2525,"prepare.run_wall_time_us":28218,"raft.queue_time_us":105,"raft.run_cpu_time_us":855,"raft.run_wall_time_us":855,"replication_time_us":36823}]]}
W20260928 01:56:26.908757 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 7602706a3fbc438d8d448c9ac057087c because the tablet was not found. No further retry: Not found: Tablet not found: 7602706a3fbc438d8d448c9ac057087c
W20260928 01:56:26.870733 19556 consensus_peers.cc:597] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12c7284250084d6299cafe8310cfd257. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:26.895136 22179 ts_tablet_manager.cc:1929] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 01:56:26.912037 19556 leader_election.cc:343] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: e05925303152462e8ca25cd15f3bedff
I20260928 01:56:26.913702 19556 leader_election.cc:304] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:26.917999 19556 raft_consensus.cc:2686] T e05925303152462e8ca25cd15f3bedff P a3ee288ca1464d20a715673422a214a0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:26.912976 22179 log.cc:1199] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/8a5e07078b2a4fe59d9293d9511cbb6b
I20260928 01:56:26.921165 22389 raft_consensus.cc:493] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:26.921886 22389 raft_consensus.cc:515] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:26.923067 22179 ts_tablet_manager.cc:1950] T 8a5e07078b2a4fe59d9293d9511cbb6b P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:26.925168 22389 leader_election.cc:290] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:26.926163 22389 raft_consensus.cc:493] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:26.926705 22389 raft_consensus.cc:515] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.928252 22363 raft_consensus.cc:2749] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:26.929431 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73835e2854976b40b31fe752d1b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.929584 22389 leader_election.cc:290] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:26.931499 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 49a73835e2854976b40b31fe752d1b1b because the tablet was not found. No further retry: Not found: Tablet not found: 49a73835e2854976b40b31fe752d1b1b
I20260928 01:56:26.931962 22382 raft_consensus.cc:493] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:26.932632 22382 raft_consensus.cc:515] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.935312 22289 raft_consensus.cc:493] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:26.935950 22289 raft_consensus.cc:515] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:26.944128 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.943775 22382 leader_election.cc:290] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:26.945492 19522 heartbeater.cc:344] Connected to a master server at 127.18.161.61:43775
I20260928 01:56:26.946022 19522 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:26.954084 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet 12c7284250084d6299cafe8310cfd257 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c395a6a87f4927b10973720aa4d868) from {username='slave'} at 127.0.0.1:50444
W20260928 01:56:26.956547 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 22606f012f1c44bd92c8e0341e9ca2b7 because the tablet was not found. No further retry: Not found: Tablet not found: 22606f012f1c44bd92c8e0341e9ca2b7
W20260928 01:56:26.957420 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 12c7284250084d6299cafe8310cfd257 because the tablet was not found. No further retry: Not found: Tablet not found: 12c7284250084d6299cafe8310cfd257
I20260928 01:56:26.958930 19447 tablet_service.cc:1558] Processing DeleteTablet for tablet 22fc9eff28c4436fb383c3d7169171bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:26.949291 19612 raft_consensus.cc:1275] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:56:26.920501 19556 leader_election.cc:304] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:26.961141 19179 catalog_manager.cc:5030] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): delete failed for tablet 22fc9eff28c4436fb383c3d7169171bb because the tablet was not found. No further retry: Not found: Tablet not found: 22fc9eff28c4436fb383c3d7169171bb
I20260928 01:56:26.963019 22289 leader_election.cc:290] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:26.964406 22363 raft_consensus.cc:2749] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:26.967257 19184 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 255) took 7426 ms (client timeout 1000 ms). Trace:
I20260928 01:56:26.798250 19764 raft_consensus.cc:2468] T 9690a224bb004152ba65d525cc10bd9f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
W20260928 01:56:26.854075 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 199723us
I20260928 01:56:26.864980 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:26.867959 20029 tablet_bootstrap.cc:654] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:26.871788 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c755f16ea1496eb7fa26fb12e01708" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:26.906200 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:26.930370 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12bafcc09ef4342bff89b0475f721af" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:56:26.983796 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 63375.3us
I20260928 01:56:26.931846 19760 raft_consensus.cc:2468] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:26.985373 19556 leader_election.cc:304] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:26.986467 19556 leader_election.cc:343] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: f709eccf4ab5413bbbd8b4746f185db4
I20260928 01:56:26.986624 22380 raft_consensus.cc:2749] T 0669f9f51b05479aa9715e06d4c42423 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:26.989621 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 36) took 6236 ms. Trace:
I20260928 01:56:26.986871 19556 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.990017 22179 rpcz_store.cc:276] 0928 01:56:20.753536 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.753674 (+   138us) service_pool.cc:224] Handling call
0928 01:56:26.371853 (+5618179us) ts_tablet_manager.cc:1151] Deleting tablet 8a5e07078b2a4fe59d9293d9511cbb6b
0928 01:56:26.371902 (+    49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:26.422695 (+ 50793us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b54000c8120. stack: 00007fd5309ed323 00007fd5309ed220 00007fd530591574 0000000000516964 00000000005168f9 00007fd537aeaaa1 00007fd537af6f4d 00007fd537add6d4 00007fd537b5f977 00007fd537b89b45 00007fd537fca55c 00007fd538c33c3a 00007fd538c64960 00007fd538c4ae6d 00007fd538c4ae19 00007fd538c4ada9
0928 01:56:26.607434 (+184739us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:26.894990 (+287556us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:26.989542 (+ 94552us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1950,"spinlock_wait_cycles":108609792,"tablet-delete.queue_time_us":5617431}
I20260928 01:56:26.992417 22363 raft_consensus.cc:2749] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260928 01:56:26.992828 19556 leader_election.cc:304] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:26.993733 22179 tablet_replica.cc:333] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
W20260928 01:56:26.977916 19184 rpcz_store.cc:269] 0928 01:56:19.541364 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:19.541489 (+   125us) service_pool.cc:224] Handling call
0928 01:56:26.967166 (+7425677us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:25.738033 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:25.738534 (+   501us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:25.738562 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:56:25.738579 (+    17us) tablet.cc:662] Decoding operations
0928 01:56:25.738890 (+   311us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:25.738943 (+    53us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:25.738970 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:25.739154 (+   184us) tablet.cc:701] Row locks acquired
0928 01:56:25.739171 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:56:25.739310 (+   139us) write_op.cc:270] Start()
0928 01:56:25.739407 (+    97us) write_op.cc:276] Timestamp: P: 1790560585739244 usec, L: 0
0928 01:56:25.739427 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:56:25.739996 (+   569us) log.cc:844] Serialized 356 byte log entry
0928 01:56:25.827664 (+ 87668us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b18000896e0. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcf9e9b81 00007f2fcf9f6571 00007f2fce0de62d 00007f2fce0e092a 00007f2fce0e08b8 00007f2fce0e0838 00007f2fce0e07f3 00007f2fce0dfa0c 00007f2fcfa78db6 00007f2fcfa73568 00007f2fcdc5dad0
0928 01:56:25.827706 (+    42us) op_driver.cc:464] REPLICATION: finished
0928 01:56:25.827985 (+   279us) write_op.cc:301] APPLY: starting
0928 01:56:25.828042 (+    57us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:25.828158 (+   116us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:25.828178 (+    20us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:25.828482 (+   304us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:25.828619 (+   137us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:25.828668 (+    49us) write_op.cc:312] APPLY: finished
0928 01:56:25.828872 (+   204us) log.cc:844] Serialized 23 byte log entry
0928 01:56:25.829024 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.829093 (+    69us) write_op.cc:454] Released schema lock
0928 01:56:25.829126 (+    33us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:25.833886 (+  4760us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:25.833915 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":437958,"reported_tablets":104,"child_traces":[["op",{"apply.queue_time_us":103,"apply.run_cpu_time_us":1343,"apply.run_wall_time_us":1343,"num_ops":1,"prepare.queue_time_us":6509,"prepare.run_cpu_time_us":2220,"prepare.run_wall_time_us":2218,"replication_time_us":84900,"spinlock_wait_cycles":3062016}]]}
I20260928 01:56:26.994153 22363 raft_consensus.cc:2749] T 67be39a8cae04ff9ae99c2c3b02713cd P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:26.999841 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1ddfab489f4ace921d551c216039bd" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:27.000947 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:27.001435 19617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.001295 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:27.004799 19611 raft_consensus.cc:2410] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260928 01:56:27.006138 19617 raft_consensus.cc:2410] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260928 01:56:27.002210 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea6adefd15a4ea19011419949047e83" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:27.002648 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.007071 19614 raft_consensus.cc:2468] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:27.011065 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:27.012399 19621 raft_consensus.cc:3060] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:27.014031 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.016799 19611 raft_consensus.cc:1240] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:27.020466 19620 raft_consensus.cc:2468] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:27.022279 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.022861 19618 raft_consensus.cc:2468] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:27.024555 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:26.958204 19553 leader_election.cc:343] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:27.028414 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 70250.9us
I20260928 01:56:27.029302 19553 leader_election.cc:304] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:27.029431 19618 raft_consensus.cc:1240] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:27.030017 22363 raft_consensus.cc:2804] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:27.030524 22363 raft_consensus.cc:493] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:27.030997 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef752c3b4b22490ab42292f61278da52" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.031530 22363 raft_consensus.cc:3060] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:27.032908 19618 raft_consensus.cc:1240] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:27.027877 19614 raft_consensus.cc:2468] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:27.040593 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.045553 19614 raft_consensus.cc:2368] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:27.048264 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:27.049407 19607 raft_consensus.cc:2368] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:27.051481 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.052729 19605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:27.040535 19618 raft_consensus.cc:1275] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:27.052995 19620 raft_consensus.cc:1240] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 01:56:27.053838 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3505a502bff747deaf1e03c03375aafa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.056140 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.058295 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.060698 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.064291 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.066582 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:27.067713 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 83102.2us
I20260928 01:56:27.068154 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.068835 19615 raft_consensus.cc:2468] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:27.070230 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b795606604960bc7cafab4ff6f3d0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.044720 19621 raft_consensus.cc:2468] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:27.071887 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b222e5366a64f52bc97acd551c7a067" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.075153 19467 raft_consensus.cc:1275] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:27.073447 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.075800 19620 raft_consensus.cc:2468] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
W20260928 01:56:27.075968 19703 leader_election.cc:343] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: f709eccf4ab5413bbbd8b4746f185db4
I20260928 01:56:27.076380 19703 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:27.076889 19617 raft_consensus.cc:1275] T 0e1ddfab489f4ace921d551c216039bd P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:27.077122 22345 raft_consensus.cc:2749] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260928 01:56:27.078859 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab12ba3e1f542949e3f203dae0fa80e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.080353 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.081833 19467 raft_consensus.cc:2393] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:27.081141 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.085443 19467 raft_consensus.cc:1275] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260928 01:56:27.088397 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c74a4a00552c4a14a871a59465524f1c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.089347 19467 raft_consensus.cc:3060] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 3
I20260928 01:56:27.092489 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.099520 22218 raft_consensus.cc:493] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:27.100353 22218 raft_consensus.cc:515] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:27.105000 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1710b95678440b1bff8a92080d43272" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.106133 19458 raft_consensus.cc:2393] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:27.113569 22218 leader_election.cc:290] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:27.115993 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36076aa674b9401b9b76fbf066348d06" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.119172 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cacb4a90a54cd3b5b3e7a9310e06ed" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.122557 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3b9ec9f88342c0aa77c0fc92d26205" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.124536 19457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.129904 19472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d114d5ba862044b4b88eee27395db7e3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.131805 19472 raft_consensus.cc:3060] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:56:27.132339 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 103093us
I20260928 01:56:27.137924 22218 raft_consensus.cc:493] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:27.138550 22218 raft_consensus.cc:515] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.145982 19472 raft_consensus.cc:2468] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:27.151804 22179 raft_consensus.cc:2243] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:27.152518 22179 raft_consensus.cc:2272] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:27.154918 22179 ts_tablet_manager.cc:1916] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:27.149523 19457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.166976 19462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9690a224bb004152ba65d525cc10bd9f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.167560 19462 raft_consensus.cc:3060] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:27.150288 22218 leader_election.cc:290] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:27.153039 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.156507 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.161980 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7441c2d1a7fa4dc8a89c6717a80d3efb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.163686 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.177220 19474 raft_consensus.cc:2468] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:27.166368 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.179414 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.180310 19473 raft_consensus.cc:2393] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:27.181169 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.185160 19460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.186209 19605 raft_consensus.cc:3060] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:27.189150 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb014699060e4a6caf4caaf33c31710a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.165433 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
W20260928 01:56:27.212303 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 76505.3us
I20260928 01:56:27.216526 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 8a5e07078b2a4fe59d9293d9511cbb6b (table default.Table_deb7dc16f0794afd95d9f29bed3a5621 [id=0da09ac1dc794d82b6f9323d0196b4cc]) successfully deleted
I20260928 01:56:27.216852 20029 tablet_bootstrap.cc:492] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:27.217326 20029 ts_tablet_manager.cc:1403] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.840s	user 0.006s	sys 0.009s
I20260928 01:56:27.222014 19612 raft_consensus.cc:2468] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:27.226601 22218 raft_consensus.cc:493] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:27.227449 19462 raft_consensus.cc:2468] T 9690a224bb004152ba65d525cc10bd9f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:27.227289 22218 raft_consensus.cc:515] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.230893 22218 leader_election.cc:290] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:27.235420 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3505a502bff747deaf1e03c03375aafa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.251829 22179 ts_tablet_manager.cc:1929] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260928 01:56:27.252461 22179 log.cc:1199] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/7602706a3fbc438d8d448c9ac057087c
I20260928 01:56:27.253386 22179 ts_tablet_manager.cc:1950] T 7602706a3fbc438d8d448c9ac057087c P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:27.254593 19184 catalog_manager.cc:5838] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:27.255759 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 37) took 6491 ms. Trace:
I20260928 01:56:27.256138 22179 rpcz_store.cc:276] 0928 01:56:20.764656 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.764775 (+   119us) service_pool.cc:224] Handling call
0928 01:56:26.993546 (+6228771us) ts_tablet_manager.cc:1151] Deleting tablet 7602706a3fbc438d8d448c9ac057087c
0928 01:56:26.993604 (+    58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:27.204055 (+210451us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:27.251662 (+ 47607us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:27.255687 (+  4025us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147856,"tablet-delete.queue_time_us":6227983}
I20260928 01:56:27.257598 22179 tablet_replica.cc:333] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:27.258476 22179 raft_consensus.cc:2243] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:27.259074 22179 raft_consensus.cc:2272] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:27.261541 22179 ts_tablet_manager.cc:1916] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:27.270853 22213 raft_consensus.cc:493] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:27.271839 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 7602706a3fbc438d8d448c9ac057087c (table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]) successfully deleted
I20260928 01:56:27.271638 22213 raft_consensus.cc:515] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:27.275117 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 124520us
I20260928 01:56:27.276440 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.276906 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.278049 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b520e89c364692af1aedde2a59c3da" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.278785 19466 raft_consensus.cc:3060] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:27.279398 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c755f16ea1496eb7fa26fb12e01708" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.279901 19468 raft_consensus.cc:3060] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:27.259718 19184 catalog_manager.cc:5838] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:27.288504 19703 leader_election.cc:304] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:56:27.288846 19468 raft_consensus.cc:2468] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:27.288935 19467 raft_consensus.cc:2468] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
I20260928 01:56:27.292248 22213 leader_election.cc:290] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:27.293020 19411 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:27.293661 22228 raft_consensus.cc:2804] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:27.294407 22228 raft_consensus.cc:697] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:27.294411 22218 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:27.268627 22363 raft_consensus.cc:515] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:27.294849 22218 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:27.295889 22228 consensus_queue.cc:237] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:27.298321 22218 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:27.299108 22363 leader_election.cc:290] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:27.297209 19605 raft_consensus.cc:2468] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:27.314891 19184 catalog_manager.cc:5838] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:27.326623 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75303ee92aae436ea6c46747a23b69b6" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.332057 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.335250 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:27.336858 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.339190 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e927cd8a991f46278c2bb663cee7f753" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.340502 19760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:27.342036 19179 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.18.161.62:38511 timed out after 30.000s (SENT) [suppressed 3 similar messages]
I20260928 01:56:27.345808 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.346886 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12bafcc09ef4342bff89b0475f721af" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.347563 19468 raft_consensus.cc:3060] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:27.358260 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:27.377158 19459 raft_consensus.cc:2468] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:27.388949 22385 raft_consensus.cc:493] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:27.389557 22385 raft_consensus.cc:515] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.392807 22385 leader_election.cc:290] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:27.330297 19466 raft_consensus.cc:2468] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:27.400780 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ca0b52215454a99b6c5d1956088829a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:27.376837 20029 raft_consensus.cc:359] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:27.402746 22179 ts_tablet_manager.cc:1929] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:27.409271 22179 log.cc:1199] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/3c6cfc9ff3344a48b09730dfde79d6cf
I20260928 01:56:27.404804 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab12ba3e1f542949e3f203dae0fa80e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.416368 20029 raft_consensus.cc:385] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:27.421129 19744 tablet_service.cc:1558] Processing DeleteTablet for tablet e05925303152462e8ca25cd15f3bedff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:31 UTC) from {username='slave'} at 127.0.0.1:55034
W20260928 01:56:27.363993 19556 connection.cc:256] RPC call timeout handler was delayed by -1.6535411930000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1s for a response
I20260928 01:56:27.421861 19739 tablet_service.cc:1558] Processing DeleteTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:35 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:27.422501 19740 tablet_service.cc:1558] Processing DeleteTablet for tablet 7daa1b799e0d408287edc03988f5b683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:27.423102 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c6cfc9ff3344a48b09730dfde79d6cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:27.423815 19748 tablet_service.cc:1558] Processing DeleteTablet for tablet 22fc9eff28c4436fb383c3d7169171bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:27.424348 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.434854 22179 ts_tablet_manager.cc:1950] T 3c6cfc9ff3344a48b09730dfde79d6cf P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:27.439318 19412 leader_election.cc:304] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:27.440259 22218 raft_consensus.cc:2749] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.442821 19412 leader_election.cc:304] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:27.441644 22380 raft_consensus.cc:493] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:27.443887 22361 raft_consensus.cc:493] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:27.444098 22380 raft_consensus.cc:515] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:27.444659 22361 raft_consensus.cc:515] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.446672 22361 leader_election.cc:290] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:27.447234 22380 leader_election.cc:290] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:27.449115 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e095aba1cb4fb7be461d625a922751" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.451221 19761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.1:45657 (request call id 888) took 1050 ms. Trace:
I20260928 01:56:27.429023 20029 raft_consensus.cc:740] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:27.453732 20029 consensus_queue.cc:260] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:27.466499 19605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522245da435b40ae84ae6dc5d19a2e95" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.466967 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b836e20d6b43cba8eaa08887afb076" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.468541 19618 raft_consensus.cc:1275] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:27.468680 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.468739 22407 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:27.469551 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:27.469436 22407 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
W20260928 01:56:27.459182 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 141721us
I20260928 01:56:27.427597 21909 ts_tablet_manager.cc:1929] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 01:56:27.507223 19556 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
I20260928 01:56:27.507753 19556 leader_election.cc:304] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.508550 22363 raft_consensus.cc:2749] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.509735 19556 leader_election.cc:304] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.509661 22371 consensus_queue.cc:1048] T 502c0f4e07ff4479af8d33c99031b6fc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 01:56:27.448165 19468 raft_consensus.cc:2468] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:27.510929 19556 leader_election.cc:304] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.512656 22306 raft_consensus.cc:2749] T a1710b95678440b1bff8a92080d43272 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:56:27.515718 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 38) took 6747 ms. Trace:
I20260928 01:56:27.516072 22179 rpcz_store.cc:276] 0928 01:56:20.768771 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.768922 (+   151us) service_pool.cc:224] Handling call
0928 01:56:27.257425 (+6488503us) ts_tablet_manager.cc:1151] Deleting tablet 3c6cfc9ff3344a48b09730dfde79d6cf
0928 01:56:27.257481 (+    56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:27.270592 (+ 13111us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:27.402609 (+132017us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:27.515641 (+113032us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76912,"tablet-delete.queue_time_us":6487548}
I20260928 01:56:27.517298 22179 tablet_replica.cc:333] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:27.512043 22371 raft_consensus.cc:2749] T 043ddb5b0b0e4ad0b30d2927d37971fb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.519157 22380 consensus_queue.cc:1048] T 8b48eacc1cec49baabe2d87bdd06cd5c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:27.520327 19556 leader_election.cc:304] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.521220 22371 raft_consensus.cc:2749] T 36076aa674b9401b9b76fbf066348d06 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.521692 19556 leader_election.cc:304] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.522811 19556 leader_election.cc:304] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.523795 22363 raft_consensus.cc:2749] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.524530 22289 raft_consensus.cc:2749] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.522890 22380 raft_consensus.cc:2749] T b8cacb4a90a54cd3b5b3e7a9310e06ed P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:27.525563 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 82831.7us
I20260928 01:56:27.527195 19412 leader_election.cc:304] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.528448 22387 consensus_queue.cc:1059] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:27.529326 19412 leader_election.cc:304] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:27.529714 22387 raft_consensus.cc:2804] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:27.530177 22387 raft_consensus.cc:697] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 2 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:27.531096 22387 consensus_queue.cc:237] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:27.532873 22218 raft_consensus.cc:3055] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:27.532884 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 3c6cfc9ff3344a48b09730dfde79d6cf (table default.Table_919e392236f9437fb1c2f9fee1f94f84 [id=e8373f635df4445ca4acdbab7cdeb448]) successfully deleted
I20260928 01:56:27.533245 22218 raft_consensus.cc:740] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:27.534093 22218 consensus_queue.cc:260] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.535218 22218 raft_consensus.cc:3060] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:27.536703 22385 raft_consensus.cc:2749] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.536991 22407 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:27.538215 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 381 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:27.554574 22289 raft_consensus.cc:493] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:27.555251 22289 raft_consensus.cc:515] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.558295 22289 leader_election.cc:290] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:27.493588 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.563402 19758 raft_consensus.cc:2468] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:27.494640 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b795606604960bc7cafab4ff6f3d0" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.485790 20029 ts_tablet_manager.cc:1434] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.268s	user 0.008s	sys 0.000s
I20260928 01:56:27.567389 20029 tablet_bootstrap.cc:492] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:27.523877 19556 leader_election.cc:304] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.575706 22380 raft_consensus.cc:2749] T fa3b9ec9f88342c0aa77c0fc92d26205 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:27.577117 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 53304.9us
I20260928 01:56:27.451617 19761 rpcz_store.cc:276] 0928 01:56:26.400389 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:26.420905 (+ 20516us) service_pool.cc:224] Handling call
0928 01:56:26.421812 (+   907us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 01:56:27.055355 (+633543us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 01:56:27.055400 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 01:56:27.110917 (+ 55517us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b2c00004d28. stack: 00007f0a1a0f8323 00007f0a1a0f8220 00007f0a19c9c574 0000000000516964 00000000005168f9 00007f0a20498c91 00007f0a204a85f2 00007f0a212c81c1 00007f0a2128cbfa 00007f0a2128bffe 00007f0a222ec659 00007f0a20968d34 00007f0a20968cc2 00007f0a20968bf1 00007f0a20968b6c 00007f0a20967e22
0928 01:56:27.111502 (+   585us) log.cc:844] Serialized 26 byte log entry
0928 01:56:27.425442 (+313940us) raft_consensus.cc:1645] Marking committed up to 0
0928 01:56:27.425502 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:56:27.425579 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:56:27.450890 (+ 25311us) raft_consensus.cc:1685] finished
0928 01:56:27.450906 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:56:27.451137 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114725,"raft.queue_time_us":121533,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":207,"spinlock_wait_cycles":86622464,"thread_start_us":312149,"threads_started":1,"wal-append.queue_time_us":270040}
I20260928 01:56:27.536880 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b222e5366a64f52bc97acd551c7a067" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.549209 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.582670 19762 raft_consensus.cc:2468] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:27.504562 21909 log.cc:1199] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/8a5e07078b2a4fe59d9293d9511cbb6b
I20260928 01:56:27.584976 21909 ts_tablet_manager.cc:1950] T 8a5e07078b2a4fe59d9293d9511cbb6b P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:27.588110 22387 raft_consensus.cc:493] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:27.588378 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba]
I20260928 01:56:27.588996 22387 raft_consensus.cc:515] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.589744 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.592918 22387 leader_election.cc:290] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:27.593626 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5442dd0aa28545c8bcf3a0b977c71e98" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.599275 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619]
I20260928 01:56:27.605556 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e]
I20260928 01:56:27.611222 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]
I20260928 01:56:27.613755 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2]
I20260928 01:56:27.616745 19556 leader_election.cc:304] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.617066 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85]
I20260928 01:56:27.617928 19556 leader_election.cc:304] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.619553 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]
I20260928 01:56:27.622910 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca]
I20260928 01:56:27.628677 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae]
I20260928 01:56:27.629634 22213 raft_consensus.cc:2749] T fb159b3aad31479f80683b0d80549cc3 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:27.630987 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]
I20260928 01:56:27.634462 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9]
I20260928 01:56:27.636749 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa]
I20260928 01:56:27.636555 22380 raft_consensus.cc:2749] T 7441c2d1a7fa4dc8a89c6717a80d3efb P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.641189 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_a82317fb7790483884cbb5ebcf554128 [id=292d90fe578e4470bced0890a4e646ef]
I20260928 01:56:27.637749 19556 leader_election.cc:304] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.644274 19556 leader_election.cc:304] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.644903 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]
I20260928 01:56:27.645552 19556 leader_election.cc:304] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.645561 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.646273 22371 raft_consensus.cc:2749] T eb014699060e4a6caf4caaf33c31710a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.646662 19556 leader_election.cc:304] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.646893 22371 raft_consensus.cc:2749] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.647557 22371 raft_consensus.cc:2749] T 8df69eb3a37445ed8a2be0ef3bf32cdb P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.648520 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]
I20260928 01:56:27.648699 19468 raft_consensus.cc:2468] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:27.648133 22371 raft_consensus.cc:2749] T 15f48cf74a1b4600b5140bf9cc8446e3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.650589 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a]
I20260928 01:56:27.652850 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305]
I20260928 01:56:27.656072 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75]
I20260928 01:56:27.658349 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3]
I20260928 01:56:27.659860 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]
I20260928 01:56:27.661266 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921]
I20260928 01:56:27.661973 19704 leader_election.cc:304] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:27.663348 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375]
I20260928 01:56:27.663246 22228 raft_consensus.cc:2804] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:27.663967 22228 raft_consensus.cc:493] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:27.664494 22228 raft_consensus.cc:3060] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:27.666199 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]
I20260928 01:56:27.667724 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]
I20260928 01:56:27.670382 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]
I20260928 01:56:27.672092 22416 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:27.673122 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a]
I20260928 01:56:27.672878 22416 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:27.673906 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.675406 19468 raft_consensus.cc:2393] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:27.675467 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]
I20260928 01:56:27.648043 19556 leader_election.cc:304] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.677816 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]
I20260928 01:56:27.678052 19556 leader_election.cc:304] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:27.679023 22380 raft_consensus.cc:2804] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:27.680238 22380 raft_consensus.cc:697] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:27.681402 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513]
I20260928 01:56:27.681901 22380 consensus_queue.cc:237] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:27.684659 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]
I20260928 01:56:27.677405 22213 raft_consensus.cc:2749] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.686618 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd]
I20260928 01:56:27.688023 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]
I20260928 01:56:27.694561 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]
I20260928 01:56:27.695402 19556 leader_election.cc:304] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:27.697633 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a]
I20260928 01:56:27.698916 22363 raft_consensus.cc:2804] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:27.699709 22363 raft_consensus.cc:697] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:27.701751 22363 consensus_queue.cc:237] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:27.710424 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 179697us
I20260928 01:56:27.711586 22218 consensus_queue.cc:1059] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:27.711720 19412 leader_election.cc:304] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:27.714192 22387 raft_consensus.cc:3055] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:27.714847 22387 raft_consensus.cc:740] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:27.715991 22218 raft_consensus.cc:2749] T ef752c3b4b22490ab42292f61278da52 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:27.720501 22289 consensus_queue.cc:1059] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:27.723294 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]
I20260928 01:56:27.724180 22380 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:27.724879 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4]
I20260928 01:56:27.724831 22385 consensus_queue.cc:1048] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:27.724692 22380 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:27.732587 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 70718.8us
I20260928 01:56:27.744179 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]
I20260928 01:56:27.746567 22420 raft_consensus.cc:493] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:27.747093 22420 raft_consensus.cc:515] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.761765 19553 leader_election.cc:304] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:27.762562 22420 leader_election.cc:290] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:27.764034 19553 leader_election.cc:343] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:27.764909 19553 leader_election.cc:343] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:27.765540 19553 leader_election.cc:304] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614
I20260928 01:56:27.776129 22371 raft_consensus.cc:2804] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:27.777124 22371 raft_consensus.cc:697] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:27.781102 22387 consensus_queue.cc:260] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.782994 22387 raft_consensus.cc:3060] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:27.784467 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b]
I20260928 01:56:27.787102 22289 raft_consensus.cc:493] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:27.787837 22289 raft_consensus.cc:515] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.676054 22416 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:27.799219 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]
I20260928 01:56:27.798552 22371 consensus_queue.cc:237] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.801322 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2597de2c4304074977db5a3c0426814" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:27.802074 19468 raft_consensus.cc:3060] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:27.771972 22306 raft_consensus.cc:2749] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:27.787744 22218 raft_consensus.cc:3055] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:27.809026 22218 raft_consensus.cc:740] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:27.810557 22218 consensus_queue.cc:260] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.825809 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]
I20260928 01:56:27.827494 22289 leader_election.cc:290] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:27.839715 22218 raft_consensus.cc:3060] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:27.857442 22380 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:27.862605 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]
I20260928 01:56:27.862836 19468 raft_consensus.cc:2468] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:27.739676 19766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522245da435b40ae84ae6dc5d19a2e95" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.741562 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 30) took 13992 ms. Trace:
I20260928 01:56:27.864166 21909 rpcz_store.cc:276] 0928 01:56:13.749102 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.749204 (+   102us) service_pool.cc:224] Handling call
0928 01:56:25.973965 (+12224761us) ts_tablet_manager.cc:1151] Deleting tablet 8a5e07078b2a4fe59d9293d9511cbb6b
0928 01:56:25.974032 (+    67us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:27.026709 (+1052677us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:27.427433 (+400724us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:27.741502 (+314069us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":759997,"tablet-delete.queue_time_us":12224141}
I20260928 01:56:27.865602 21909 tablet_replica.cc:333] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:27.866937 19704 leader_election.cc:304] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:27.867823 22361 raft_consensus.cc:2749] T eb014699060e4a6caf4caaf33c31710a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:27.744307 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.751559 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b836e20d6b43cba8eaa08887afb076" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.756603 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376b5a87b07b4f87a2a502b5fa1b23f8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.759423 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.761099 19760 raft_consensus.cc:1275] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:27.775460 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.777897 20029 tablet_bootstrap.cc:654] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:27.813853 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.821946 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.852177 22345 raft_consensus.cc:493] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:27.886149 22345 raft_consensus.cc:515] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:27.889501 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:27.890451 19758 raft_consensus.cc:3060] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:27.893882 19764 raft_consensus.cc:1275] T c74a4a00552c4a14a871a59465524f1c P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:27.892055 22345 leader_election.cc:290] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:27.908464 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233]
I20260928 01:56:27.911238 21909 raft_consensus.cc:2243] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Raft consensus shutting down.
I20260928 01:56:27.912176 21909 pending_rounds.cc:70] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da: Trying to abort 1 pending ops.
I20260928 01:56:27.912503 21909 pending_rounds.cc:77] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7334136161605828608 op_type: NO_OP noop_request { }
I20260928 01:56:27.912871 21909 raft_consensus.cc:2889] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:56:27.913635 21909 raft_consensus.cc:2272] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:27.915957 19758 raft_consensus.cc:2468] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
I20260928 01:56:27.919595 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bec2c4274497ea73872d0db233eac" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:27.921919 21909 ts_tablet_manager.cc:1916] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:27.945955 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e]
I20260928 01:56:27.954964 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765]
I20260928 01:56:27.963949 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7]
I20260928 01:56:27.977963 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb]
W20260928 01:56:27.980577 19184 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 259) took 933 ms (client timeout 1000 ms). Trace:
W20260928 01:56:27.980960 19184 rpcz_store.cc:269] 0928 01:56:27.046944 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:27.047103 (+   159us) service_pool.cc:224] Handling call
0928 01:56:27.980486 (+933383us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:27.409523 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:27.410216 (+   693us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:27.410246 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:56:27.410266 (+    20us) tablet.cc:662] Decoding operations
0928 01:56:27.410780 (+   514us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:27.410840 (+    60us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:27.410873 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0928 01:56:27.411164 (+   291us) tablet.cc:701] Row locks acquired
0928 01:56:27.411180 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:56:27.411321 (+   141us) write_op.cc:270] Start()
0928 01:56:27.411418 (+    97us) write_op.cc:276] Timestamp: P: 1790560587411261 usec, L: 0
0928 01:56:27.411437 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:27.441267 (+ 29830us) log.cc:844] Serialized 1284 byte log entry
0928 01:56:27.518436 (+ 77169us) op_driver.cc:464] REPLICATION: finished
0928 01:56:27.608790 (+ 90354us) write_op.cc:301] APPLY: starting
0928 01:56:27.608861 (+    71us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:27.609010 (+   149us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:27.609141 (+   131us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:27.609874 (+   733us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:27.610065 (+   191us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0928 01:56:27.610116 (+    51us) write_op.cc:312] APPLY: finished
0928 01:56:27.610346 (+   230us) log.cc:844] Serialized 35 byte log entry
0928 01:56:27.611089 (+   743us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:27.611174 (+    85us) write_op.cc:454] Released schema lock
0928 01:56:27.611215 (+    41us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:27.693972 (+ 82757us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:27.694075 (+   103us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33456,"reported_tablets":97,"child_traces":[["op",{"apply.queue_time_us":90114,"apply.run_cpu_time_us":1945,"apply.run_wall_time_us":85148,"num_ops":3,"prepare.queue_time_us":11119,"prepare.run_cpu_time_us":3950,"prepare.run_wall_time_us":40788,"raft.queue_time_us":4919,"raft.run_cpu_time_us":847,"raft.run_wall_time_us":5778,"replication_time_us":106854,"thread_start_us":33938,"threads_started":3}]]}
I20260928 01:56:27.986229 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f]
W20260928 01:56:27.991063 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 124215us
I20260928 01:56:27.991643 21909 ts_tablet_manager.cc:1929] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.2
I20260928 01:56:27.993566 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b]
I20260928 01:56:27.997833 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b]
I20260928 01:56:27.998507 21909 log.cc:1199] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/22606f012f1c44bd92c8e0341e9ca2b7
I20260928 01:56:28.009714 21909 ts_tablet_manager.cc:1950] T 22606f012f1c44bd92c8e0341e9ca2b7 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
W20260928 01:56:28.022459 20456 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.549s (SENT) [suppressed 1 similar messages]
I20260928 01:56:27.868947 22289 consensus_queue.cc:1048] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260928 01:56:27.941207 19469 raft_consensus.cc:1275] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260928 01:56:28.050874 19469 pending_rounds.cc:85] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614: Aborting all ops after (but not including) 0
I20260928 01:56:28.051193 19469 pending_rounds.cc:107] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260928 01:56:28.051465 19469 raft_consensus.cc:2889] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 01:56:27.944669 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:27.953837 19467 raft_consensus.cc:2468] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
W20260928 01:56:27.956403 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 234806us
W20260928 01:56:28.037309 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 171539us
I20260928 01:56:28.053655 19409 leader_election.cc:304] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:28.068755 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 34) took 14144 ms. Trace:
I20260928 01:56:28.069132 21909 rpcz_store.cc:276] 0928 01:56:13.924978 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.925237 (+   259us) service_pool.cc:224] Handling call
0928 01:56:27.865414 (+13940177us) ts_tablet_manager.cc:1151] Deleting tablet 22606f012f1c44bd92c8e0341e9ca2b7
0928 01:56:27.865479 (+    65us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:27.957237 (+ 91758us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:27.991514 (+ 34277us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:28.068684 (+ 77170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44726,"tablet-delete.queue_time_us":13939001}
I20260928 01:56:28.075100 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.077227 21909 tablet_replica.cc:333] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:28.077867 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.080587 21909 raft_consensus.cc:2243] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Raft consensus shutting down.
I20260928 01:56:28.082533 21909 raft_consensus.cc:2272] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:28.104297 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]
I20260928 01:56:28.106433 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]
I20260928 01:56:28.106912 21909 ts_tablet_manager.cc:1916] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:28.108255 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]
I20260928 01:56:28.111182 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]
I20260928 01:56:28.115854 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d]
I20260928 01:56:28.122315 22179 raft_consensus.cc:2243] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:28.123898 22179 raft_consensus.cc:2272] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:28.127381 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151]
I20260928 01:56:28.127795 22179 ts_tablet_manager.cc:1916] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:28.136929 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 83312.4us
I20260928 01:56:28.137578 22289 raft_consensus.cc:2804] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260928 01:56:28.138129 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 84565.7us
I20260928 01:56:28.138401 19412 leader_election.cc:400] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) with higher term. Message: Invalid argument: T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:28.137883 22218 consensus_queue.cc:1048] T eb014699060e4a6caf4caaf33c31710a P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:28.137972 22289 raft_consensus.cc:493] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:28.139597 22289 raft_consensus.cc:3060] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:28.139693 19412 leader_election.cc:400] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Vote denied by peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) with higher term. Message: Invalid argument: T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:28.141095 19412 leader_election.cc:304] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.141878 22218 raft_consensus.cc:2749] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:28.145859 19409 leader_election.cc:304] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:28.149595 22421 raft_consensus.cc:2804] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:28.150053 22421 raft_consensus.cc:493] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:28.150386 22421 raft_consensus.cc:3060] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:28.149286 22431 consensus_queue.cc:1048] T 81c205176cb94d9f861cc140560944d4 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260928 01:56:28.157759 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87]
I20260928 01:56:28.159451 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e]
I20260928 01:56:28.160888 22421 raft_consensus.cc:515] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.163096 22421 leader_election.cc:290] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:28.149528 19412 leader_election.cc:304] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.164464 19412 leader_election.cc:304] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.165612 19412 leader_election.cc:304] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.166301 22416 raft_consensus.cc:2749] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:28.167016 22416 raft_consensus.cc:2749] T e2d1238d0a2d45c0a708442fd0b17291 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:28.167929 22416 raft_consensus.cc:2749] T 75303ee92aae436ea6c46747a23b69b6 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:28.168807 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1]
I20260928 01:56:28.169620 19412 leader_election.cc:304] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.170353 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542]
I20260928 01:56:28.170918 22429 raft_consensus.cc:2749] T e927cd8a991f46278c2bb663cee7f753 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:28.173804 22429 consensus_queue.cc:1048] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:28.176891 19412 leader_election.cc:304] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.178786 22387 raft_consensus.cc:2749] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:56:28.202000 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93]
W20260928 01:56:28.201895 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 436239us
I20260928 01:56:28.203835 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]
I20260928 01:56:28.205446 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f]
I20260928 01:56:28.207877 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]
I20260928 01:56:28.202946 19412 leader_election.cc:304] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.214289 19412 leader_election.cc:304] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.222592 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:28.223273 19763 raft_consensus.cc:3060] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:28.229514 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55]
I20260928 01:56:28.232638 22435 raft_consensus.cc:493] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:28.233208 22435 raft_consensus.cc:515] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.235435 22435 leader_election.cc:290] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:28.237633 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]
I20260928 01:56:28.239185 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]
I20260928 01:56:28.241423 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9]
I20260928 01:56:28.250308 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975]
I20260928 01:56:28.251905 20029 tablet_bootstrap.cc:492] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:28.252493 20029 ts_tablet_manager.cc:1403] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.685s	user 0.023s	sys 0.006s
I20260928 01:56:28.255229 20029 raft_consensus.cc:359] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.256645 20029 raft_consensus.cc:385] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:28.257011 20029 raft_consensus.cc:740] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:28.257858 20029 consensus_queue.cc:260] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.260560 20029 ts_tablet_manager.cc:1434] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260928 01:56:28.261466 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f]
I20260928 01:56:28.261716 20029 tablet_bootstrap.cc:492] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:28.262974 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6]
I20260928 01:56:28.274286 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37]
I20260928 01:56:28.276575 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749]
I20260928 01:56:28.276790 20029 tablet_bootstrap.cc:654] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:28.277992 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4]
W20260928 01:56:28.281299 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 67081.5us
I20260928 01:56:28.282522 19412 leader_election.cc:304] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.283171 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417]
I20260928 01:56:28.285514 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]
I20260928 01:56:28.293533 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7]
I20260928 01:56:27.990104 22228 raft_consensus.cc:515] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.231890 19763 raft_consensus.cc:2468] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:28.298009 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]
I20260928 01:56:28.298543 22416 raft_consensus.cc:2749] T a01b795606604960bc7cafab4ff6f3d0 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:28.306176 22416 consensus_queue.cc:1048] T 0e1ddfab489f4ace921d551c216039bd P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:28.298398 22420 raft_consensus.cc:2749] T 0b222e5366a64f52bc97acd551c7a067 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:28.177878 22289 raft_consensus.cc:515] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.312861 22289 leader_election.cc:290] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:28.293279 22387 raft_consensus.cc:2749] T 22e095aba1cb4fb7be461d625a922751 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260928 01:56:28.294821 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 302927us
I20260928 01:56:28.341486 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]
I20260928 01:56:28.342975 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5]
I20260928 01:56:28.344427 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d]
I20260928 01:56:28.353466 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619]
I20260928 01:56:28.357788 22447 raft_consensus.cc:493] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.358650 22447 raft_consensus.cc:515] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.360025 22387 raft_consensus.cc:493] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.360642 22387 raft_consensus.cc:515] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.361953 22289 raft_consensus.cc:493] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
W20260928 01:56:28.362250 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 78046.5us
I20260928 01:56:28.364486 22228 leader_election.cc:290] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:28.389847 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]
I20260928 01:56:28.322328 22436 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:28.366225 22420 raft_consensus.cc:493] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.396695 19412 leader_election.cc:304] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.396854 22420 raft_consensus.cc:515] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.368508 22431 raft_consensus.cc:493] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.402120 22436 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:28.400077 22385 raft_consensus.cc:2749] T bab12ba3e1f542949e3f203dae0fa80e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:28.361174 22447 leader_election.cc:290] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:28.396164 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]
I20260928 01:56:28.409171 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d]
I20260928 01:56:28.415934 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b]
I20260928 01:56:28.418067 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]
I20260928 01:56:28.362485 22289 raft_consensus.cc:515] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.419504 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]
I20260928 01:56:28.420317 22289 leader_election.cc:290] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:28.420917 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2]
I20260928 01:56:28.422260 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87]
I20260928 01:56:28.424983 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02]
I20260928 01:56:28.426975 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14]
I20260928 01:56:28.427421 22385 raft_consensus.cc:493] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.428385 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]
I20260928 01:56:28.428061 22385 raft_consensus.cc:515] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.430477 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]
I20260928 01:56:28.401062 22420 leader_election.cc:290] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:28.440681 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 87086.7us
I20260928 01:56:28.441282 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b]
I20260928 01:56:28.441859 19704 leader_election.cc:304] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:28.442680 19704 leader_election.cc:304] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:28.443578 22361 raft_consensus.cc:2764] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260928 01:56:28.444170 22361 raft_consensus.cc:2804] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:28.444504 22361 raft_consensus.cc:493] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:28.444823 22361 raft_consensus.cc:3060] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:28.445766 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]
I20260928 01:56:28.446986 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb]
I20260928 01:56:28.454916 22361 raft_consensus.cc:515] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:28.457755 21271 catalog_manager.cc:692] Loaded metadata for table default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320]
I20260928 01:56:28.459429 22361 leader_election.cc:290] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:28.397977 19412 leader_election.cc:304] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.481205 20545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:28.494310 22371 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.494939 22371 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:28.495678 20029 tablet_bootstrap.cc:492] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:28.496134 20029 ts_tablet_manager.cc:1403] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.235s	user 0.010s	sys 0.000s
I20260928 01:56:28.500396 22371 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:28.503494 21271 tablet_loader.cc:96] loaded metadata for tablet 01cc307b127446958bd4199a1aa60adb (table default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375])
I20260928 01:56:28.398952 22431 raft_consensus.cc:515] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.508776 21271 tablet_loader.cc:96] loaded metadata for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6])
I20260928 01:56:28.511669 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:28.512437 19764 raft_consensus.cc:3060] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:28.516543 22306 raft_consensus.cc:493] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.517289 22306 raft_consensus.cc:515] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.517943 22363 raft_consensus.cc:493] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.518497 22363 raft_consensus.cc:515] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.519747 22306 leader_election.cc:290] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:28.520272 22306 raft_consensus.cc:493] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.520794 22306 raft_consensus.cc:515] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.521215 22363 leader_election.cc:290] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:28.522907 22306 leader_election.cc:290] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:28.527519 22436 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
W20260928 01:56:28.534356 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 331224us
I20260928 01:56:28.430171 22385 leader_election.cc:290] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:28.538470 21271 tablet_loader.cc:96] loaded metadata for tablet 043ddb5b0b0e4ad0b30d2927d37971fb (table default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9])
I20260928 01:56:28.430914 22416 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.543112 22431 leader_election.cc:290] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:28.365772 22387 leader_election.cc:290] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:28.544229 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 97296.2us
I20260928 01:56:28.430752 22447 raft_consensus.cc:493] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.540642 22289 raft_consensus.cc:2749] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:28.530579 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:28.546208 19467 raft_consensus.cc:2468] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:28.545145 22447 raft_consensus.cc:515] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.549398 22447 leader_election.cc:290] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:28.556685 21271 tablet_loader.cc:96] loaded metadata for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6])
I20260928 01:56:28.550087 22361 consensus_queue.cc:1048] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260928 01:56:28.563058 21271 tablet_loader.cc:96] loaded metadata for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7])
I20260928 01:56:28.563632 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.565552 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6b59144fe14daab98b0965c7f8af02" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.570080 21271 tablet_loader.cc:96] loaded metadata for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0])
I20260928 01:56:28.573288 21271 tablet_loader.cc:96] loaded metadata for tablet 0e1ddfab489f4ace921d551c216039bd (table default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f])
I20260928 01:56:28.543365 22416 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.578372 22416 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:28.472672 22448 raft_consensus.cc:493] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.579109 22448 raft_consensus.cc:515] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.580655 21271 tablet_loader.cc:96] loaded metadata for tablet 10fa56df34ad44d88f1dd700c823d57c (table default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7])
W20260928 01:56:28.540194 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 142287us
I20260928 01:56:28.592693 22447 raft_consensus.cc:493] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.593289 22447 raft_consensus.cc:515] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:28.595439 22447 leader_election.cc:290] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:28.596141 20456 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511): Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.549s (SENT)
I20260928 01:56:28.596608 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:28.597093 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 342 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:28.597970 22447 raft_consensus.cc:493] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.598557 22447 raft_consensus.cc:515] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.600958 22447 leader_election.cc:290] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:28.599701 19102 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:56:28.606981 21271 tablet_loader.cc:96] loaded metadata for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117])
I20260928 01:56:28.610881 21271 tablet_loader.cc:96] loaded metadata for tablet 12b836e20d6b43cba8eaa08887afb076 (table default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4])
I20260928 01:56:28.618929 21271 tablet_loader.cc:96] loaded metadata for tablet 13c395a6a87f4927b10973720aa4d868 (table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92])
I20260928 01:56:28.626437 22458 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:28.613406 22436 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:28.629936 21271 tablet_loader.cc:96] loaded metadata for tablet 1555e557370a4e92915a9c55107b573b (table default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6])
I20260928 01:56:28.593135 19412 leader_election.cc:304] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:28.635330 22447 raft_consensus.cc:2804] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:28.635888 22447 raft_consensus.cc:697] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:28.636736 22447 consensus_queue.cc:237] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.644302 21271 tablet_loader.cc:96] loaded metadata for tablet 15f48cf74a1b4600b5140bf9cc8446e3 (table default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2])
I20260928 01:56:28.645751 21271 tablet_loader.cc:96] loaded metadata for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b])
I20260928 01:56:28.648626 22455 raft_consensus.cc:493] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.649219 22455 raft_consensus.cc:515] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.651396 22455 leader_election.cc:290] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:28.652884 21271 tablet_loader.cc:96] loaded metadata for tablet 202f1ead822548a2bbeae4e4d3cf9be8 (table default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975])
I20260928 01:56:28.652999 22448 leader_election.cc:290] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:28.657567 22425 raft_consensus.cc:493] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.657768 21271 tablet_loader.cc:96] loaded metadata for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d])
I20260928 01:56:28.504854 20029 raft_consensus.cc:359] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.657555 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:28.662770 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:28.671069 21271 tablet_loader.cc:96] loaded metadata for tablet 21906a8380e64d95b9454a57fc01c6f0 (table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a])
I20260928 01:56:28.674237 21271 tablet_loader.cc:96] loaded metadata for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d])
I20260928 01:56:28.676460 21271 tablet_loader.cc:96] loaded metadata for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5])
I20260928 01:56:28.663271 19467 raft_consensus.cc:1275] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260928 01:56:28.660112 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 67099.6us
I20260928 01:56:28.681638 19412 leader_election.cc:304] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.688118 22289 raft_consensus.cc:493] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.688863 22289 raft_consensus.cc:515] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:28.690296 21271 tablet_loader.cc:96] loaded metadata for tablet 27a232fc915a46c1a833ec5f6721eece (table default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417])
I20260928 01:56:28.691053 22289 leader_election.cc:290] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:28.702081 21271 tablet_loader.cc:96] loaded metadata for tablet 29f65b0966c04012bfec3c67a37acc25 (table default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e])
I20260928 01:56:28.703423 21271 tablet_loader.cc:96] loaded metadata for tablet 2c007b068b1d414298cce3fe44a91daa (table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc])
I20260928 01:56:28.658114 22425 raft_consensus.cc:515] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.709019 22425 leader_election.cc:290] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:28.712864 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 155896us
I20260928 01:56:28.571561 19764 raft_consensus.cc:2468] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
W20260928 01:56:28.716966 19553 leader_election.cc:343] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: 89e1d60db21f4a8294792df3fadf5d90
I20260928 01:56:28.718902 21271 tablet_loader.cc:96] loaded metadata for tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12])
I20260928 01:56:28.718647 22380 consensus_queue.cc:1048] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:28.721318 21271 tablet_loader.cc:96] loaded metadata for tablet 36076aa674b9401b9b76fbf066348d06 (table default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a])
I20260928 01:56:28.692848 22416 raft_consensus.cc:493] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.724927 21271 tablet_loader.cc:96] loaded metadata for tablet 376b5a87b07b4f87a2a502b5fa1b23f8 (table default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7])
I20260928 01:56:28.724998 22416 raft_consensus.cc:515] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.693331 22447 raft_consensus.cc:493] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.726956 22447 raft_consensus.cc:515] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.727618 21271 tablet_loader.cc:96] loaded metadata for tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7 (table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535])
I20260928 01:56:28.729140 22447 leader_election.cc:290] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:28.693897 22448 raft_consensus.cc:493] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.729612 21271 tablet_loader.cc:96] loaded metadata for tablet 3f4a1c903a04450684ba38081a75559e (table default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a])
I20260928 01:56:28.729861 22448 raft_consensus.cc:515] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.731871 22448 leader_election.cc:290] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:28.642369 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 85590.1us
I20260928 01:56:28.733690 19704 leader_election.cc:304] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:28.669868 20029 raft_consensus.cc:385] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:28.734601 20029 raft_consensus.cc:740] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:28.735402 20029 consensus_queue.cc:260] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.741928 22454 consensus_queue.cc:1048] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:28.712992 22387 raft_consensus.cc:2749] T 522245da435b40ae84ae6dc5d19a2e95 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:28.695530 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:28.745574 19467 raft_consensus.cc:3060] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:28.732764 19412 leader_election.cc:304] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.748384 22425 raft_consensus.cc:493] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.749218 22387 raft_consensus.cc:2749] T 12b836e20d6b43cba8eaa08887afb076 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:28.749035 22425 raft_consensus.cc:515] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.750654 19412 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.735476 22416 leader_election.cc:290] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:28.715406 19409 leader_election.cc:304] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:28.754985 22380 raft_consensus.cc:493] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.755754 22380 raft_consensus.cc:515] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:28.757794 21271 tablet_loader.cc:96] loaded metadata for tablet 416ccc1323fe41b2a7783dc95bba8d84 (table default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d])
I20260928 01:56:28.759907 21271 tablet_loader.cc:96] loaded metadata for tablet 45d8d07b367b4fafbd7171f8ea7b2a26 (table default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921])
I20260928 01:56:28.759850 22456 raft_consensus.cc:493] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.760545 22456 raft_consensus.cc:515] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.763597 22456 leader_election.cc:290] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:28.764735 22387 raft_consensus.cc:2749] T 502c0f4e07ff4479af8d33c99031b6fc P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:56:28.765532 22387 consensus_queue.cc:1048] T 8df69eb3a37445ed8a2be0ef3bf32cdb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:28.765776 22380 leader_election.cc:290] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:28.766433 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 51209.1us
I20260928 01:56:28.689759 21909 ts_tablet_manager.cc:1929] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260928 01:56:28.767277 21909 log.cc:1199] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/7602706a3fbc438d8d448c9ac057087c
I20260928 01:56:28.767726 22420 raft_consensus.cc:2804] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:28.768491 22420 raft_consensus.cc:697] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 3 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:28.769305 22420 consensus_queue.cc:237] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.770038 21271 tablet_loader.cc:96] loaded metadata for tablet 4c6f4708c641414aa59f01703c86aaf1 (table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8])
I20260928 01:56:28.771291 21271 tablet_loader.cc:96] loaded metadata for tablet 4e6b59144fe14daab98b0965c7f8af02 (table default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2])
I20260928 01:56:28.782634 21909 ts_tablet_manager.cc:1950] T 7602706a3fbc438d8d448c9ac057087c P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
W20260928 01:56:28.783663 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 50056.9us
I20260928 01:56:28.785300 21271 tablet_loader.cc:96] loaded metadata for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88])
I20260928 01:56:28.787747 22425 leader_election.cc:290] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:28.788787 19412 leader_election.cc:304] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.789664 21271 tablet_loader.cc:96] loaded metadata for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd])
I20260928 01:56:28.791226 21271 tablet_loader.cc:96] loaded metadata for tablet 522245da435b40ae84ae6dc5d19a2e95 (table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed])
I20260928 01:56:28.790853 19556 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:28.792690 22387 raft_consensus.cc:2749] T 8b48eacc1cec49baabe2d87bdd06cd5c P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:56:28.784704 19704 leader_election.cc:304] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:28.795385 22228 raft_consensus.cc:2804] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:28.795892 22228 raft_consensus.cc:697] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:28.796366 22446 raft_consensus.cc:493] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:28.796936 21271 tablet_loader.cc:96] loaded metadata for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3 (table default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f])
I20260928 01:56:28.796792 22446 raft_consensus.cc:515] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.798166 21271 tablet_loader.cc:96] loaded metadata for tablet 5374596938d64cafb9621a1932ca1f68 (table default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f])
I20260928 01:56:28.798887 22446 leader_election.cc:290] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:28.799753 19814 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:28.799952 21271 tablet_loader.cc:96] loaded metadata for tablet 53c755f16ea1496eb7fa26fb12e01708 (table default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85])
I20260928 01:56:28.801072 21271 tablet_loader.cc:96] loaded metadata for tablet 5442dd0aa28545c8bcf3a0b977c71e98 (table default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b])
I20260928 01:56:28.606313 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.608678 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.803797 22228 consensus_queue.cc:237] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.808293 22452 raft_consensus.cc:2804] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:28.808858 22452 raft_consensus.cc:697] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:28.809695 22452 consensus_queue.cc:237] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:28.609090 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.824568 19409 leader_election.cc:304] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:28.825802 22421 raft_consensus.cc:2804] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:28.826294 22421 raft_consensus.cc:697] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:28.827121 22421 consensus_queue.cc:237] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:28.828349 21271 tablet_loader.cc:96] loaded metadata for tablet 6546cfe6f3a6405fab41a4ebdcffb288 (table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df])
I20260928 01:56:28.819682 22435 consensus_queue.cc:1048] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260928 01:56:28.841962 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 37) took 14914 ms. Trace:
I20260928 01:56:28.842331 21909 rpcz_store.cc:276] 0928 01:56:13.927854 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.928460 (+   606us) service_pool.cc:224] Handling call
0928 01:56:28.070172 (+14141712us) ts_tablet_manager.cc:1151] Deleting tablet 7602706a3fbc438d8d448c9ac057087c
0928 01:56:28.077100 (+  6928us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:28.454815 (+377715us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:28.689607 (+234792us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:28.841888 (+152281us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14140482}
I20260928 01:56:28.843483 21909 tablet_replica.cc:333] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:28.847991 22460 tablet.cc:1751] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:28.849337 21271 tablet_loader.cc:96] loaded metadata for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435])
I20260928 01:56:28.850664 21271 tablet_loader.cc:96] loaded metadata for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee])
I20260928 01:56:28.851859 21271 tablet_loader.cc:96] loaded metadata for tablet 664b608bb0f54fc5baa10622f7d916c1 (table default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9])
I20260928 01:56:28.853109 21271 tablet_loader.cc:96] loaded metadata for tablet 675e1e1f2630411f8b070d8ca99e8ffb (table default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93])
I20260928 01:56:28.861333 21271 tablet_loader.cc:96] loaded metadata for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331])
I20260928 01:56:28.861420 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.862573 21271 tablet_loader.cc:96] loaded metadata for tablet 6ea6adefd15a4ea19011419949047e83 (table default.Table_a82317fb7790483884cbb5ebcf554128 [id=292d90fe578e4470bced0890a4e646ef])
I20260928 01:56:28.863358 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.864848 21271 tablet_loader.cc:96] loaded metadata for tablet 7441c2d1a7fa4dc8a89c6717a80d3efb (table default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233])
I20260928 01:56:28.866103 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.867702 21271 tablet_loader.cc:96] loaded metadata for tablet 75303ee92aae436ea6c46747a23b69b6 (table default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320])
I20260928 01:56:28.871805 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.872308 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.838171 20029 ts_tablet_manager.cc:1434] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.342s	user 0.006s	sys 0.000s
I20260928 01:56:28.874245 20029 tablet_bootstrap.cc:492] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:28.874136 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.868741 19467 raft_consensus.cc:2468] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:28.881210 21271 tablet_loader.cc:96] loaded metadata for tablet 7801c623930d4e4eaf24c5c424b06d26 (table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006])
I20260928 01:56:28.885618 21271 tablet_loader.cc:96] loaded metadata for tablet 7979940c4a2e470bbecc40384edf38c9 (table default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87])
I20260928 01:56:28.890147 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.898123 21271 tablet_loader.cc:96] loaded metadata for tablet 81c205176cb94d9f861cc140560944d4 (table default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765])
I20260928 01:56:28.901626 19761 raft_consensus.cc:1240] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3. Ops: []
I20260928 01:56:28.908951 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.912551 19703 leader_election.cc:304] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:28.914620 22361 raft_consensus.cc:3060] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:28.918301 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:28.921447 21271 tablet_loader.cc:96] loaded metadata for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9])
I20260928 01:56:28.922900 21271 tablet_loader.cc:96] loaded metadata for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780])
W20260928 01:56:28.923182 19409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:28.926103 22361 raft_consensus.cc:2749] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:28.933723 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:28.935369 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 8a5e07078b2a4fe59d9293d9511cbb6b (table default.Table_deb7dc16f0794afd95d9f29bed3a5621 [id=0da09ac1dc794d82b6f9323d0196b4cc]) successfully deleted
I20260928 01:56:28.937153 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 22606f012f1c44bd92c8e0341e9ca2b7 (table default.Table_593e8a23ad954f5b8b209830cbd7ccf9 [id=cb3f94a374cd4a21a132791410361924]) successfully deleted
I20260928 01:56:28.937821 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:28.941962 21271 tablet_loader.cc:96] loaded metadata for tablet 8b48eacc1cec49baabe2d87bdd06cd5c (table default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd])
I20260928 01:56:28.943181 21271 tablet_loader.cc:96] loaded metadata for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_dba14cbe11f54bef81b2bb5b2b9e2068 [id=55616d2998544e568042a46ef7f958e4])
I20260928 01:56:28.944511 21271 tablet_loader.cc:96] loaded metadata for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca])
I20260928 01:56:28.945706 21271 tablet_loader.cc:96] loaded metadata for tablet 8df69eb3a37445ed8a2be0ef3bf32cdb (table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624])
I20260928 01:56:28.956724 22387 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.957252 21271 tablet_loader.cc:96] loaded metadata for tablet 8e39fce4f0a149a898de678d73052f52 (table default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55])
I20260928 01:56:28.957441 22387 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:28.960675 22387 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:28.970520 22179 ts_tablet_manager.cc:1929] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260928 01:56:28.971022 22179 log.cc:1199] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/89e1d60db21f4a8294792df3fadf5d90
I20260928 01:56:28.974692 21271 tablet_loader.cc:96] loaded metadata for tablet 9690a224bb004152ba65d525cc10bd9f (table default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5])
I20260928 01:56:28.979713 19193 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:28.976032 21271 tablet_loader.cc:96] loaded metadata for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7])
I20260928 01:56:28.985870 21271 tablet_loader.cc:96] loaded metadata for tablet 99e806ba248746d2bde39a2eb76b17df (table default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542])
I20260928 01:56:28.987116 21271 tablet_loader.cc:96] loaded metadata for tablet 9a9c2db89fb8467d91c6bd01985d8b40 (table default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3])
W20260928 01:56:28.987069 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 196424us
I20260928 01:56:28.989641 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:28.990931 19605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:28.991508 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376b5a87b07b4f87a2a502b5fa1b23f8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:28.991892 19605 raft_consensus.cc:2393] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 3: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:28.992969 22380 raft_consensus.cc:2749] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260928 01:56:28.993330 19617 raft_consensus.cc:1240] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:28.993167 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb159b3aad31479f80683b0d80549cc3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:28.993736 22380 raft_consensus.cc:493] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:28.991006 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:28.994297 22380 raft_consensus.cc:515] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:29.002007 21271 tablet_loader.cc:96] loaded metadata for tablet 9ec3f279423a46c1acb1cbfecf4a608a (table default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b])
W20260928 01:56:29.004452 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 212383us
I20260928 01:56:29.003713 21271 tablet_loader.cc:96] loaded metadata for tablet 9f80b652a19a41968d1bfbaaf020b721 (table default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1])
I20260928 01:56:29.010741 21271 tablet_loader.cc:96] loaded metadata for tablet a01b795606604960bc7cafab4ff6f3d0 (table default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae])
I20260928 01:56:29.011864 21271 tablet_loader.cc:96] loaded metadata for tablet a12bafcc09ef4342bff89b0475f721af (table default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b])
I20260928 01:56:29.012880 21271 tablet_loader.cc:96] loaded metadata for tablet a1710b95678440b1bff8a92080d43272 (table default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d])
I20260928 01:56:29.014029 21271 tablet_loader.cc:96] loaded metadata for tablet a23b494afa1f45988d447519356d2b03 (table default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305])
I20260928 01:56:29.016877 19553 leader_election.cc:304] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:29.019969 22425 raft_consensus.cc:2804] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:29.020349 22421 raft_consensus.cc:493] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:29.020571 22425 raft_consensus.cc:697] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 3 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:29.020946 22421 raft_consensus.cc:515] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:29.021706 22425 consensus_queue.cc:237] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:29.023087 22421 leader_election.cc:290] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:29.029532 21271 tablet_loader.cc:96] loaded metadata for tablet a735102c576640b69323cacb50393a42 (table default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e])
I20260928 01:56:29.030827 21271 tablet_loader.cc:96] loaded metadata for tablet a82d3233e4514813b22121f75d11eebc (table default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151])
I20260928 01:56:29.033391 21271 tablet_loader.cc:96] loaded metadata for tablet b4b520e89c364692af1aedde2a59c3da (table default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca])
I20260928 01:56:29.034628 21271 tablet_loader.cc:96] loaded metadata for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5])
I20260928 01:56:29.035092 22380 leader_election.cc:290] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:29.036563 21271 tablet_loader.cc:96] loaded metadata for tablet b8cacb4a90a54cd3b5b3e7a9310e06ed (table default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d])
I20260928 01:56:29.038437 21271 tablet_loader.cc:96] loaded metadata for tablet ba89039dcfa848159112caa76802b5f1 (table default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749])
I20260928 01:56:29.039637 21271 tablet_loader.cc:96] loaded metadata for tablet bab12ba3e1f542949e3f203dae0fa80e (table default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb])
W20260928 01:56:29.042734 19149 debug-util.cc:398] Leaking SignalData structure 0x7b08000a1de0 after lost signal to thread 19086
W20260928 01:56:29.043885 19149 debug-util.cc:398] Leaking SignalData structure 0x7b08000ce840 after lost signal to thread 19152
I20260928 01:56:29.053802 21271 tablet_loader.cc:96] loaded metadata for tablet c2597de2c4304074977db5a3c0426814 (table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e])
I20260928 01:56:29.055811 21271 tablet_loader.cc:96] loaded metadata for tablet c53d75604ee3405d83fe9ecaa824ea68 (table default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513])
I20260928 01:56:29.056998 21271 tablet_loader.cc:96] loaded metadata for tablet c74a4a00552c4a14a871a59465524f1c (table default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a])
I20260928 01:56:29.058840 21271 tablet_loader.cc:96] loaded metadata for tablet c8fd6b965d22477aaee9bafccb2069b1 (table default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02])
I20260928 01:56:29.060154 21271 tablet_loader.cc:96] loaded metadata for tablet c9f3e966ab0d46d187fb9daa356b16fc (table default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b])
I20260928 01:56:29.061371 21271 tablet_loader.cc:96] loaded metadata for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e])
I20260928 01:56:29.063279 21271 tablet_loader.cc:96] loaded metadata for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305])
I20260928 01:56:29.068745 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.072400 19618 raft_consensus.cc:1240] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 2. Current term is 3. Ops: []
I20260928 01:56:29.076524 21271 tablet_loader.cc:96] loaded metadata for tablet d114d5ba862044b4b88eee27395db7e3 (table default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb])
I20260928 01:56:29.079993 21271 tablet_loader.cc:96] loaded metadata for tablet d7774406b22547d29d9d42c969cf0874 (table default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa])
I20260928 01:56:29.089397 21271 tablet_loader.cc:96] loaded metadata for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4])
I20260928 01:56:29.091555 21271 tablet_loader.cc:96] loaded metadata for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e])
I20260928 01:56:29.092645 21271 tablet_loader.cc:96] loaded metadata for tablet e6206afe245740b1819069a48e8b548e (table default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37])
I20260928 01:56:29.093920 21271 tablet_loader.cc:96] loaded metadata for tablet e8f6ce7612d4463ebe95e07557bca4e7 (table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67])
I20260928 01:56:29.100351 22179 ts_tablet_manager.cc:1950] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:29.105135 21271 tablet_loader.cc:96] loaded metadata for tablet e927cd8a991f46278c2bb663cee7f753 (table default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75])
I20260928 01:56:29.106469 21271 tablet_loader.cc:96] loaded metadata for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba])
I20260928 01:56:29.109602 21271 tablet_loader.cc:96] loaded metadata for tablet eb014699060e4a6caf4caaf33c31710a (table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f])
I20260928 01:56:29.111562 21271 tablet_loader.cc:96] loaded metadata for tablet ef752c3b4b22490ab42292f61278da52 (table default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619])
I20260928 01:56:29.115811 21271 tablet_loader.cc:96] loaded metadata for tablet f7b78eb499d6418f8877bf3b59bbbec2 (table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d])
I20260928 01:56:29.126590 21271 tablet_loader.cc:96] loaded metadata for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9])
I20260928 01:56:29.127923 21271 tablet_loader.cc:96] loaded metadata for tablet fa3b9ec9f88342c0aa77c0fc92d26205 (table default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87])
I20260928 01:56:29.129180 21271 tablet_loader.cc:96] loaded metadata for tablet fb159b3aad31479f80683b0d80549cc3 (table default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b])
I20260928 01:56:29.130424 21271 tablet_loader.cc:96] loaded metadata for tablet fc428ccbf88e4d5cbae197cb67e9a0a5 (table default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14])
I20260928 01:56:29.131698 21271 tablet_loader.cc:96] loaded metadata for tablet fcf1b727e86a43b08bd464647fa529a3 (table default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619])
I20260928 01:56:29.154477 19605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a232fc915a46c1a833ec5f6721eece" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:29.155287 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:29.155962 19620 raft_consensus.cc:3060] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:29.167666 19620 raft_consensus.cc:2468] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
W20260928 01:56:29.190667 21271 catalog_manager.cc:1525] Time spent T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Loading table and tablet metadata into memory: real 32.709s	user 0.401s	sys 0.131s
I20260928 01:56:29.191125 21271 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 01:56:29.194221 19127 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Refusing update from remote peer c17b7f9972364c76893311539b569e0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 342. Preceding OpId from leader: term: 6 index: 342. (term mismatch)
I20260928 01:56:29.194687 19127 pending_rounds.cc:85] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Aborting all ops after (but not including) 341
I20260928 01:56:29.194940 19127 pending_rounds.cc:107] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Aborting uncommitted NO_OP operation due to leader change: 5.342
I20260928 01:56:29.195235 19127 raft_consensus.cc:2889] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260928 01:56:29.196177 19127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42956 (request call id 34) took 31834 ms (client timeout 30000 ms). Trace:
W20260928 01:56:29.196671 19127 rpcz_store.cc:269] 0928 01:55:57.361731 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:57.362704 (+   973us) service_pool.cc:224] Handling call
0928 01:56:29.193662 (+31830958us) raft_consensus.cc:1471] Updating replica for 0 ops
0928 01:56:29.195879 (+  2217us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:56:29.196104 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 01:56:29.197968 19127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 26) took 25811 ms (client timeout 730 ms). Trace:
W20260928 01:56:29.198302 19127 rpcz_store.cc:269] 0928 01:56:03.386274 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.197708 (+25811434us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.197878 (+   170us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:29.199381 19127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 27) took 23544 ms (client timeout 669 ms). Trace:
W20260928 01:56:29.199684 19127 rpcz_store.cc:269] 0928 01:56:05.655085 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.199145 (+23544060us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.199291 (+   146us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 01:56:29.200421 19125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:56:29.201174 19125 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c17b7f9972364c76893311539b569e0f in term 6.
W20260928 01:56:29.201731 19125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42956 (request call id 32) took 32678 ms (client timeout 923 ms). Trace:
W20260928 01:56:29.202050 19125 rpcz_store.cc:269] 0928 01:55:56.523293 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:56.524433 (+  1140us) service_pool.cc:224] Handling call
0928 01:56:29.201655 (+32677222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 01:56:29.202986 19125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 28) took 22805 ms (client timeout 669 ms). Trace:
W20260928 01:56:29.203321 19125 rpcz_store.cc:269] 0928 01:56:06.397919 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.202791 (+22804872us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.202932 (+   141us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 01:56:29.204615 19113 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:51212 (request call id 322) took 32702 ms. Trace:
I20260928 01:56:29.204969 19113 rpcz_store.cc:276] 0928 01:55:56.502334 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:56.503077 (+   743us) service_pool.cc:224] Handling call
0928 01:56:29.204421 (+32701344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:29.207167 19119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 342 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:56:29.207821 19119 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e48edd841a42d08a480be209f0d294 in term 6.
W20260928 01:56:29.208340 19119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 25) took 26587 ms (client timeout 730 ms). Trace:
W20260928 01:56:29.208662 19119 rpcz_store.cc:269] 0928 01:56:02.620994 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:02.621384 (+   390us) service_pool.cc:224] Handling call
0928 01:56:29.208261 (+26586877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:29.209537 19122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 342 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:56:29.210225 19122 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e48edd841a42d08a480be209f0d294 in term 6.
W20260928 01:56:29.210731 19122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 22) took 30250 ms (client timeout 642 ms). Trace:
W20260928 01:56:29.211109 19122 rpcz_store.cc:269] 0928 01:55:58.960741 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:58.961124 (+   383us) service_pool.cc:224] Handling call
0928 01:56:29.210656 (+30249532us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:29.224965 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc"
I20260928 01:56:29.228667 19120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 342 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
W20260928 01:56:29.229882 19120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 24) took 27996 ms (client timeout 640 ms). Trace:
W20260928 01:56:29.230214 19120 rpcz_store.cc:269] 0928 01:56:01.233879 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:01.234210 (+   331us) service_pool.cc:224] Handling call
0928 01:56:29.229790 (+27995580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:29.240283 19121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 342 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
W20260928 01:56:29.241760 19121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 23) took 28719 ms (client timeout 640 ms). Trace:
W20260928 01:56:29.242187 19121 rpcz_store.cc:269] 0928 01:56:00.522753 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:00.522974 (+   221us) service_pool.cc:224] Handling call
0928 01:56:29.241647 (+28718673us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 01:56:29.243324 19121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 30) took 18950 ms (client timeout 622 ms). Trace:
W20260928 01:56:29.243645 19121 rpcz_store.cc:269] 0928 01:56:10.293393 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.243122 (+18949729us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.243251 (+   129us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 01:56:29.244247 21271 catalog_manager.cc:1308] Loaded cluster ID: 726a03a5ce124d548da65567db2a283d
I20260928 01:56:29.244491 21271 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:56:29.248384 19128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
W20260928 01:56:29.249336 19128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42956 (request call id 35) took 31486 ms (client timeout 923 ms). Trace:
W20260928 01:56:29.249682 19128 rpcz_store.cc:269] 0928 01:55:57.762637 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:57.763213 (+   576us) service_pool.cc:224] Handling call
0928 01:56:29.249237 (+31486024us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 01:56:29.250590 19128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 31) took 15832 ms (client timeout 613 ms). Trace:
W20260928 01:56:29.250887 19128 rpcz_store.cc:269] 0928 01:56:13.418520 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.250416 (+15831896us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.250536 (+   120us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 01:56:28.966418 21909 raft_consensus.cc:2243] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:29.253569 21909 raft_consensus.cc:2272] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:29.252172 19467 raft_consensus.cc:1275] T c74a4a00552c4a14a871a59465524f1c P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:29.253160 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:29.256013 21909 ts_tablet_manager.cc:1916] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:29.257699 19189 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60098:
table { table_name: "default.Table_dba14cbe11f54bef81b2bb5b2b9e2068" } new_table_name: "default.Table_9a7d932e0ef8485cb1fb0d4450cbd14d" modify_external_catalogs: true
I20260928 01:56:29.258579 19186 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60098:
name: "default.Table_f064df9b0ba6484e8b4ff02df3f02433"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:56:29.262241 19186 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f064df9b0ba6484e8b4ff02df3f02433 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:56:29.265053 19191 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60098:
name: "default.Table_8c45cdb1505f4f2c98e33582a08d4915"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:56:29.266866 19191 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c45cdb1505f4f2c98e33582a08d4915 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:56:29.015969 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 101604us
I20260928 01:56:29.268334 19190 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60098:
table { table_name: "default.Table_a82317fb7790483884cbb5ebcf554128" } new_table_name: "default.Table_2a43036236e34e2586f541aa2fb3b8b6" modify_external_catalogs: true
I20260928 01:56:29.269840 19188 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60098:
table { table_name: "default.Table_81323d2c6d8441fe93083d127876a785" } modify_external_catalogs: true
I20260928 01:56:29.270445 19188 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60098:
table { table_name: "default.Table_81323d2c6d8441fe93083d127876a785" } modify_external_catalogs: true
I20260928 01:56:29.271944 19185 master_service.cc:960] ReplaceTablet: received request to replace tablet 58c61408724e4a70b39e5dbdab9a3e8a from {username='slave'} at 127.0.0.1:60098
I20260928 01:56:29.274228 19187 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60098:
name: "default.Table_c559f34b8864494f82ca062207ebbecf"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:56:29.275820 19187 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c559f34b8864494f82ca062207ebbecf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:56:29.283687 19185 master_service.cc:960] ReplaceTablet: received request to replace tablet e8f6ce7612d4463ebe95e07557bca4e7 from {username='slave'} at 127.0.0.1:60098
I20260928 01:56:29.030260 20029 tablet_bootstrap.cc:654] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:29.081333 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d70a8be7244c86864187420a4fd5f5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.152247 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.229221 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:29.289039 19127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 29) took 19799 ms (client timeout 622 ms). Trace:
W20260928 01:56:29.289400 19127 rpcz_store.cc:269] 0928 01:56:09.451819 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.235181 (+19783362us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.251572 (+ 16391us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 01:56:29.288308 19124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 341 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc"
W20260928 01:56:29.290922 19124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42956 (request call id 36) took 31527 ms (client timeout 846 ms). Trace:
W20260928 01:56:29.291462 19124 rpcz_store.cc:269] 0928 01:55:57.763003 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:57.763537 (+   534us) service_pool.cc:224] Handling call
0928 01:56:29.290821 (+31527284us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 01:56:29.292431 19124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 33) took 13197 ms (client timeout 523 ms). Trace:
W20260928 01:56:29.292747 19124 rpcz_store.cc:269] 0928 01:56:16.095465 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.292234 (+13196769us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.292369 (+   135us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:29.293715 19128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 34) took 12679 ms (client timeout 523 ms). Trace:
W20260928 01:56:29.294023 19128 rpcz_store.cc:269] 0928 01:56:16.614699 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.293551 (+12678852us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.293658 (+   107us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:29.294864 19128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 35) took 10824 ms (client timeout 533 ms). Trace:
W20260928 01:56:29.295157 19128 rpcz_store.cc:269] 0928 01:56:18.470265 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.294689 (+10824424us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.294800 (+   111us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 01:56:29.296469 19123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 342 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
W20260928 01:56:29.299942 19123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 21) took 31050 ms (client timeout 642 ms). Trace:
W20260928 01:56:29.300364 19123 rpcz_store.cc:269] 0928 01:55:58.249553 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:58.249798 (+   245us) service_pool.cc:224] Handling call
0928 01:56:29.299846 (+31050048us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:29.301566 22452 consensus_queue.cc:1048] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:56:29.305160 19125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 37) took 8401 ms (client timeout 555 ms). Trace:
W20260928 01:56:29.305537 19125 rpcz_store.cc:269] 0928 01:56:20.904284 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.304982 (+8400698us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.305096 (+   114us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:29.306497 19119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 38) took 7792 ms (client timeout 555 ms). Trace:
W20260928 01:56:29.306877 19119 rpcz_store.cc:269] 0928 01:56:21.514623 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.306310 (+7791687us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.306426 (+   116us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:29.307930 19120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 39) took 4668 ms (client timeout 566 ms). Trace:
W20260928 01:56:29.308274 19120 rpcz_store.cc:269] 0928 01:56:24.640084 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.307765 (+4667681us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.307876 (+   111us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:29.300983 19121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 32) took 15211 ms (client timeout 613 ms). Trace:
W20260928 01:56:29.309056 19121 rpcz_store.cc:269] 0928 01:56:14.086334 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.290166 (+15203832us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.296951 (+  6785us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:29.295984 19128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 36) took 10282 ms (client timeout 533 ms). Trace:
W20260928 01:56:29.309861 19128 rpcz_store.cc:269] 0928 01:56:19.013242 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.295830 (+10282588us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.295934 (+   104us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:29.314898 19122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 40) took 4077 ms (client timeout 566 ms). Trace:
W20260928 01:56:29.315352 19122 rpcz_store.cc:269] 0928 01:56:25.237981 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.314587 (+4076606us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.314801 (+   214us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:29.318284 19127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 41) took 1845 ms (client timeout 549 ms). Trace:
W20260928 01:56:29.318667 19127 rpcz_store.cc:269] 0928 01:56:27.472868 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.318112 (+1845244us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.318224 (+   112us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:29.319512 19127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 42) took 1271 ms (client timeout 549 ms). Trace:
W20260928 01:56:29.319825 19127 rpcz_store.cc:269] 0928 01:56:28.047737 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.319359 (+1271622us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:29.319457 (+    98us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 01:56:29.330195 19126 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c17b7f9972364c76893311539b569e0f in term 6.
I20260928 01:56:29.330943 22421 raft_consensus.cc:493] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:29.331620 22421 raft_consensus.cc:515] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:29.333973 19120 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Refusing update from remote peer c17b7f9972364c76893311539b569e0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 341. Preceding OpId from leader: term: 6 index: 342. (index mismatch)
I20260928 01:56:29.334100 22421 leader_election.cc:290] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:29.336103 19120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42956 (request call id 37) took 1957 ms. Trace:
I20260928 01:56:29.336512 19120 rpcz_store.cc:276] 0928 01:56:27.379364 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.320928 (+1941564us) service_pool.cc:224] Handling call
0928 01:56:29.333651 (+ 12723us) raft_consensus.cc:1471] Updating replica for 0 ops
0928 01:56:29.334281 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:56:29.335852 (+  1571us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b5400030550. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b6aa1 00007f19fd74d06d 00007f19fe7ad659 00007f19fce29d34 00007f19fce29cc2 00007f19fce29bf1 00007f19fce29b6c 00007f19fce28e22 00007f19fb41c09c 00007f19fb41b4d6 00007f19fb41ae7f
0928 01:56:29.336020 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28521856}
W20260928 01:56:29.337692 19126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42956 (request call id 33) took 32690 ms (client timeout 846 ms). Trace:
W20260928 01:56:29.338049 19126 rpcz_store.cc:269] 0928 01:55:56.647566 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:55:56.647804 (+   238us) service_pool.cc:224] Handling call
0928 01:56:29.337613 (+32689809us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:29.169585 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:29.338549 22408 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 342, Last known committed idx: 341, Time since last communication: 0.001s
I20260928 01:56:29.173496 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d1238d0a2d45c0a708442fd0b17291" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.139720 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 40) took 8351 ms. Trace:
I20260928 01:56:29.209003 19605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6b59144fe14daab98b0965c7f8af02" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.217809 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:29.341107 19615 raft_consensus.cc:3060] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:29.348301 22179 rpcz_store.cc:276] 0928 01:56:20.788610 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.789250 (+   640us) service_pool.cc:224] Handling call
0928 01:56:27.517118 (+6727868us) ts_tablet_manager.cc:1151] Deleting tablet 89e1d60db21f4a8294792df3fadf5d90
0928 01:56:27.517176 (+    58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:28.700286 (+1183110us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:28.970366 (+270080us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:29.139601 (+169235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":601899,"tablet-delete.queue_time_us":6704155}
I20260928 01:56:29.351188 22179 tablet_replica.cc:333] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:29.351454 21271 catalog_manager.cc:1553] Loading token signing keys...
I20260928 01:56:29.411855 21271 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Loaded TSK: 0
I20260928 01:56:29.305236 19703 leader_election.cc:304] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:29.415191 22452 raft_consensus.cc:2804] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:29.415928 22452 raft_consensus.cc:493] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:29.416656 22452 raft_consensus.cc:3060] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:29.354187 19615 raft_consensus.cc:2468] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:29.381232 22456 raft_consensus.cc:493] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:29.426865 21271 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 01:56:29.426604 22456 raft_consensus.cc:515] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:29.428869 22456 leader_election.cc:290] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:29.395538 19605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.405978 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10fa56df34ad44d88f1dd700c823d57c" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.408687 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f4a1c903a04450684ba38081a75559e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.409428 19607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.434882 19764 raft_consensus.cc:1240] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:29.409700 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.410420 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.410564 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.410913 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.408743 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a23b494afa1f45988d447519356d2b03" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:29.412701 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 107558us
I20260928 01:56:29.412153 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.412983 19613 raft_consensus.cc:1240] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [term 3 LEADER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3. Ops: []
I20260928 01:56:29.448349 22228 consensus_queue.cc:1048] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:29.484292 22456 raft_consensus.cc:493] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:29.485081 22456 raft_consensus.cc:515] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:29.501083 19193 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:29.501240 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.502513 19764 raft_consensus.cc:2468] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 1.
I20260928 01:56:29.505772 22456 leader_election.cc:290] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:29.508504 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12bafcc09ef4342bff89b0475f721af" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.509454 19606 raft_consensus.cc:2393] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:29.512113 20029 tablet_bootstrap.cc:492] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:29.516374 20029 ts_tablet_manager.cc:1403] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.642s	user 0.012s	sys 0.000s
I20260928 01:56:29.521642 22431 consensus_queue.cc:1059] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:29.522545 22431 raft_consensus.cc:3055] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 2 LEADER]: Stepping down as leader of term 2
I20260928 01:56:29.522892 22431 raft_consensus.cc:740] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:29.523728 22431 consensus_queue.cc:260] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:29.525516 22431 raft_consensus.cc:3060] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:29.533900 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43bec2c4274497ea73872d0db233eac" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:29.541882 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 7602706a3fbc438d8d448c9ac057087c (table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]) successfully deleted
I20260928 01:56:29.547616 22460 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55034 (request call id 70) took 3789 ms. Trace:
W20260928 01:56:29.550499 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 102357us
I20260928 01:56:29.551805 22435 consensus_queue.cc:1048] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260928 01:56:29.563515 22380 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:29.565133 22380 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:29.567930 22380 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:29.593978 22484 tablet.cc:1751] T 11a7c70dba4e4b3b97104b5d65704b9d P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:29.608938 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 89e1d60db21f4a8294792df3fadf5d90 (table default.Table_3ce866b8da2a4181bedfe396a59a2b76 [id=2e72bf3c803b4352af5b9d6300abbd35]) successfully deleted
I20260928 01:56:29.618214 19667 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:29.602180 20029 raft_consensus.cc:359] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:29.624059 20029 raft_consensus.cc:385] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:29.626394 20029 raft_consensus.cc:740] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:29.631348 20029 consensus_queue.cc:260] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:29.548096 22460 rpcz_store.cc:276] 0928 01:56:25.758716 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:25.758839 (+   123us) service_pool.cc:224] Handling call
0928 01:56:29.547534 (+3788695us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:25.895993 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 01:56:25.974358 (+ 78365us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 01:56:25.974411 (+    53us) alter_schema_op.cc:66] Acquired schema lock
0928 01:56:25.974480 (+    69us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 01:56:25.974616 (+   136us) alter_schema_op.cc:128] START. Timestamp: 1790560585970421
0928 01:56:25.974641 (+    25us) op_driver.cc:348] REPLICATION: starting
0928 01:56:25.975368 (+   727us) log.cc:844] Serialized 173 byte log entry
0928 01:56:28.641768 (+2666400us) op_driver.cc:464] REPLICATION: finished
0928 01:56:28.847897 (+206129us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 01:56:28.849897 (+  2000us) log.cc:844] Serialized 5 byte log entry
0928 01:56:29.327699 (+477802us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:29.547165 (+219466us) log.cc:844] Serialized 14 byte log entry
0928 01:56:29.547381 (+   216us) alter_schema_op.cc:73] Released schema lock
0928 01:56:29.547412 (+    31us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":205943,"prepare.queue_time_us":136047,"prepare.run_cpu_time_us":4203,"prepare.run_wall_time_us":164099,"replication_time_us":2666987,"thread_start_us":548883,"threads_started":4,"wal-append.queue_time_us":173672,"wal-append.run_cpu_time_us":2005,"wal-append.run_wall_time_us":1325438}]]}
I20260928 01:56:29.637732 22487 raft_consensus.cc:493] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:29.640372 22487 raft_consensus.cc:515] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:29.643147 22487 leader_election.cc:290] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:29.645967 19608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b78eb499d6418f8877bf3b59bbbec2" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.648077 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:29.639536 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 87161.3us
I20260928 01:56:29.660856 20029 ts_tablet_manager.cc:1434] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.144s	user 0.006s	sys 0.000s
I20260928 01:56:29.647495 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.663821 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:29.664515 19467 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
I20260928 01:56:29.666107 19703 leader_election.cc:304] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:29.669068 22446 raft_consensus.cc:2804] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:29.669541 22446 raft_consensus.cc:697] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:29.670423 22446 consensus_queue.cc:237] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:29.676189 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12bafcc09ef4342bff89b0475f721af" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:29.678076 19467 raft_consensus.cc:2393] T a12bafcc09ef4342bff89b0475f721af P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:29.684830 22361 raft_consensus.cc:493] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:29.685361 22361 raft_consensus.cc:515] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:29.687485 22361 leader_election.cc:290] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:29.667294 22487 raft_consensus.cc:493] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:29.690184 22487 raft_consensus.cc:515] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:29.707788 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.716981 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:29.717628 19459 raft_consensus.cc:2468] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:29.716666 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:29.718429 19458 raft_consensus.cc:2468] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
I20260928 01:56:29.719260 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:29.721726 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:29.722352 19459 raft_consensus.cc:2468] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:29.726200 19556 leader_election.cc:304] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:29.727046 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d70a8be7244c86864187420a4fd5f5" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:29.729372 19076 master-stress-test.cc:581] Killed test thread 1/10
I20260928 01:56:29.729797 19076 master-stress-test.cc:579] Killing test thread 2/10
W20260928 01:56:29.735096 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 44786.2us
I20260928 01:56:29.757678 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.762558 21909 ts_tablet_manager.cc:1929] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:29.763125 21909 log.cc:1199] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/c320eb2ca2ac4ac68293ef8f7400b45f
I20260928 01:56:29.764226 21909 ts_tablet_manager.cc:1950] T c320eb2ca2ac4ac68293ef8f7400b45f P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:29.765022 22487 leader_election.cc:290] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:29.768713 19556 leader_election.cc:304] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:29.769776 22485 raft_consensus.cc:2764] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260928 01:56:29.771034 22485 raft_consensus.cc:2804] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:29.772074 22485 raft_consensus.cc:697] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:29.773048 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.775326 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.779359 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:29.785827 19553 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 174001us
I20260928 01:56:29.790761 19752 raft_consensus.cc:3060] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:29.791087 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.795579 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.810472 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8d07b367b4fafbd7171f8ea7b2a26" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.812299 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.817003 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.820475 19752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:29.825089 19193 catalog_manager.cc:5838] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:29.840054 22488 mvcc.cc:204] Tried to move back new op lower bound from 7334136160527327232 to 7334136040608206848. Current Snapshot: MvccSnapshot[applied={T|T < 7334136160527327232 or (T in {7334136160527327232})}]
I20260928 01:56:29.773361 22485 consensus_queue.cc:237] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:29.863304 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 94694.7us
I20260928 01:56:29.864470 19556 leader_election.cc:304] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:29.859306 22495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:29.865444 22495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:56:29.872406 22481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17b7f9972364c76893311539b569e0f. Latest consensus state: current_term: 6 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
W20260928 01:56:29.873123 19116 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 175) took 811 ms (client timeout 1000 ms). Trace:
I20260928 01:56:29.873433 22481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: FOLLOWER
W20260928 01:56:29.873596 19116 rpcz_store.cc:269] 0928 01:56:29.061459 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.062833 (+  1374us) service_pool.cc:224] Handling call
0928 01:56:29.865407 (+802574us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:56:29.872818 (+  7411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511049600}
I20260928 01:56:29.898729 19409 leader_election.cc:304] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:29.901517 22179 raft_consensus.cc:2243] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:29.902179 22179 raft_consensus.cc:2272] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:29.904467 22380 raft_consensus.cc:2804] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:29.905355 22380 raft_consensus.cc:697] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:29.896606 22431 consensus_queue.cc:1059] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260928 01:56:29.906435 22179 ts_tablet_manager.cc:1916] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:29.906284 22380 consensus_queue.cc:237] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:29.910432 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 46173us
I20260928 01:56:29.916088 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5374596938d64cafb9621a1932ca1f68" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:56:29.874785 19179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 95713.2us
I20260928 01:56:29.926503 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8d07b367b4fafbd7171f8ea7b2a26" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:29.926772 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:29.927627 19458 raft_consensus.cc:2468] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:29.928937 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:29.929826 19467 raft_consensus.cc:2468] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:29.934042 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:29.939935 22431 raft_consensus.cc:3055] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:29.940452 22431 raft_consensus.cc:740] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:29.941429 22431 consensus_queue.cc:260] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:29.942838 22431 raft_consensus.cc:3060] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:29.950744 22510 raft_consensus.cc:2804] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:29.952483 22510 raft_consensus.cc:493] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:29.953644 22510 raft_consensus.cc:3060] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:29.994405 22457 raft_consensus.cc:493] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:29.994944 22457 raft_consensus.cc:515] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:29.997094 22457 leader_election.cc:290] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:29.993548 22485 raft_consensus.cc:493] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:29.998207 22485 raft_consensus.cc:515] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:30.000777 22485 leader_election.cc:290] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:30.026732 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c2db89fb8467d91c6bd01985d8b40" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:29.839756 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:30.052369 19753 raft_consensus.cc:1275] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:56:30.050209 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:30.025578 22457 raft_consensus.cc:493] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:30.055393 22457 raft_consensus.cc:515] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:30.056118 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 120071us
I20260928 01:56:30.057871 22457 leader_election.cc:290] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:30.062561 19409 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:30.062913 22481 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:30.063409 22481 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:30.028143 19412 leader_election.cc:304] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.066056 22481 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:30.065416 22421 raft_consensus.cc:2749] T 99e806ba248746d2bde39a2eb76b17df P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:30.067502 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 382 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:30.067871 19412 leader_election.cc:304] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.068538 22421 raft_consensus.cc:2749] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.069661 19412 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.070325 22421 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:30.070603 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 382 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:30.072492 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:56:30.073292 22481 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:30.075897 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d114d5ba862044b4b88eee27395db7e3" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:30.076701 19459 raft_consensus.cc:2468] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:30.087054 22526 tablet.cc:1751] T 11a7c70dba4e4b3b97104b5d65704b9d P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260928 01:56:29.844357 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:30.108418 19412 leader_election.cc:304] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.109911 19412 leader_election.cc:304] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:29.894172 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 35) took 15968 ms. Trace:
I20260928 01:56:29.713033 22452 raft_consensus.cc:515] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.110998 21909 rpcz_store.cc:276] 0928 01:56:13.925614 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.926804 (+  1190us) service_pool.cc:224] Handling call
0928 01:56:28.843291 (+14916487us) ts_tablet_manager.cc:1151] Deleting tablet c320eb2ca2ac4ac68293ef8f7400b45f
0928 01:56:28.843355 (+    64us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:29.298721 (+455366us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:29.762411 (+463690us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:29.894073 (+131662us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":241818,"tablet-delete.queue_time_us":14908146}
I20260928 01:56:30.113225 21909 tablet_replica.cc:333] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:30.113489 22452 leader_election.cc:290] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:30.048684 19749 raft_consensus.cc:1275] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:30.089175 19765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:30.104945 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d70a8be7244c86864187420a4fd5f5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:30.110612 22431 raft_consensus.cc:2749] T fb159b3aad31479f80683b0d80549cc3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:30.116542 22431 raft_consensus.cc:2749] T 202f1ead822548a2bbeae4e4d3cf9be8 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.120446 22421 raft_consensus.cc:2749] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:30.122483 22179 ts_tablet_manager.cc:1929] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:30.124666 22179 log.cc:1199] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/f709eccf4ab5413bbbd8b4746f185db4
I20260928 01:56:30.126273 19756 raft_consensus.cc:1240] T 27a232fc915a46c1a833ec5f6721eece P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 2. Current term is 3. Ops: []
I20260928 01:56:30.142997 22179 ts_tablet_manager.cc:1950] T f709eccf4ab5413bbbd8b4746f185db4 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:30.143908 22523 consensus_queue.cc:1048] T 01cc307b127446958bd4199a1aa60adb P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:30.147135 19412 leader_election.cc:304] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.153717 22431 raft_consensus.cc:2749] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:30.157617 19412 leader_election.cc:304] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.169627 22456 consensus_queue.cc:1048] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:30.171088 22456 consensus_queue.cc:1048] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 01:56:30.172669 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 129234us
I20260928 01:56:30.173863 22380 consensus_queue.cc:1048] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:29.923481 19193 catalog_manager.cc:5838] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:30.189019 22431 raft_consensus.cc:2749] T 4e6b59144fe14daab98b0965c7f8af02 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.199929 19412 leader_election.cc:304] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.202194 22431 raft_consensus.cc:2749] T 10fa56df34ad44d88f1dd700c823d57c P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.204375 19412 leader_election.cc:304] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.212482 22431 raft_consensus.cc:2749] T 3f4a1c903a04450684ba38081a75559e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.214814 19412 leader_election.cc:304] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
W20260928 01:56:30.214655 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 444330us
I20260928 01:56:30.218735 22431 raft_consensus.cc:2749] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:30.220300 19412 leader_election.cc:304] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.225329 22431 raft_consensus.cc:2749] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.225973 19704 leader_election.cc:304] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.228785 22435 raft_consensus.cc:493] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:30.229478 22435 raft_consensus.cc:515] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:30.232326 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21906a8380e64d95b9454a57fc01c6f0" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:30.242087 22523 raft_consensus.cc:493] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:30.242589 22523 raft_consensus.cc:515] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.244978 22523 leader_election.cc:290] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:30.247184 19412 leader_election.cc:304] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.248521 19412 leader_election.cc:304] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.249097 22523 raft_consensus.cc:2749] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.250173 22431 raft_consensus.cc:2749] T ba89039dcfa848159112caa76802b5f1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.251302 19412 leader_election.cc:304] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.252074 22523 raft_consensus.cc:2749] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.253479 19412 leader_election.cc:304] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.255491 22523 raft_consensus.cc:2749] T 8dc9a1c5be7c4e519f1415ba70397f01 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.256611 19412 leader_election.cc:304] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.257318 22523 raft_consensus.cc:2749] T a23b494afa1f45988d447519356d2b03 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.258353 19412 leader_election.cc:304] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.259119 22523 raft_consensus.cc:2749] T 9a9c2db89fb8467d91c6bd01985d8b40 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260928 01:56:30.261472 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 49009.6us
I20260928 01:56:30.262472 19412 leader_election.cc:304] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.264034 22523 raft_consensus.cc:2749] T f7b78eb499d6418f8877bf3b59bbbec2 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.179414 22510 raft_consensus.cc:515] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:30.265677 19412 leader_election.cc:304] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.266894 22510 leader_election.cc:290] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:30.267468 22523 raft_consensus.cc:2749] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.268860 19412 leader_election.cc:304] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.270874 19412 leader_election.cc:304] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.271405 22510 raft_consensus.cc:2749] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.273531 22431 raft_consensus.cc:493] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:30.274062 22523 raft_consensus.cc:2749] T 65d70a8be7244c86864187420a4fd5f5 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.273975 22431 raft_consensus.cc:515] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.274902 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:30.275502 19459 raft_consensus.cc:2468] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:30.276564 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c755f16ea1496eb7fa26fb12e01708" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:30.276738 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:30.277298 19463 raft_consensus.cc:2393] T 53c755f16ea1496eb7fa26fb12e01708 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:30.276012 22431 leader_election.cc:290] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:30.287350 19463 raft_consensus.cc:1240] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:30.289392 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e806ba248746d2bde39a2eb76b17df" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:30.289876 22452 raft_consensus.cc:493] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:30.290606 22452 raft_consensus.cc:515] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:30.231884 22435 leader_election.cc:290] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:30.294795 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 69048.6us
I20260928 01:56:30.298424 22534 raft_consensus.cc:493] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:30.299268 22534 raft_consensus.cc:515] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.305645 22452 leader_election.cc:290] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:30.227960 22525 raft_consensus.cc:2749] T 9ec3f279423a46c1acb1cbfecf4a608a P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.313619 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:30.314688 19463 raft_consensus.cc:2468] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:30.321013 22431 raft_consensus.cc:493] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:30.321593 22431 raft_consensus.cc:515] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.322261 22534 leader_election.cc:290] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:30.323637 22431 leader_election.cc:290] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:30.326107 22452 consensus_queue.cc:1059] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 01:56:30.327634 22421 consensus_queue.cc:1048] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:30.328954 22441 raft_consensus.cc:3055] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Stepping down as leader of term 2
I20260928 01:56:30.329381 22441 raft_consensus.cc:740] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:30.329169 22361 consensus_queue.cc:1048] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:30.330192 22421 consensus_queue.cc:1048] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:30.330423 22441 consensus_queue.cc:260] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:30.331756 22441 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:30.333443 19704 leader_election.cc:304] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.335713 19704 leader_election.cc:304] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.337417 22528 raft_consensus.cc:2749] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.338080 22528 raft_consensus.cc:2749] T e2d1238d0a2d45c0a708442fd0b17291 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:30.352192 19759 raft_consensus.cc:3060] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:30.359552 19704 leader_election.cc:304] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:30.361533 22534 raft_consensus.cc:3060] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:30.366362 19459 raft_consensus.cc:1275] T 5442dd0aa28545c8bcf3a0b977c71e98 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:30.393661 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 41) took 9603 ms. Trace:
I20260928 01:56:30.394083 22179 rpcz_store.cc:276] 0928 01:56:20.789946 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.790047 (+   101us) service_pool.cc:224] Handling call
0928 01:56:29.350964 (+8560917us) ts_tablet_manager.cc:1151] Deleting tablet f709eccf4ab5413bbbd8b4746f185db4
0928 01:56:29.351050 (+    86us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:29.987835 (+636785us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:30.122340 (+134505us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:30.393531 (+271191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":585675,"tablet-delete.queue_time_us":8537774}
I20260928 01:56:30.395474 22179 tablet_replica.cc:333] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:30.398299 22179 raft_consensus.cc:2243] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:30.399240 22179 raft_consensus.cc:2272] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:30.401710 19703 leader_election.cc:304] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:30.402470 22179 ts_tablet_manager.cc:1916] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:30.408938 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 146874us
W20260928 01:56:30.411285 19553 consensus_peers.cc:597] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 -> Peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Couldn't send request to peer 8373bfae1f384c36b5e4c5ca26b208da. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c320eb2ca2ac4ac68293ef8f7400b45f. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:30.411592 22228 raft_consensus.cc:493] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:30.412153 22228 raft_consensus.cc:515] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:30.417410 22228 leader_election.cc:290] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:30.419993 19463 raft_consensus.cc:1240] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [term 3 LEADER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 2. Current term is 3. Ops: []
I20260928 01:56:30.426164 22228 raft_consensus.cc:493] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:30.427425 22228 raft_consensus.cc:515] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.432098 22228 leader_election.cc:290] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:30.433595 22525 raft_consensus.cc:2804] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:30.451189 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea6adefd15a4ea19011419949047e83" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:30.453554 22525 raft_consensus.cc:493] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:30.453593 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d70a8be7244c86864187420a4fd5f5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:30.454035 22525 raft_consensus.cc:3060] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:56:30.454710 20591 debug-util.cc:398] Leaking SignalData structure 0x7b0800076f20 after lost signal to thread 19965
W20260928 01:56:30.455408 20591 debug-util.cc:398] Leaking SignalData structure 0x7b08000774c0 after lost signal to thread 20601
I20260928 01:56:30.456310 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba89039dcfa848159112caa76802b5f1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:30.458099 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:30.458704 19756 raft_consensus.cc:3060] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:30.479072 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:30.480690 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 121252us
W20260928 01:56:30.481704 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 65520.2us
I20260928 01:56:30.486979 22485 raft_consensus.cc:493] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:30.498919 22485 raft_consensus.cc:515] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.500962 22485 leader_election.cc:290] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:30.487442 22457 raft_consensus.cc:493] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:30.502434 22457 raft_consensus.cc:515] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.504474 22457 leader_election.cc:290] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:30.487856 22456 raft_consensus.cc:493] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:30.505367 22456 raft_consensus.cc:515] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.495455 19756 raft_consensus.cc:2468] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:30.507387 22456 leader_election.cc:290] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:30.488322 22425 raft_consensus.cc:493] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:30.508227 22425 raft_consensus.cc:515] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.510070 22425 leader_election.cc:290] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:30.488768 22380 raft_consensus.cc:493] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:30.496402 22545 raft_consensus.cc:493] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:30.511132 22380 raft_consensus.cc:515] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:30.511204 22545 raft_consensus.cc:515] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.513145 22380 leader_election.cc:290] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:30.513192 22545 leader_election.cc:290] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:30.527554 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b520e89c364692af1aedde2a59c3da" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:30.528456 19467 raft_consensus.cc:2393] T b4b520e89c364692af1aedde2a59c3da P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:30.520563 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:30.532846 22541 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:30.533917 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:30.555361 22541 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:30.562116 22485 consensus_queue.cc:1059] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:30.563711 22547 raft_consensus.cc:3055] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260928 01:56:30.564077 22547 raft_consensus.cc:740] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:30.565917 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet f709eccf4ab5413bbbd8b4746f185db4 (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]) successfully deleted
I20260928 01:56:30.567198 22547 consensus_queue.cc:260] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.568425 22547 raft_consensus.cc:3060] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:30.579638 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:30.582423 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:30.591293 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 387 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:56:30.591926 19126 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e48edd841a42d08a480be209f0d294 in term 6.
I20260928 01:56:30.593281 20456 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 
I20260928 01:56:30.607662 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:30.613678 19621 raft_consensus.cc:1275] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:56:30.613389 22525 raft_consensus.cc:515] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:30.549048 22534 raft_consensus.cc:2749] T a12bafcc09ef4342bff89b0475f721af P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:30.624933 22551 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260928 01:56:30.625455 22551 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:30.627615 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 387 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:30.641268 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:30.648509 19608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:30.649142 19608 raft_consensus.cc:2468] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:30.656391 22551 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 6 FOLLOWER]: Advancing to term 7
I20260928 01:56:30.626355 22541 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
W20260928 01:56:30.640187 20456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 46995.2us
I20260928 01:56:30.663944 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:30.670727 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:30.675745 19621 raft_consensus.cc:1275] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260928 01:56:30.676258 19621 pending_rounds.cc:85] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0: Aborting all ops after (but not including) 1
I20260928 01:56:30.676550 19621 pending_rounds.cc:107] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260928 01:56:30.676874 19621 raft_consensus.cc:2889] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 01:56:30.683044 21909 raft_consensus.cc:2243] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:30.683720 21909 raft_consensus.cc:2272] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Raft consensus is shut down!
W20260928 01:56:30.684748 19412 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:30.692435 21909 ts_tablet_manager.cc:1916] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:30.700425 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d114d5ba862044b4b88eee27395db7e3" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:30.701179 19458 raft_consensus.cc:3060] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:30.713076 22421 consensus_queue.cc:1048] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:30.720098 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet c320eb2ca2ac4ac68293ef8f7400b45f (table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]) successfully deleted
I20260928 01:56:30.722807 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c755f16ea1496eb7fa26fb12e01708" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:30.723097 19613 raft_consensus.cc:1275] T 5442dd0aa28545c8bcf3a0b977c71e98 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:30.724141 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:30.724821 19610 raft_consensus.cc:2468] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:30.726750 22441 raft_consensus.cc:493] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:30.727461 22441 raft_consensus.cc:515] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.730541 19606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea6adefd15a4ea19011419949047e83" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:30.731323 19606 raft_consensus.cc:2393] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:30.732086 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:30.732595 19620 raft_consensus.cc:1275] T c2597de2c4304074977db5a3c0426814 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:30.733335 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b520e89c364692af1aedde2a59c3da" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:30.733608 22441 leader_election.cc:290] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:30.738750 22525 leader_election.cc:290] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:30.739711 19703 leader_election.cc:304] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:30.741086 22532 raft_consensus.cc:2804] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:30.741484 22532 raft_consensus.cc:493] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:30.742158 22532 raft_consensus.cc:3060] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:30.749249 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:30.761469 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d114d5ba862044b4b88eee27395db7e3" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:30.776096 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:30.776768 19611 raft_consensus.cc:2468] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:30.777758 22525 consensus_queue.cc:1048] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:30.780579 22532 raft_consensus.cc:515] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:30.798686 19703 leader_election.cc:343] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:30.810322 19458 raft_consensus.cc:2468] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:30.811686 22179 ts_tablet_manager.cc:1929] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:30.815196 22179 log.cc:1199] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/49a73835e2854976b40b31fe752d1b1b
I20260928 01:56:30.819480 22179 ts_tablet_manager.cc:1950] T 49a73835e2854976b40b31fe752d1b1b P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
W20260928 01:56:30.825809 19556 leader_election.cc:343] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: 89e1d60db21f4a8294792df3fadf5d90
I20260928 01:56:30.826385 19556 leader_election.cc:304] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:30.824788 22551 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
W20260928 01:56:30.827068 19556 raft_consensus.cc:2686] T 89e1d60db21f4a8294792df3fadf5d90 P a3ee288ca1464d20a715673422a214a0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:30.830730 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 43) took 10038 ms. Trace:
I20260928 01:56:30.832244 19409 leader_election.cc:304] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:30.833362 22510 raft_consensus.cc:2804] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:30.845038 22510 raft_consensus.cc:697] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [term 2 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:30.845091 19120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 387 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc"
I20260928 01:56:30.846930 22510 consensus_queue.cc:237] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:30.857695 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:30.858441 19458 raft_consensus.cc:2468] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:30.861442 22179 rpcz_store.cc:276] 0928 01:56:20.792155 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.792279 (+   124us) service_pool.cc:224] Handling call
0928 01:56:30.395293 (+9603014us) ts_tablet_manager.cc:1151] Deleting tablet 49a73835e2854976b40b31fe752d1b1b
0928 01:56:30.395355 (+    62us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:30.572665 (+177310us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:30.811519 (+238854us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:30.830664 (+ 19145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9581986}
I20260928 01:56:30.862998 22179 tablet_replica.cc:333] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:30.868846 20553 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 7 FOLLOWER]: Rejecting Update request from peer c17b7f9972364c76893311539b569e0f for earlier term 6. Current term is 7. Ops: []
W20260928 01:56:30.870860 19703 leader_election.cc:343] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 4 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: f709eccf4ab5413bbbd8b4746f185db4
I20260928 01:56:30.875705 22485 consensus_queue.cc:1048] T c74a4a00552c4a14a871a59465524f1c P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:30.877318 22551 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 election: Requested vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:30.878013 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 7 candidate_status { last_received { term: 6 index: 387 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f"
I20260928 01:56:30.879812 20447 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:30.880512 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 49a73835e2854976b40b31fe752d1b1b (table default.Table_63f36a8d22184eac8a38565457441d09 [id=102958783e204ded94a67a96b0dec09b]) successfully deleted
I20260928 01:56:30.885234 22551 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260928 01:56:30.894364 22408 consensus_queue.cc:1059] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 }, Status: INVALID_TERM, Last received: 6.387, Next index: 388, Last known committed idx: 385, Time since last communication: 0.000s
I20260928 01:56:30.896091 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:30.896771 19467 raft_consensus.cc:3060] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:30.896801 19463 raft_consensus.cc:1275] T c2597de2c4304074977db5a3c0426814 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:30.908104 22485 consensus_queue.cc:1048] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:30.919250 19467 raft_consensus.cc:2468] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:30.904881 19703 leader_election.cc:304] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:30.928045 22179 raft_consensus.cc:2243] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:56:30.929157 22179 raft_consensus.cc:2272] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:30.930258 19703 leader_election.cc:304] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:30.932897 22179 ts_tablet_manager.cc:1916] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:30.935443 22435 raft_consensus.cc:493] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:30.936277 22533 raft_consensus.cc:2804] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:30.940734 22533 raft_consensus.cc:493] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:30.941157 22533 raft_consensus.cc:3060] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:30.939756 22435 raft_consensus.cc:515] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:30.934253 22441 raft_consensus.cc:2804] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:30.933908 22532 leader_election.cc:290] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:30.949038 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf1b727e86a43b08bd464647fa529a3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:30.951663 19756 raft_consensus.cc:1240] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 01:56:30.953235 19187 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60098 (request call id 24) took 1698 ms. Trace:
I20260928 01:56:30.953619 19187 rpcz_store.cc:276] 0928 01:56:29.255180 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.273704 (+ 18524us) service_pool.cc:224] Handling call
0928 01:56:29.276260 (+  2556us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:56:29.297757 (+ 21497us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:56:30.952431 (+1654674us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:56:30.952849 (+   418us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:56:30.953163 (+   314us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:29.889223 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:29.889714 (+   491us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:29.889745 (+    31us) write_op.cc:435] Acquired schema lock
0928 01:56:29.889760 (+    15us) tablet.cc:662] Decoding operations
0928 01:56:29.890103 (+   343us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:29.890150 (+    47us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:29.890186 (+    36us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:56:29.890443 (+   257us) tablet.cc:701] Row locks acquired
0928 01:56:29.890465 (+    22us) write_op.cc:260] PREPARE: finished
0928 01:56:29.890615 (+   150us) write_op.cc:270] Start()
0928 01:56:29.890722 (+   107us) write_op.cc:276] Timestamp: P: 1790560589890551 usec, L: 0
0928 01:56:29.890739 (+    17us) op_driver.cc:348] REPLICATION: starting
0928 01:56:29.891362 (+   623us) log.cc:844] Serialized 433 byte log entry
0928 01:56:30.795421 (+904059us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b5400030d20. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbb5c0 00007f2fcdbc8be8 00007f2fcdbc882a 00007f2fcdc4d125 00007f2fcdc4d5c9 00007f2fce0dd791 00007f2fce0dcf68 00007f2fce0e1c01 00007f2fce0e1bb9 00007f2fce0e1b49 00007f2fce0e1b11
0928 01:56:30.937222 (+141801us) op_driver.cc:464] REPLICATION: finished
0928 01:56:30.949069 (+ 11847us) write_op.cc:301] APPLY: starting
0928 01:56:30.949148 (+    79us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:30.949290 (+   142us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:30.949311 (+    21us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:30.949827 (+   516us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:30.949983 (+   156us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:56:30.950044 (+    61us) write_op.cc:312] APPLY: finished
0928 01:56:30.950290 (+   246us) log.cc:844] Serialized 29 byte log entry
0928 01:56:30.950457 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:30.950531 (+    74us) write_op.cc:454] Released schema lock
0928 01:56:30.950565 (+    34us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":11633,"num_ops":2,"prepare.queue_time_us":590149,"prepare.run_cpu_time_us":16827,"prepare.run_wall_time_us":956302,"raft.queue_time_us":49694,"raft.run_cpu_time_us":19,"raft.run_wall_time_us":22,"replication_time_us":1046369,"spinlock_wait_cycles":1715277056,"thread_start_us":49795,"threads_started":2}]]}
I20260928 01:56:30.958851 19076 master-stress-test.cc:581] Killed test thread 2/10
I20260928 01:56:30.959148 19076 master-stress-test.cc:579] Killing test thread 3/10
I20260928 01:56:30.960125 19759 raft_consensus.cc:1240] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:30.954970 22441 raft_consensus.cc:697] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:30.962100 22441 consensus_queue.cc:237] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:30.966626 22435 leader_election.cc:290] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:30.971920 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 64018.5us
I20260928 01:56:30.972783 19556 leader_election.cc:304] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:30.973635 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:30.978348 22179 ts_tablet_manager.cc:1929] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:30.984705 22179 log.cc:1199] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/c320eb2ca2ac4ac68293ef8f7400b45f
I20260928 01:56:30.985653 22179 ts_tablet_manager.cc:1950] T c320eb2ca2ac4ac68293ef8f7400b45f P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:30.988056 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 44) took 10195 ms. Trace:
I20260928 01:56:30.993355 22179 rpcz_store.cc:276] 0928 01:56:20.793126 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.793274 (+   148us) service_pool.cc:224] Handling call
0928 01:56:30.862772 (+10069498us) ts_tablet_manager.cc:1151] Deleting tablet c320eb2ca2ac4ac68293ef8f7400b45f
0928 01:56:30.862861 (+    89us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:30.970755 (+107894us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:30.978214 (+  7459us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:30.987989 (+  9775us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64000,"tablet-delete.queue_time_us":10049254}
I20260928 01:56:30.995270 22179 tablet_replica.cc:333] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:30.995960 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet c320eb2ca2ac4ac68293ef8f7400b45f (table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]) successfully deleted
I20260928 01:56:30.999202 20553 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 7 FOLLOWER]: Rejecting Update request from peer c17b7f9972364c76893311539b569e0f for earlier term 6. Current term is 7. Ops: [6.388-6.388]
I20260928 01:56:31.000866 19758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.18.161.2:59399 (request call id 1078) took 1115 ms. Trace:
I20260928 01:56:31.002422 22179 raft_consensus.cc:2243] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 3 LEADER]: Raft consensus shutting down.
I20260928 01:56:31.001420 19758 rpcz_store.cc:276] 0928 01:56:29.808861 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.809011 (+   150us) service_pool.cc:224] Handling call
0928 01:56:29.809431 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 01:56:30.418948 (+609517us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 01:56:30.435130 (+ 16182us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 01:56:30.436965 (+  1835us) log.cc:844] Serialized 26 byte log entry
0928 01:56:30.872320 (+435355us) raft_consensus.cc:1645] Marking committed up to 1
0928 01:56:30.872361 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 01:56:30.876942 (+  4581us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 01:56:30.884679 (+  7737us) raft_consensus.cc:1685] finished
0928 01:56:30.895165 (+ 10486us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 01:56:30.924279 (+ 29114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":305144,"raft.queue_time_us":325576,"raft.run_cpu_time_us":472,"raft.run_wall_time_us":473,"thread_start_us":657522,"threads_started":2,"wal-append.queue_time_us":248711}
I20260928 01:56:31.003460 22179 raft_consensus.cc:2272] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:31.005766 22179 ts_tablet_manager.cc:1916] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:30.941908 22573 tablet.cc:1751] T e43bec2c4274497ea73872d0db233eac P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
W20260928 01:56:31.012166 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:31.014701 22562 raft_consensus.cc:3055] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 6 LEADER]: Stepping down as leader of term 6
I20260928 01:56:31.014298 22514 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:31.015316 22514 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: LEADER
I20260928 01:56:31.015365 22562 raft_consensus.cc:740] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c17b7f9972364c76893311539b569e0f, State: Running, Role: LEADER
I20260928 01:56:31.025612 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d114d5ba862044b4b88eee27395db7e3" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:31.012452 22487 raft_consensus.cc:493] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:31.028867 22487 raft_consensus.cc:515] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:31.031189 22487 leader_election.cc:290] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:31.011900 22525 raft_consensus.cc:493] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:31.016686 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca443386942e49d9a66143e1fde777c5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:31.032100 22525 raft_consensus.cc:515] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:31.017935 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:31.033108 22485 raft_consensus.cc:2749] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:31.033656 19762 raft_consensus.cc:2393] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
W20260928 01:56:31.034066 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 61371.5us
I20260928 01:56:31.035749 22525 leader_election.cc:290] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:31.046622 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:31.018611 19764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:31.019678 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:31.048501 19751 raft_consensus.cc:2393] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 3: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:31.018487 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:31.052309 19768 raft_consensus.cc:1275] T 219b7dad56a64a3b813344e0ed9bdbdc P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260928 01:56:31.055751 22228 consensus_queue.cc:1048] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:31.055055 22179 ts_tablet_manager.cc:1929] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.2
I20260928 01:56:31.060752 22179 log.cc:1199] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/12c7284250084d6299cafe8310cfd257
I20260928 01:56:31.061573 22179 ts_tablet_manager.cc:1950] T 12c7284250084d6299cafe8310cfd257 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:31.062409 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:31.067588 22561 consensus_queue.cc:1059] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 }, Status: INVALID_TERM, Last received: 6.387, Next index: 388, Last known committed idx: 385, Time since last communication: 0.013s
I20260928 01:56:31.063534 19610 raft_consensus.cc:3060] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:31.069283 22562 consensus_queue.cc:260] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 387, Committed index: 387, Last appended: 6.388, Last appended by leader: 388, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:31.070645 22562 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 6 FOLLOWER]: Advancing to term 7
I20260928 01:56:31.068357 19621 raft_consensus.cc:2393] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 2: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:31.076001 22533 raft_consensus.cc:515] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:31.077688 19186 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60098 (request call id 25) took 1822 ms. Trace:
I20260928 01:56:31.078066 19186 rpcz_store.cc:276] 0928 01:56:29.255758 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.257788 (+  2030us) service_pool.cc:224] Handling call
0928 01:56:29.262913 (+  5125us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:56:29.295767 (+ 32854us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:56:31.076997 (+1781230us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:56:31.077330 (+   333us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:56:31.077617 (+   287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:29.857414 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:29.857903 (+   489us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:29.857934 (+    31us) write_op.cc:435] Acquired schema lock
0928 01:56:29.858027 (+    93us) tablet.cc:662] Decoding operations
0928 01:56:29.858428 (+   401us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:29.858482 (+    54us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:29.858515 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:56:29.858803 (+   288us) tablet.cc:701] Row locks acquired
0928 01:56:29.858822 (+    19us) write_op.cc:260] PREPARE: finished
0928 01:56:29.886790 (+ 27968us) write_op.cc:270] Start()
0928 01:56:29.886907 (+   117us) write_op.cc:276] Timestamp: P: 1790560589886713 usec, L: 0
0928 01:56:29.886926 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:29.887509 (+   583us) log.cc:844] Serialized 433 byte log entry
0928 01:56:30.853200 (+965691us) op_driver.cc:464] REPLICATION: finished
0928 01:56:30.934980 (+ 81780us) write_op.cc:301] APPLY: starting
0928 01:56:30.935061 (+    81us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:30.935177 (+   116us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:30.935293 (+   116us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:30.935787 (+   494us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:30.935960 (+   173us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:56:30.936005 (+    45us) write_op.cc:312] APPLY: finished
0928 01:56:30.936251 (+   246us) log.cc:844] Serialized 29 byte log entry
0928 01:56:31.076511 (+140260us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:31.076586 (+    75us) write_op.cc:454] Released schema lock
0928 01:56:31.076627 (+    41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":81546,"num_ops":2,"prepare.queue_time_us":559178,"prepare.run_cpu_time_us":2694,"prepare.run_wall_time_us":32273,"raft.queue_time_us":10737,"raft.run_cpu_time_us":884,"raft.run_wall_time_us":885,"replication_time_us":953202,"thread_start_us":179974,"threads_started":2,"wal-append.queue_time_us":16595}]]}
I20260928 01:56:31.082829 19076 master-stress-test.cc:581] Killed test thread 3/10
I20260928 01:56:31.083101 19076 master-stress-test.cc:579] Killing test thread 4/10
I20260928 01:56:31.083326 19076 master-stress-test.cc:581] Killed test thread 4/10
I20260928 01:56:31.083521 19076 master-stress-test.cc:579] Killing test thread 5/10
I20260928 01:56:31.094774 19704 leader_election.cc:304] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:31.097750 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 45) took 10303 ms. Trace:
I20260928 01:56:31.098157 22179 rpcz_store.cc:276] 0928 01:56:20.794317 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.794447 (+   130us) service_pool.cc:224] Handling call
0928 01:56:30.995087 (+10200640us) ts_tablet_manager.cc:1151] Deleting tablet 12c7284250084d6299cafe8310cfd257
0928 01:56:30.995150 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:31.029531 (+ 34381us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:31.054466 (+ 24935us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:31.097662 (+ 43196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33951,"tablet-delete.queue_time_us":10181325}
I20260928 01:56:31.099480 22179 tablet_replica.cc:333] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
W20260928 01:56:31.100523 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 45560us
I20260928 01:56:31.102392 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 12c7284250084d6299cafe8310cfd257 (table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]) successfully deleted
I20260928 01:56:31.100666 22179 raft_consensus.cc:2243] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:31.105825 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:31.111280 22179 raft_consensus.cc:2272] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:31.114358 22179 ts_tablet_manager.cc:1916] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:31.127152 19704 leader_election.cc:304] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:31.142230 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:31.142967 19463 raft_consensus.cc:2468] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:31.144908 19704 leader_election.cc:304] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:31.149617 19610 raft_consensus.cc:2468] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:31.150614 19556 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.153721 21909 ts_tablet_manager.cc:1929] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260928 01:56:31.154156 22487 raft_consensus.cc:2749] T 6ea6adefd15a4ea19011419949047e83 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:31.136183 22525 consensus_queue.cc:1048] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260928 01:56:31.158881 22441 raft_consensus.cc:2749] T 53c755f16ea1496eb7fa26fb12e01708 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:31.170596 22485 raft_consensus.cc:2804] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 01:56:31.171039 22485 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:31.171428 22485 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:56:31.179569 22179 ts_tablet_manager.cc:1929] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:31.180824 22179 log.cc:1199] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/22606f012f1c44bd92c8e0341e9ca2b7
I20260928 01:56:31.182314 19704 leader_election.cc:304] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:31.185714 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:31.186269 22179 ts_tablet_manager.cc:1950] T 22606f012f1c44bd92c8e0341e9ca2b7 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:31.186523 19463 raft_consensus.cc:2468] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
W20260928 01:56:31.190358 19704 leader_election.cc:343] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: 58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:31.190800 19704 leader_election.cc:304] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:31.191720 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:31.192376 19463 raft_consensus.cc:2468] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:31.196218 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 46) took 10401 ms. Trace:
I20260928 01:56:31.196575 22179 rpcz_store.cc:276] 0928 01:56:20.795177 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.795325 (+   148us) service_pool.cc:224] Handling call
0928 01:56:31.099212 (+10303887us) ts_tablet_manager.cc:1151] Deleting tablet 22606f012f1c44bd92c8e0341e9ca2b7
0928 01:56:31.099355 (+   143us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:31.123782 (+ 24427us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:31.179436 (+ 55654us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:31.196065 (+ 16629us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7139,"tablet-delete.queue_time_us":10285322}
I20260928 01:56:31.197983 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 22606f012f1c44bd92c8e0341e9ca2b7 (table default.Table_593e8a23ad954f5b8b209830cbd7ccf9 [id=cb3f94a374cd4a21a132791410361924]) successfully deleted
I20260928 01:56:31.199241 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 47) took 10403 ms. Trace:
I20260928 01:56:31.199579 22179 rpcz_store.cc:276] 0928 01:56:20.795672 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.795847 (+   175us) service_pool.cc:224] Handling call
0928 01:56:31.198710 (+10402863us) ts_tablet_manager.cc:1151] Deleting tablet 58c61408724e4a70b39e5dbdab9a3e8a
0928 01:56:31.198800 (+    90us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:31.199140 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10384632}
W20260928 01:56:31.201293 19180 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 58c61408724e4a70b39e5dbdab9a3e8a because the tablet was not found. No further retry: Not found: Tablet not found: 58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:31.201629 21909 log.cc:1199] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/58c61408724e4a70b39e5dbdab9a3e8a
I20260928 01:56:31.200829 22179 tablet_replica.cc:333] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:31.202010 22228 raft_consensus.cc:2749] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:31.179540 22485 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:31.204807 19556 leader_election.cc:304] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.205670 22380 raft_consensus.cc:2804] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:31.206141 22380 raft_consensus.cc:493] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:31.206700 22380 raft_consensus.cc:3060] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:56:31.218895 22578 catalog_manager.cc:1458] Failed waiting for node to catch up after master election: Illegal state: Node c17b7f9972364c76893311539b569e0f not leader. Raft Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:31.231683 19186 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:60098 (request call id 32) took 1958 ms. Trace:
I20260928 01:56:31.220626 22532 raft_consensus.cc:3060] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:31.244158 19768 raft_consensus.cc:1240] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:31.201753 22529 consensus_queue.cc:1048] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260928 01:56:31.253150 21909 ts_tablet_manager.cc:1950] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:31.254846 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 38) took 17222 ms. Trace:
I20260928 01:56:31.255224 21909 rpcz_store.cc:276] 0928 01:56:14.033293 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:14.033614 (+   321us) service_pool.cc:224] Handling call
0928 01:56:30.112920 (+16079306us) ts_tablet_manager.cc:1151] Deleting tablet 58c61408724e4a70b39e5dbdab9a3e8a
0928 01:56:30.113020 (+   100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:30.960265 (+847245us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:31.153572 (+193307us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:31.254716 (+101144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":567981,"tablet-delete.queue_time_us":16074254}
W20260928 01:56:31.256590 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 51871.8us
I20260928 01:56:31.257411 19556 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.258147 22545 raft_consensus.cc:2804] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 01:56:31.258591 22545 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:31.259069 22545 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:56:31.260876 19556 leader_election.cc:304] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.261621 22546 raft_consensus.cc:2749] T 65fdc8575c7440ffbf5c7c4db5d4b35e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:31.262897 19556 leader_election.cc:304] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.265240 22485 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:31.273854 22546 raft_consensus.cc:2804] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:31.274118 21909 tablet_replica.cc:333] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:31.274425 22546 raft_consensus.cc:493] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:31.274945 22546 raft_consensus.cc:3060] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:31.297009 22533 leader_election.cc:290] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:31.297549 22547 consensus_queue.cc:1048] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:31.299943 19556 leader_election.cc:304] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.300808 22547 raft_consensus.cc:2749] T 5374596938d64cafb9621a1932ca1f68 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:31.302284 19556 leader_election.cc:304] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.321537 22547 raft_consensus.cc:2749] T 45d8d07b367b4fafbd7171f8ea7b2a26 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:31.323233 19556 leader_election.cc:304] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.304487 22380 raft_consensus.cc:515] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:31.314544 22179 raft_consensus.cc:2243] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
W20260928 01:56:31.327612 19704 raft_consensus.cc:2686] T 58c61408724e4a70b39e5dbdab9a3e8a P 8373bfae1f384c36b5e4c5ca26b208da: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:56:31.303139 22546 raft_consensus.cc:515] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:31.329523 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 139200us
I20260928 01:56:31.327852 22380 leader_election.cc:290] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:31.330590 22547 raft_consensus.cc:2804] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:31.336407 22547 raft_consensus.cc:493] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:31.336971 22547 raft_consensus.cc:3060] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:31.340124 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:31.331231 22179 raft_consensus.cc:2272] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:31.343786 22179 ts_tablet_manager.cc:1916] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:31.332011 19556 leader_election.cc:304] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.365310 19556 leader_election.cc:304] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.366272 22485 raft_consensus.cc:2804] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:31.366993 22485 raft_consensus.cc:493] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:31.367583 22485 raft_consensus.cc:3060] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:31.373005 19556 leader_election.cc:304] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.374643 22380 raft_consensus.cc:2749] T 202f1ead822548a2bbeae4e4d3cf9be8 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:31.377790 22546 leader_election.cc:290] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:31.389094 19555 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:31.386072 22425 raft_consensus.cc:2749] T 9a9c2db89fb8467d91c6bd01985d8b40 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:31.389683 19186 rpcz_store.cc:276] 0928 01:56:29.273365 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:31.230585 (+1957220us) service_pool.cc:224] Handling call
0928 01:56:31.231564 (+   979us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 01:56:31.386792 22545 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:31.393424 22545 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:31.393811 19823 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.18.161.61:43775)
W20260928 01:56:31.392630 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 62454us
I20260928 01:56:31.399544 19704 leader_election.cc:304] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:31.403681 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:31.404686 22547 raft_consensus.cc:515] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:31.382407 22485 raft_consensus.cc:515] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:31.387938 19556 leader_election.cc:304] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.414535 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:31.415694 22380 raft_consensus.cc:2749] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:31.420881 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:31.420717 22380 consensus_queue.cc:1059] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:31.423210 22425 raft_consensus.cc:3055] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:31.423565 22425 raft_consensus.cc:740] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:31.424400 22425 consensus_queue.cc:260] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:31.425321 22425 raft_consensus.cc:3060] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:56:31.425155 19704 leader_election.cc:343] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 4 pre-election: Tablet error from VoteRequest() call to peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Not found: Tablet not found: f709eccf4ab5413bbbd8b4746f185db4
I20260928 01:56:31.427752 19704 leader_election.cc:304] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:31.425603 22533 raft_consensus.cc:2749] T 502c0f4e07ff4479af8d33c99031b6fc P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:56:31.429239 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:31.432502 22532 raft_consensus.cc:2749] T b4b520e89c364692af1aedde2a59c3da P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:31.435899 22546 consensus_queue.cc:1059] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 01:56:31.437180 22546 raft_consensus.cc:3055] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:31.445349 22546 raft_consensus.cc:740] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:31.449219 22546 consensus_queue.cc:260] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:31.450901 22562 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:31.451512 22546 raft_consensus.cc:3060] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:31.451504 22562 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:31.455823 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 388 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:56:31.461524 22361 raft_consensus.cc:2749] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:56:31.463333 22485 leader_election.cc:290] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:31.464294 22583 raft_consensus.cc:493] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:31.465574 22583 raft_consensus.cc:515] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:31.467774 22583 leader_election.cc:290] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:31.468291 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 48437.8us
I20260928 01:56:31.473130 22545 consensus_queue.cc:1048] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:31.480250 22562 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:31.477780 19556 leader_election.cc:304] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.488157 19703 leader_election.cc:304] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:31.492288 22529 raft_consensus.cc:2804] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:31.493225 22529 raft_consensus.cc:697] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:31.494139 22529 consensus_queue.cc:237] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:31.495468 22545 raft_consensus.cc:2749] T 99e806ba248746d2bde39a2eb76b17df P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:31.498615 22591 consensus_queue.cc:1048] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:31.502638 19556 leader_election.cc:304] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.504653 19556 leader_election.cc:304] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.506482 19556 leader_election.cc:304] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.509784 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 388 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:31.510478 20553 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c17b7f9972364c76893311539b569e0f in term 7.
I20260928 01:56:31.521548 22592 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:31.511991 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:56:31.523409 22514 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260928 01:56:31.523945 22514 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:31.524492 22514 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 7 FOLLOWER]: Advancing to term 8
I20260928 01:56:31.545457 22585 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:31.546133 22585 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:31.549407 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 8 candidate_status { last_received { term: 6 index: 387 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:56:31.550966 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 8 candidate_status { last_received { term: 6 index: 387 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:31.578608 22590 raft_consensus.cc:2749] T 65d70a8be7244c86864187420a4fd5f5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:31.579015 22591 raft_consensus.cc:2749] T ba89039dcfa848159112caa76802b5f1 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:31.585608 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 79208.7us
I20260928 01:56:31.522552 22592 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:31.587288 19126 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e48edd841a42d08a480be209f0d294 for term 8 because replica has last-logged OpId of term: 6 index: 388, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 387.
I20260928 01:56:31.591941 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 388 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:31.592870 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf1b727e86a43b08bd464647fa529a3" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:31.594177 19618 raft_consensus.cc:1240] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:31.597299 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:31.601051 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca443386942e49d9a66143e1fde777c5" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:31.583889 22485 raft_consensus.cc:2804] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:31.603965 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:31.604745 19467 raft_consensus.cc:2468] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:31.606961 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f3e966ab0d46d187fb9daa356b16fc" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:31.609335 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f4708c641414aa59f01703c86aaf1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:31.610297 19467 raft_consensus.cc:2393] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 3: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
W20260928 01:56:31.611485 19412 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:31.613186 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee6d48172044c74aacd4b78683efb66" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:31.621236 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 58c61408724e4a70b39e5dbdab9a3e8a (table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]) successfully deleted
I20260928 01:56:31.623361 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:31.624063 19616 raft_consensus.cc:2393] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 2: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:31.591117 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:31.625478 19610 raft_consensus.cc:2393] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 2: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:31.629724 22585 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:31.632187 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 388 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:31.632992 20553 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81ebb46a410e43ebaec3ef4dd13a71fc in current term 7: Already voted for candidate 04e48edd841a42d08a480be209f0d294 in this term.
I20260928 01:56:31.633374 19412 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:31.634073 22563 raft_consensus.cc:2749] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:56:31.634605 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 04e48edd841a42d08a480be209f0d294, c17b7f9972364c76893311539b569e0f
I20260928 01:56:31.635445 19412 leader_election.cc:304] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:31.635207 22599 tablet.cc:1751] T e43bec2c4274497ea73872d0db233eac P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:56:31.636165 22563 raft_consensus.cc:2749] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:31.648497 22563 consensus_queue.cc:1048] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:31.605857 22485 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:31.650125 22485 raft_consensus.cc:3060] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:31.655184 22592 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:31.665693 22179 ts_tablet_manager.cc:1929] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:31.626677 22514 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:31.672605 19197 raft_consensus.cc:2393] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e48edd841a42d08a480be209f0d294 in current term 8: Already voted for candidate c17b7f9972364c76893311539b569e0f in this term.
I20260928 01:56:31.675731 20447 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:31.681342 22585 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 7 FOLLOWER]: Advancing to term 8
I20260928 01:56:31.699344 19463 raft_consensus.cc:1240] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 01:56:31.704280 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 388 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc"
I20260928 01:56:31.708582 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 388 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294"
I20260928 01:56:31.710511 22514 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 8 election: Requested vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:31.718731 22179 log.cc:1199] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/7daa1b799e0d408287edc03988f5b683
I20260928 01:56:31.719534 22179 ts_tablet_manager.cc:1950] T 7daa1b799e0d408287edc03988f5b683 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:31.620523 22547 leader_election.cc:290] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:31.706609 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:31.721421 19610 raft_consensus.cc:2393] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 2: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:31.723795 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 39) took 10935 ms. Trace:
I20260928 01:56:31.724159 22179 rpcz_store.cc:276] 0928 01:56:20.788280 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.788711 (+   431us) service_pool.cc:224] Handling call
0928 01:56:31.200630 (+10411919us) ts_tablet_manager.cc:1151] Deleting tablet 7daa1b799e0d408287edc03988f5b683
0928 01:56:31.200712 (+    82us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:31.357498 (+156786us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:31.665546 (+308048us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:31.723724 (+ 58178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117873,"tablet-delete.queue_time_us":10386214}
I20260928 01:56:31.728451 22563 raft_consensus.cc:493] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:31.729117 22563 raft_consensus.cc:515] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:31.732108 22563 leader_election.cc:290] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:31.682410 22602 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 6 FOLLOWER]: Advancing to term 7
W20260928 01:56:31.684366 19104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 49846.6us
I20260928 01:56:31.740024 19610 raft_consensus.cc:1240] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 1. Current term is 2. Ops: []
W20260928 01:56:31.747332 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 52329us
I20260928 01:56:31.748359 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:31.753238 19703 leader_election.cc:304] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:56:31.756807 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:31.758872 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:31.764664 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:31.774065 19468 raft_consensus.cc:2468] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:31.780831 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:31.801930 22585 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260928 01:56:31.802750 22581 raft_consensus.cc:2804] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:31.803182 22581 raft_consensus.cc:493] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:31.803544 22581 raft_consensus.cc:3060] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:31.806924 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:31.808678 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:31.811666 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
W20260928 01:56:31.812832 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 59680.9us
I20260928 01:56:31.814999 22581 raft_consensus.cc:515] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:31.817452 22581 leader_election.cc:290] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:31.822115 19703 leader_election.cc:304] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:31.824265 22441 raft_consensus.cc:2804] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:31.824651 22441 raft_consensus.cc:493] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:31.825029 22441 raft_consensus.cc:3060] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:31.832562 21909 raft_consensus.cc:2243] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:31.833194 21909 raft_consensus.cc:2272] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:31.835505 21909 ts_tablet_manager.cc:1916] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:31.745677 19606 raft_consensus.cc:1275] T 2c007b068b1d414298cce3fe44a91daa P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260928 01:56:31.718154 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 246349us
I20260928 01:56:31.845952 22179 tablet_replica.cc:333] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:31.846930 22179 raft_consensus.cc:2243] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:31.812291 19619 raft_consensus.cc:1240] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 3. Current term is 4. Ops: []
I20260928 01:56:31.846839 22583 consensus_queue.cc:1048] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:31.848392 22589 consensus_queue.cc:1059] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:31.849201 22589 consensus_queue.cc:1243] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer 8373bfae1f384c36b5e4c5ca26b208da log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260928 01:56:31.849767 22589 raft_consensus.cc:3055] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:31.850167 22589 raft_consensus.cc:740] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:31.851007 22589 consensus_queue.cc:260] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:31.852221 22589 raft_consensus.cc:3060] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:31.736064 22485 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:31.839151 19703 leader_election.cc:304] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:31.868230 22563 raft_consensus.cc:493] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:31.868830 22563 raft_consensus.cc:515] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:31.871100 22563 leader_election.cc:290] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:31.878046 22614 consensus_queue.cc:1048] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:31.880034 22529 consensus_queue.cc:1059] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 01:56:31.880414 19412 leader_election.cc:304] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.882114 22529 raft_consensus.cc:3055] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:31.882453 22529 raft_consensus.cc:740] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:31.883188 22529 consensus_queue.cc:260] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:31.884390 22529 raft_consensus.cc:3060] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:31.891566 19556 leader_election.cc:304] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.895114 22421 raft_consensus.cc:2804] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:31.833403 22441 raft_consensus.cc:515] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:31.895550 22421 raft_consensus.cc:493] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:31.895875 22421 raft_consensus.cc:3060] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:31.896813 22602 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:56:31.897683 19126 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 7 FOLLOWER]: Advancing to term 8
I20260928 01:56:31.899819 22441 leader_election.cc:290] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:31.904472 19126 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c17b7f9972364c76893311539b569e0f in term 8.
I20260928 01:56:31.909494 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f; no voters: 
I20260928 01:56:31.911948 22514 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 8 FOLLOWER]: Leader election won for term 8
I20260928 01:56:31.912783 22514 raft_consensus.cc:697] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 8 LEADER]: Becoming Leader. State: Replica: c17b7f9972364c76893311539b569e0f, State: Running, Role: LEADER
I20260928 01:56:31.914752 22514 consensus_queue.cc:237] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 387, Committed index: 387, Last appended: 6.388, Last appended by leader: 388, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:31.919667 22562 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17b7f9972364c76893311539b569e0f. Latest consensus state: current_term: 8 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:31.920455 22562 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: LEADER
W20260928 01:56:31.928737 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 89649.1us
I20260928 01:56:31.929589 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 7daa1b799e0d408287edc03988f5b683 (table default.Table_7b0eeaea0af144bf8165b6228c454e7e [id=a051e78b19ab4fe1be3db9e064eaf56d]) successfully deleted
W20260928 01:56:31.934434 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 52566.4us
I20260928 01:56:31.935469 19412 leader_election.cc:304] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:31.939309 22614 raft_consensus.cc:2749] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:31.925853 19556 leader_election.cc:304] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:31.942818 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 73265.9us
I20260928 01:56:31.947860 20553 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c17b7f9972364c76893311539b569e0f in term 8.
I20260928 01:56:31.952836 19412 leader_election.cc:304] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.954739 22563 consensus_queue.cc:1048] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:31.955178 22615 raft_consensus.cc:2804] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:31.955626 22615 raft_consensus.cc:493] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:31.955951 22615 raft_consensus.cc:3060] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:31.973219 22421 raft_consensus.cc:515] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:31.989534 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 63762.1us
I20260928 01:56:31.990504 19556 leader_election.cc:304] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.991999 19556 leader_election.cc:304] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:31.947417 22532 raft_consensus.cc:2804] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:31.992834 22532 raft_consensus.cc:493] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:31.993273 22532 raft_consensus.cc:3060] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:31.993922 22421 leader_election.cc:290] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:32.006829 22532 raft_consensus.cc:515] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:32.009152 22532 leader_election.cc:290] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:32.012566 22179 raft_consensus.cc:2272] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:32.013449 19556 leader_election.cc:304] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:32.014174 19621 raft_consensus.cc:1240] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 2. Current term is 3. Ops: []
W20260928 01:56:32.017177 19411 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.62:38511, user_credentials={real_user=slave}} blocked reactor thread for 49717.5us
I20260928 01:56:32.003665 22615 raft_consensus.cc:515] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:32.020254 22615 leader_election.cc:290] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:31.950886 19814 heartbeater.cc:344] Connected to a master server at 127.18.161.61:43775
I20260928 01:56:31.926198 22545 raft_consensus.cc:2749] T fcf1b727e86a43b08bd464647fa529a3 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:32.036612 19814 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:32.037423 19469 raft_consensus.cc:1275] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260928 01:56:32.037787 19469 pending_rounds.cc:85] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614: Aborting all ops after (but not including) 2
I20260928 01:56:32.038017 19469 pending_rounds.cc:107] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260928 01:56:32.038251 19469 raft_consensus.cc:2889] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 01:56:31.952342 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
W20260928 01:56:32.042150 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 45075.9us
W20260928 01:56:32.051892 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 105791us
I20260928 01:56:32.016175 22425 raft_consensus.cc:2749] T ca443386942e49d9a66143e1fde777c5 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:31.969455 21909 ts_tablet_manager.cc:1929] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.2
W20260928 01:56:31.948472 19704 consensus_peers.cc:597] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da -> Peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): Couldn't send request to peer a3ee288ca1464d20a715673422a214a0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49a73835e2854976b40b31fe752d1b1b. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:32.024682 19759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:32.061830 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 113465us
I20260928 01:56:32.072229 21909 log.cc:1199] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/12c7284250084d6299cafe8310cfd257
I20260928 01:56:32.025463 22590 raft_consensus.cc:2804] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:32.074661 22596 raft_consensus.cc:2749] T 9ec3f279423a46c1acb1cbfecf4a608a P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:32.077230 22179 ts_tablet_manager.cc:1916] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:32.081766 21909 ts_tablet_manager.cc:1950] T 12c7284250084d6299cafe8310cfd257 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:32.085549 22485 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:32.087841 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 40) took 18047 ms. Trace:
I20260928 01:56:32.072615 22590 raft_consensus.cc:493] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:32.097865 22590 raft_consensus.cc:3060] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:32.073989 22589 raft_consensus.cc:2749] T c9f3e966ab0d46d187fb9daa356b16fc P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:32.098852 22581 consensus_queue.cc:1059] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:32.105536 22533 consensus_queue.cc:1048] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:32.110414 22532 consensus_queue.cc:1059] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:32.117408 21909 rpcz_store.cc:276] 0928 01:56:14.040933 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:14.041368 (+   435us) service_pool.cc:224] Handling call
0928 01:56:31.273642 (+17232274us) ts_tablet_manager.cc:1151] Deleting tablet 12c7284250084d6299cafe8310cfd257
0928 01:56:31.273815 (+   173us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:31.873887 (+600072us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:31.969314 (+ 95427us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:32.087780 (+118466us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":556844,"tablet-delete.queue_time_us":17230005}
I20260928 01:56:32.176331 19469 raft_consensus.cc:1275] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:32.176573 21909 tablet_replica.cc:333] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:32.177090 22532 raft_consensus.cc:3055] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Stepping down as leader of term 3
I20260928 01:56:32.177635 22532 raft_consensus.cc:740] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:32.179919 22532 consensus_queue.cc:260] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:32.181669 22532 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:56:32.183048 22590 raft_consensus.cc:515] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:32.185602 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:32.193966 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:32.195047 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:32.195820 19618 raft_consensus.cc:2393] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 2: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:32.197148 19606 raft_consensus.cc:1275] T d114d5ba862044b4b88eee27395db7e3 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:32.209658 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:32.210775 19618 raft_consensus.cc:2393] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 2: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:32.210632 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:32.211344 19761 raft_consensus.cc:3060] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:32.220645 22581 raft_consensus.cc:3055] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:32.221357 22581 raft_consensus.cc:740] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:32.222548 22581 consensus_queue.cc:260] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:32.224345 22581 raft_consensus.cc:3060] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:32.233729 19759 raft_consensus.cc:1275] T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 01:56:32.242657 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:32.243413 19467 raft_consensus.cc:2368] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da for earlier term 2. Current term is 3.
I20260928 01:56:32.244244 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:32.244937 19768 raft_consensus.cc:3060] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:32.246080 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:32.253628 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 12c7284250084d6299cafe8310cfd257 (table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]) successfully deleted
W20260928 01:56:32.269721 19703 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 70474.6us
I20260928 01:56:32.270610 19703 leader_election.cc:304] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:56:32.275170 22179 ts_tablet_manager.cc:1929] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:56:32.285102 22179 log.cc:1199] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/c1f73a301c84482f897990ac5e5dd162
I20260928 01:56:32.301762 22590 leader_election.cc:290] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:32.324677 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 311280us
I20260928 01:56:32.326802 19556 leader_election.cc:304] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:32.328363 19556 leader_election.cc:304] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:32.328975 22631 raft_consensus.cc:2749] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:32.332897 22627 raft_consensus.cc:2749] T 4ee6d48172044c74aacd4b78683efb66 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:32.335794 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:32.336576 22629 consensus_queue.cc:1048] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:32.338188 22179 ts_tablet_manager.cc:1950] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:32.338392 19556 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:32.346848 19467 raft_consensus.cc:2468] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:32.360641 22629 raft_consensus.cc:2749] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260928 01:56:32.361951 19556 leader_election.cc:304] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:32.362387 22529 consensus_queue.cc:1059] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260928 01:56:32.363624 22525 raft_consensus.cc:3055] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Stepping down as leader of term 2
I20260928 01:56:32.363735 19556 leader_election.cc:304] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:32.364032 22525 raft_consensus.cc:740] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:32.364413 22590 raft_consensus.cc:2749] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:32.365274 22629 raft_consensus.cc:2749] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:32.374974 19556 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:32.384478 22590 raft_consensus.cc:2749] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260928 01:56:32.385867 19556 leader_election.cc:304] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:32.389643 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 117682us
I20260928 01:56:32.390528 22590 raft_consensus.cc:2749] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260928 01:56:32.392853 19556 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
I20260928 01:56:32.393990 22525 consensus_queue.cc:260] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:32.395327 22525 raft_consensus.cc:3060] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:32.350121 22619 raft_consensus.cc:493] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:32.401015 22619 raft_consensus.cc:515] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:32.402392 22627 consensus_queue.cc:1048] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:32.403466 22619 leader_election.cc:290] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:32.411952 20553 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 8 FOLLOWER]: Refusing update from remote peer c17b7f9972364c76893311539b569e0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 387. Preceding OpId from leader: term: 8 index: 389. (index mismatch)
I20260928 01:56:32.414271 22514 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 389, Last known committed idx: 385, Time since last communication: 0.001s
I20260928 01:56:32.416592 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:32.432282 19126 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 8 FOLLOWER]: Refusing update from remote peer c17b7f9972364c76893311539b569e0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 388. Preceding OpId from leader: term: 8 index: 389. (index mismatch)
I20260928 01:56:32.435711 22514 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 389, Last known committed idx: 387, Time since last communication: 0.001s
I20260928 01:56:32.436702 22620 consensus_queue.cc:1048] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:32.436939 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:32.438073 19762 raft_consensus.cc:2393] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
W20260928 01:56:32.444427 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 54074.4us
I20260928 01:56:32.468844 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:32.498719 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:32.502542 19553 leader_election.cc:343] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: c1f73a301c84482f897990ac5e5dd162
I20260928 01:56:32.503013 19553 leader_election.cc:304] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:32.494407 22628 consensus_queue.cc:1048] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260928 01:56:32.503925 19606 raft_consensus.cc:1240] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:32.505465 22631 raft_consensus.cc:493] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:32.505947 22631 raft_consensus.cc:515] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:32.513312 19618 raft_consensus.cc:1240] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 3. Current term is 4. Ops: []
I20260928 01:56:32.522760 19611 raft_consensus.cc:1240] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:32.508123 22631 leader_election.cc:290] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:32.532850 22638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17b7f9972364c76893311539b569e0f. Latest consensus state: current_term: 8 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:32.533215 22614 raft_consensus.cc:493] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:32.533577 22638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:56:32.533703 22614 raft_consensus.cc:515] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:32.535923 22614 leader_election.cc:290] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:32.541827 22614 raft_consensus.cc:493] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:32.542521 22614 raft_consensus.cc:515] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:32.551450 22585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17b7f9972364c76893311539b569e0f. Latest consensus state: current_term: 8 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:32.552420 22585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:56:32.553747 19467 raft_consensus.cc:2468] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:32.561753 22614 leader_election.cc:290] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:32.586308 19553 raft_consensus.cc:2686] T c1f73a301c84482f897990ac5e5dd162 P a3ee288ca1464d20a715673422a214a0: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 01:56:32.586910 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 84416.5us
I20260928 01:56:32.595840 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea77f3197ee5496d9624cc76b3361ace" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:32.602532 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 48) took 11805 ms. Trace:
I20260928 01:56:32.610550 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:32.615533 19179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 57465.8us
I20260928 01:56:32.629194 22179 rpcz_store.cc:276] 0928 01:56:20.796643 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:20.797372 (+   729us) service_pool.cc:224] Handling call
0928 01:56:31.845767 (+11048395us) ts_tablet_manager.cc:1151] Deleting tablet c1f73a301c84482f897990ac5e5dd162
0928 01:56:31.845830 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:32.148319 (+302489us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:32.275017 (+126698us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:32.589864 (+314847us) spinlock_profiling.cc:243] Waited 95.6 ms on lock 0x7b5800000f98. stack: 00007fd5309ed323 00007fd5309ed220 00007fd530591574 0000000000516964 00000000005168f9 00007fd5308a38a1 00007fd5309e7b51 00007fd5309e8182 00007fd53995b2c9 00007fd538b6c918 00007fd538c352be 00007fd538c38289 00007fd538c6110e 00007fd538c610d9 00007fd538c61095 00007fd538c52296
0928 01:56:32.602438 (+ 12574us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31383,"spinlock_wait_cycles":219816320,"tablet-delete.queue_time_us":11031068}
I20260928 01:56:32.651427 22585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:32.652159 22585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 01:56:32.654161 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 176785us
I20260928 01:56:32.442255 19761 raft_consensus.cc:2468] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:32.669059 22620 raft_consensus.cc:493] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:32.669569 22620 raft_consensus.cc:515] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:32.673264 22620 leader_election.cc:290] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:32.675369 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 65) took 6146 ms. Trace:
I20260928 01:56:32.687206 19768 raft_consensus.cc:2468] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:32.692610 22179 rpcz_store.cc:276] 0928 01:56:26.529042 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:26.534700 (+  5658us) service_pool.cc:224] Handling call
0928 01:56:32.674973 (+6140273us) ts_tablet_manager.cc:1151] Deleting tablet 7ab79c6ad03e481a903a0f95ae0512e6
0928 01:56:32.675033 (+    60us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:32.675288 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6139575}
W20260928 01:56:32.696830 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 77343.1us
W20260928 01:56:32.707346 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 228733us
I20260928 01:56:32.716166 22638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:32.716907 22638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:56:32.678421 22631 consensus_queue.cc:1048] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:32.723294 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 59) took 6196 ms. Trace:
I20260928 01:56:32.723714 22179 rpcz_store.cc:276] 0928 01:56:26.527190 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:26.527304 (+   114us) service_pool.cc:224] Handling call
0928 01:56:32.722936 (+6195632us) ts_tablet_manager.cc:1151] Deleting tablet eac01fc222dd480cbed7cac37a0e6693
0928 01:56:32.723001 (+    65us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:32.723230 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6182297}
I20260928 01:56:32.725015 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 63) took 6196 ms. Trace:
I20260928 01:56:32.725419 22179 rpcz_store.cc:276] 0928 01:56:26.528515 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:26.530695 (+  2180us) service_pool.cc:224] Handling call
0928 01:56:32.724731 (+6194036us) ts_tablet_manager.cc:1151] Deleting tablet 22fc9eff28c4436fb383c3d7169171bb
0928 01:56:32.724784 (+    53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:32.724964 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6183902}
I20260928 01:56:32.734098 22228 consensus_queue.cc:1048] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:32.740703 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:32.741549 19184 catalog_manager.cc:5838] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 1 to 2, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 2 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:32.743732 19184 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:32.667716 22648 tablet.cc:1751] T e43bec2c4274497ea73872d0db233eac P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:56:32.687799 19553 leader_election.cc:304] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:32.677363 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f65b0966c04012bfec3c67a37acc25" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:32.707917 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2018f8b52f974554924f9ecfbd5a0f51" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:32.703024 22533 raft_consensus.cc:2764] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260928 01:56:32.754127 21909 raft_consensus.cc:2243] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:32.762666 22647 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:32.763592 22647 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: LEADER
I20260928 01:56:32.764425 22514 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "c17b7f9972364c76893311539b569e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:32.765563 22514 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: LEADER
I20260928 01:56:32.771847 21909 raft_consensus.cc:2272] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:32.774363 21909 ts_tablet_manager.cc:1916] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:32.774976 22581 consensus_meta.cc:287] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.001s
I20260928 01:56:32.781181 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:32.782025 19762 raft_consensus.cc:2393] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:32.785347 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:32.785578 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:32.788246 22532 consensus_meta.cc:287] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.000s
I20260928 01:56:32.740573 19619 raft_consensus.cc:1275] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260928 01:56:32.804674 19619 pending_rounds.cc:85] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0: Aborting all ops after (but not including) 0
I20260928 01:56:32.804889 19619 pending_rounds.cc:107] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260928 01:56:32.805121 19619 raft_consensus.cc:2889] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 01:56:32.742765 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c007b068b1d414298cce3fe44a91daa" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:32.749251 22631 raft_consensus.cc:2749] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:56:32.726676 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 64) took 6197 ms. Trace:
I20260928 01:56:32.809177 22179 rpcz_store.cc:276] 0928 01:56:26.528777 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:26.531228 (+  2451us) service_pool.cc:224] Handling call
0928 01:56:32.726383 (+6195155us) ts_tablet_manager.cc:1151] Deleting tablet 57a81b9455a340728fea713318e1e77a
0928 01:56:32.726436 (+    53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:32.726620 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6185377}
I20260928 01:56:32.810498 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 66) took 6281 ms. Trace:
I20260928 01:56:32.810848 22179 rpcz_store.cc:276] 0928 01:56:26.529319 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:26.531682 (+  2363us) service_pool.cc:224] Handling call
0928 01:56:32.810113 (+6278431us) ts_tablet_manager.cc:1151] Deleting tablet 158edf7a5d724c88992fecbadd2cedfa
0928 01:56:32.810248 (+   135us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:32.810443 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6268927}
I20260928 01:56:32.812005 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 67) took 6282 ms. Trace:
I20260928 01:56:32.815573 22361 consensus_queue.cc:1059] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260928 01:56:32.817209 22532 raft_consensus.cc:3055] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:32.817611 22532 raft_consensus.cc:740] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:32.818524 22532 consensus_queue.cc:260] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
W20260928 01:56:32.852727 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 84509.6us
I20260928 01:56:32.860594 22361 consensus_queue.cc:1059] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 01:56:32.854666 22532 raft_consensus.cc:3060] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:32.862176 22581 raft_consensus.cc:3055] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Stepping down as leader of term 3
I20260928 01:56:32.866729 22581 raft_consensus.cc:740] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:32.867815 22581 consensus_queue.cc:260] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:32.869238 22581 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:56:32.886420 22179 rpcz_store.cc:276] 0928 01:56:26.529644 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:26.532165 (+  2521us) service_pool.cc:224] Handling call
0928 01:56:32.811729 (+6279564us) ts_tablet_manager.cc:1151] Deleting tablet 9ca0b52215454a99b6c5d1956088829a
0928 01:56:32.811777 (+    48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:32.811957 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6270381}
W20260928 01:56:32.895013 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 240230us
I20260928 01:56:32.749835 19610 raft_consensus.cc:3060] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:32.774540 19608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:32.749819 19621 raft_consensus.cc:3060] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:32.838131 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e1e1f2630411f8b070d8ca99e8ffb" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:32.851523 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:32.904835 19608 raft_consensus.cc:2468] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
W20260928 01:56:32.749577 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 70071.8us
I20260928 01:56:32.934515 22636 consensus_queue.cc:1059] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:32.936861 22653 raft_consensus.cc:3055] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:32.937397 22653 raft_consensus.cc:740] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:32.938221 22653 consensus_queue.cc:260] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:32.939014 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:32.939357 22653 raft_consensus.cc:3060] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:32.939596 19469 raft_consensus.cc:2468] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:32.969573 19412 leader_election.cc:304] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:32.928658 22546 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:32.973951 22546 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:32.975091 19610 raft_consensus.cc:2468] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:32.975981 22546 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:32.982482 22614 raft_consensus.cc:2749] T ea77f3197ee5496d9624cc76b3361ace P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:32.983420 19621 raft_consensus.cc:2468] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:32.985773 19412 leader_election.cc:304] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:32.987229 22619 raft_consensus.cc:2749] T 219b7dad56a64a3b813344e0ed9bdbdc P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:56:32.994405 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 70) took 6336 ms. Trace:
I20260928 01:56:32.997779 22179 rpcz_store.cc:276] 0928 01:56:26.657609 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:26.657720 (+   111us) service_pool.cc:224] Handling call
0928 01:56:32.921373 (+6263653us) ts_tablet_manager.cc:1151] Deleting tablet 0ae3663fbe024a4e946e47339a4b9090
0928 01:56:32.929952 (+  8579us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:32.994343 (+ 64391us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6262996}
I20260928 01:56:33.000538 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 72) took 6342 ms. Trace:
W20260928 01:56:33.016324 22618 op_tracker.cc:284] OpTracker waiting for 2 outstanding ops to complete now for 1.093s
I20260928 01:56:33.016690 22618 op_tracker.cc:286] Dumping up to 50 currently running ops: 
I20260928 01:56:33.016888 22618 op_tracker.cc:290] NR-NP WriteOp [type=LEADER, start_time=2287-12-15 08:28:50, state=WriteOpState 0x7b5800100e00 [op_id=(), ts=<unassigned>, rows=[]]]
I20260928 01:56:33.017393 22618 op_tracker.cc:290] R-P WriteOp [type=LEADER, start_time=2026-09-28 01:56:32, state=WriteOpState 0x7b5800110a00 [op_id=(), ts=7334136188630769664, rows=[INSERT (int8 entry_type=<redacted>, string entry_id=<redacted>, string metadata=<redacted>), MUTATE (int8 entry_type=<redacted>, string entry_id=<redacted>) SET metadata=<redacted>]]]
I20260928 01:56:33.027664 22529 consensus_queue.cc:1048] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:33.033977 19703 leader_election.cc:304] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:33.037848 19409 leader_election.cc:304] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:33.039310 22614 raft_consensus.cc:2804] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:33.040403 22614 raft_consensus.cc:697] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [term 3 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:33.041838 22614 consensus_queue.cc:237] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:33.051592 19409 leader_election.cc:304] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:56:33.013659 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 64175.7us
I20260928 01:56:33.067983 22649 raft_consensus.cc:2804] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:33.068519 22649 raft_consensus.cc:697] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 3 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:33.069334 22649 consensus_queue.cc:237] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:33.053325 22179 rpcz_store.cc:276] 0928 01:56:26.658214 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:26.658312 (+    98us) service_pool.cc:224] Handling call
0928 01:56:33.000016 (+6341704us) ts_tablet_manager.cc:1151] Deleting tablet e05925303152462e8ca25cd15f3bedff
0928 01:56:33.000079 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:33.000469 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6341142}
I20260928 01:56:33.078615 22652 raft_consensus.cc:2749] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260928 01:56:33.087484 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 57911us
W20260928 01:56:33.132532 22661 log.cc:927] Time spent T e6206afe245740b1819069a48e8b548e P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260928 01:56:33.136955 19703 leader_election.cc:400] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Vote denied by peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) with higher term. Message: Invalid argument: T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da for earlier term 2. Current term is 3.
I20260928 01:56:33.137466 19703 leader_election.cc:403] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260928 01:56:33.173321 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 100326us
I20260928 01:56:33.176224 22652 raft_consensus.cc:2749] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) with higher term. Message: Invalid argument: T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da for earlier term 2. Current term is 3.
I20260928 01:56:33.186506 22529 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:33.187276 22529 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:33.189893 22529 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:33.194716 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 49121.4us
I20260928 01:56:33.198887 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:33.199620 19758 raft_consensus.cc:2468] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:33.201437 22614 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:33.202180 19758 raft_consensus.cc:1240] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 1. Current term is 2. Ops: []
I20260928 01:56:33.202011 22614 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:33.204124 22614 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:33.205312 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet c1f73a301c84482f897990ac5e5dd162 (table default.Table_9aeb2b485111496ea1fed85fd4c55531 [id=c6da5b1f292748818838b53ed38d64a3]) successfully deleted
I20260928 01:56:33.218428 21909 ts_tablet_manager.cc:1929] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:33.239936 22615 consensus_queue.cc:1048] T e6206afe245740b1819069a48e8b548e P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:56:33.242491 19412 leader_election.cc:304] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:33.243794 22649 raft_consensus.cc:2749] T 2c007b068b1d414298cce3fe44a91daa P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:56:33.261334 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:33.262042 19610 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
W20260928 01:56:33.281253 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 102114us
W20260928 01:56:33.295648 19180 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 7ab79c6ad03e481a903a0f95ae0512e6 because the tablet was not found. No further retry: Not found: Tablet not found: 7ab79c6ad03e481a903a0f95ae0512e6
W20260928 01:56:33.297299 19180 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet eac01fc222dd480cbed7cac37a0e6693 because the tablet was not found. No further retry: Not found: Tablet not found: eac01fc222dd480cbed7cac37a0e6693
W20260928 01:56:33.298455 19180 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 22fc9eff28c4436fb383c3d7169171bb because the tablet was not found. No further retry: Not found: Tablet not found: 22fc9eff28c4436fb383c3d7169171bb
W20260928 01:56:33.299446 19180 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 57a81b9455a340728fea713318e1e77a because the tablet was not found. No further retry: Not found: Tablet not found: 57a81b9455a340728fea713318e1e77a
W20260928 01:56:33.300527 19180 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 158edf7a5d724c88992fecbadd2cedfa because the tablet was not found. No further retry: Not found: Tablet not found: 158edf7a5d724c88992fecbadd2cedfa
I20260928 01:56:33.314844 19412 leader_election.cc:304] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:33.315888 22615 raft_consensus.cc:2749] T 675e1e1f2630411f8b070d8ca99e8ffb P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:33.328123 19412 leader_election.cc:304] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:33.330453 22619 raft_consensus.cc:2749] T c8fd6b965d22477aaee9bafccb2069b1 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:33.329913 19412 leader_election.cc:304] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:33.332906 22619 raft_consensus.cc:2804] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:33.333370 22619 raft_consensus.cc:493] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:33.333823 22619 raft_consensus.cc:3060] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:33.343842 21909 log.cc:1199] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/f709eccf4ab5413bbbd8b4746f185db4
W20260928 01:56:33.353135 19180 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 9ca0b52215454a99b6c5d1956088829a because the tablet was not found. No further retry: Not found: Tablet not found: 9ca0b52215454a99b6c5d1956088829a
I20260928 01:56:33.361147 21909 ts_tablet_manager.cc:1950] T f709eccf4ab5413bbbd8b4746f185db4 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
W20260928 01:56:33.387214 19180 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 0ae3663fbe024a4e946e47339a4b9090 because the tablet was not found. No further retry: Not found: Tablet not found: 0ae3663fbe024a4e946e47339a4b9090
W20260928 01:56:33.265653 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 127304us
I20260928 01:56:33.380173 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:33.388725 19758 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
I20260928 01:56:33.390173 19703 leader_election.cc:304] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
I20260928 01:56:33.410427 22529 raft_consensus.cc:2804] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:33.411895 22529 raft_consensus.cc:697] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:33.413093 22529 consensus_queue.cc:237] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:33.418192 19469 raft_consensus.cc:1275] T d114d5ba862044b4b88eee27395db7e3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:33.435043 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:33.435854 19768 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 3.
I20260928 01:56:33.437696 19556 leader_election.cc:304] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:33.443214 19180 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet e05925303152462e8ca25cd15f3bedff because the tablet was not found. No further retry: Not found: Tablet not found: e05925303152462e8ca25cd15f3bedff
I20260928 01:56:33.477865 22590 raft_consensus.cc:2749] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260928 01:56:33.536974 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 59498.5us
I20260928 01:56:33.440861 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 33) took 19561 ms. Trace:
I20260928 01:56:33.542044 21909 rpcz_store.cc:276] 0928 01:56:13.880377 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:13.913999 (+ 33622us) service_pool.cc:224] Handling call
0928 01:56:32.176392 (+18262393us) ts_tablet_manager.cc:1151] Deleting tablet f709eccf4ab5413bbbd8b4746f185db4
0928 01:56:32.176455 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:32.919784 (+743329us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:33.218291 (+298507us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:33.440783 (+222492us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":591435,"tablet-delete.queue_time_us":18066053}
I20260928 01:56:33.556532 19468 raft_consensus.cc:1275] T 4c6f4708c641414aa59f01703c86aaf1 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:33.594070 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:33.594736 19463 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:33.597496 21909 tablet_replica.cc:333] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:33.600246 21909 raft_consensus.cc:2243] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Raft consensus shutting down.
W20260928 01:56:33.589219 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 89325.1us
I20260928 01:56:33.604971 22679 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:33.605613 22679 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:33.614998 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 9 candidate_status { last_received { term: 8 index: 391 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:56:33.617974 22679 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:33.618579 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 9 candidate_status { last_received { term: 8 index: 391 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:33.620453 20447 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:33.621745 22679 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260928 01:56:33.623736 19553 leader_election.cc:304] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:33.639928 19556 leader_election.cc:304] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:33.375875 22619 raft_consensus.cc:515] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:33.656488 22619 leader_election.cc:290] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:33.672536 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 70849.7us
I20260928 01:56:33.675719 22681 raft_consensus.cc:2804] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:33.700362 22685 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:33.701015 22685 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:33.702679 22681 raft_consensus.cc:697] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:33.703615 22681 consensus_queue.cc:237] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:33.705720 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 82231.2us
I20260928 01:56:33.707320 19553 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:33.708503 22627 raft_consensus.cc:2804] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:33.708877 22627 raft_consensus.cc:493] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:33.709196 22627 raft_consensus.cc:3060] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:33.717366 20545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 391 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:33.718093 20545 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81ebb46a410e43ebaec3ef4dd13a71fc in term 8.
I20260928 01:56:33.719808 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 
I20260928 01:56:33.727144 22683 consensus_queue.cc:1059] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:33.729002 22692 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260928 01:56:33.729274 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 81634.3us
I20260928 01:56:33.729512 22692 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader c17b7f9972364c76893311539b569e0f)
I20260928 01:56:33.730005 22692 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 8 FOLLOWER]: Advancing to term 9
I20260928 01:56:33.729274 22683 raft_consensus.cc:2804] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 01:56:33.731268 22683 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:33.731607 22683 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:56:33.738277 22684 raft_consensus.cc:3055] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:56:33.738701 22684 raft_consensus.cc:740] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:33.739454 22684 consensus_queue.cc:260] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:33.741840 22685 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:33.748553 22692 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:33.751561 21909 raft_consensus.cc:2272] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:33.751853 20545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 391 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294"
I20260928 01:56:33.752552 20545 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 8 FOLLOWER]: Advancing to term 9
I20260928 01:56:33.760515 20545 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81ebb46a410e43ebaec3ef4dd13a71fc in term 9.
I20260928 01:56:33.760632 19704 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:33.762058 19104 leader_election.cc:304] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc; no voters: 
I20260928 01:56:33.762925 22692 leader_election.cc:290] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 9 election: Requested vote from peers c17b7f9972364c76893311539b569e0f (127.18.161.61:43775), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
I20260928 01:56:33.762949 22685 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 9 FOLLOWER]: Leader election won for term 9
I20260928 01:56:33.764670 22685 raft_consensus.cc:697] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 9 LEADER]: Becoming Leader. State: Replica: 81ebb46a410e43ebaec3ef4dd13a71fc, State: Running, Role: LEADER
I20260928 01:56:33.765658 22685 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 391, Committed index: 391, Last appended: 8.391, Last appended by leader: 391, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:33.786748 19409 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:56:33.794730 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 64237.9us
W20260928 01:56:33.799034 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 90899.4us
I20260928 01:56:33.811618 22581 raft_consensus.cc:2804] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 01:56:33.813516 22581 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:33.813874 22581 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:56:33.821465 22581 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:33.824095 22581 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 4 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:33.850188 22614 raft_consensus.cc:2804] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 01:56:33.850574 22614 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:33.850893 22614 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:56:33.829459 21909 ts_tablet_manager.cc:1916] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:33.858631 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 71971.5us
I20260928 01:56:33.867080 22692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81ebb46a410e43ebaec3ef4dd13a71fc. Latest consensus state: current_term: 9 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:33.867813 22692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: LEADER
I20260928 01:56:33.867748 22684 raft_consensus.cc:3060] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:33.886018 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:33.889546 22532 consensus_queue.cc:1048] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:33.904603 22697 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 01:56:33.911974 22614 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:33.926564 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 131137us
I20260928 01:56:33.947002 22614 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:33.948016 19469 raft_consensus.cc:2393] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 4: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:33.923310 22627 raft_consensus.cc:515] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:33.978776 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba]
I20260928 01:56:33.981592 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619]
I20260928 01:56:33.919512 22683 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:33.985495 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e]
W20260928 01:56:33.990142 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 122849us
I20260928 01:56:33.995616 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7]
I20260928 01:56:33.997231 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2]
I20260928 01:56:33.999130 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85]
I20260928 01:56:34.000702 22683 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:34.000811 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435]
I20260928 01:56:34.003435 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca]
I20260928 01:56:34.004674 22627 leader_election.cc:290] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:34.009805 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 109017us
I20260928 01:56:34.020550 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae]
I20260928 01:56:34.021534 22691 raft_consensus.cc:493] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:34.022430 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd]
I20260928 01:56:34.022105 22691 raft_consensus.cc:515] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:34.024458 22691 leader_election.cc:290] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:34.024884 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9]
I20260928 01:56:34.026298 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa]
I20260928 01:56:34.028559 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_8c45cdb1505f4f2c98e33582a08d4915 [id=23e1ba18b554433da62038872faa0ccb]
I20260928 01:56:34.039556 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_2a43036236e34e2586f541aa2fb3b8b6 [id=292d90fe578e4470bced0890a4e646ef]
I20260928 01:56:34.041913 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92]
I20260928 01:56:34.042128 19610 raft_consensus.cc:1275] T 4c6f4708c641414aa59f01703c86aaf1 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:34.043885 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:34.044138 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]
I20260928 01:56:34.044787 19610 raft_consensus.cc:2393] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 4: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:34.045509 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a]
W20260928 01:56:34.046196 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 246440us
I20260928 01:56:34.047580 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305]
W20260928 01:56:34.052162 19556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 124340us
W20260928 01:56:34.053426 19704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:34.059791 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75]
I20260928 01:56:34.062049 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3]
I20260928 01:56:34.063403 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0]
I20260928 01:56:34.064756 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921]
I20260928 01:56:34.066203 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375]
I20260928 01:56:34.077419 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006]
I20260928 01:56:34.078846 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d]
I20260928 01:56:34.080237 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6]
I20260928 01:56:34.081597 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a]
I20260928 01:56:34.082988 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]
I20260928 01:56:34.082996 21909 ts_tablet_manager.cc:1929] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:34.083600 21909 log.cc:1199] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/49a73835e2854976b40b31fe752d1b1b
I20260928 01:56:34.084542 21909 ts_tablet_manager.cc:1950] T 49a73835e2854976b40b31fe752d1b1b P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:34.088927 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:34.090111 19469 raft_consensus.cc:2393] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 4: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:34.092001 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8]
I20260928 01:56:34.094331 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513]
I20260928 01:56:34.096570 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d]
I20260928 01:56:34.097905 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd]
I20260928 01:56:34.099247 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e]
I20260928 01:56:34.101399 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305]
I20260928 01:56:34.111680 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a]
I20260928 01:56:34.113348 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_f064df9b0ba6484e8b4ff02df3f02433 [id=50e7e099a7b64f7094ba08d3e6871a33]
I20260928 01:56:34.114907 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc]
I20260928 01:56:34.116426 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_9a7d932e0ef8485cb1fb0d4450cbd14d [id=55616d2998544e568042a46ef7f958e4]
I20260928 01:56:34.117780 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535]
I20260928 01:56:34.124673 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 39) took 20086 ms. Trace:
I20260928 01:56:34.124143 22699 raft_consensus.cc:493] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37089d44fdba4b6488b5b5aea28af614)
I20260928 01:56:34.125144 21909 rpcz_store.cc:276] 0928 01:56:14.038917 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:14.039262 (+   345us) service_pool.cc:224] Handling call
0928 01:56:33.579224 (+19539962us) ts_tablet_manager.cc:1151] Deleting tablet 49a73835e2854976b40b31fe752d1b1b
0928 01:56:33.597351 (+ 18127us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:33.938309 (+340958us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:34.082857 (+144548us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:34.124592 (+ 41735us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148714,"tablet-delete.queue_time_us":19468544}
I20260928 01:56:34.125622 22699 raft_consensus.cc:515] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:34.127713 22699 leader_election.cc:290] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:34.132674 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b]
I20260928 01:56:34.134914 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df]
I20260928 01:56:34.136264 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780]
I20260928 01:56:34.137614 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7]
I20260928 01:56:34.144634 22703 raft_consensus.cc:493] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:34.148803 22703 raft_consensus.cc:515] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:34.153331 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233]
I20260928 01:56:34.156821 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e]
I20260928 01:56:34.158286 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765]
I20260928 01:56:34.160861 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7]
I20260928 01:56:34.162334 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb]
W20260928 01:56:34.153092 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 85365.5us
I20260928 01:56:34.165278 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:34.166191 19610 raft_consensus.cc:2393] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 4: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:34.162966 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 57) took 12627 ms. Trace:
I20260928 01:56:34.175062 21909 rpcz_store.cc:276] 0928 01:56:21.535433 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:21.536238 (+   805us) service_pool.cc:224] Handling call
0928 01:56:34.156087 (+12619849us) ts_tablet_manager.cc:1151] Deleting tablet 0ae3663fbe024a4e946e47339a4b9090
0928 01:56:34.161303 (+  5216us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:34.162890 (+  1587us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12602107}
I20260928 01:56:34.176676 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f]
I20260928 01:56:34.176553 22653 consensus_queue.cc:1048] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:34.178157 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b]
I20260928 01:56:34.179585 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b]
I20260928 01:56:34.181030 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b]
I20260928 01:56:34.182432 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee]
I20260928 01:56:34.184058 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88]
I20260928 01:56:34.185609 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9]
I20260928 01:56:34.187026 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d]
W20260928 01:56:34.187098 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 55901.6us
I20260928 01:56:34.188391 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151]
I20260928 01:56:34.189762 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87]
I20260928 01:56:34.191149 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e]
I20260928 01:56:34.192498 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1]
I20260928 01:56:34.193813 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542]
I20260928 01:56:34.199050 22703 leader_election.cc:290] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:34.201658 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:34.203107 19761 raft_consensus.cc:2393] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:34.213820 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93]
I20260928 01:56:34.214054 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:34.215355 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]
I20260928 01:56:34.216637 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f]
I20260928 01:56:34.218444 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca]
I20260928 01:56:34.219596 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55]
I20260928 01:56:34.220871 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_c559f34b8864494f82ca062207ebbecf [id=94c9af4db37f4a2a8459631624fbc5de]
I20260928 01:56:34.222004 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f]
I20260928 01:56:34.222805 19618 raft_consensus.cc:2468] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:34.223150 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9]
I20260928 01:56:34.225318 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:34.226024 19468 raft_consensus.cc:2393] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 4: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:34.226802 19462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:34.227367 19462 raft_consensus.cc:3060] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:34.228418 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:34.229092 19616 raft_consensus.cc:2393] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 4: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:34.230522 19616 raft_consensus.cc:1275] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:34.233021 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 58) took 12679 ms. Trace:
I20260928 01:56:34.233399 21909 rpcz_store.cc:276] 0928 01:56:21.553870 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:21.554150 (+   280us) service_pool.cc:224] Handling call
0928 01:56:34.176089 (+12621939us) ts_tablet_manager.cc:1151] Deleting tablet eac01fc222dd480cbed7cac37a0e6693
0928 01:56:34.176147 (+    58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:34.232948 (+ 56801us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12621282}
I20260928 01:56:34.234583 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 61) took 12326 ms. Trace:
I20260928 01:56:34.234907 21909 rpcz_store.cc:276] 0928 01:56:21.907837 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:21.908220 (+   383us) service_pool.cc:224] Handling call
0928 01:56:34.234272 (+12326052us) ts_tablet_manager.cc:1151] Deleting tablet 7ab79c6ad03e481a903a0f95ae0512e6
0928 01:56:34.234330 (+    58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:34.234522 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12325441}
I20260928 01:56:34.236965 19761 raft_consensus.cc:1275] T 2018f8b52f974554924f9ecfbd5a0f51 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260928 01:56:34.238034 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9]
I20260928 01:56:34.240242 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975]
I20260928 01:56:34.245379 19462 raft_consensus.cc:2468] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
I20260928 01:56:34.253475 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f]
I20260928 01:56:34.254801 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6]
I20260928 01:56:34.256755 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37]
I20260928 01:56:34.256824 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:34.257609 19761 raft_consensus.cc:2393] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 4: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:34.258585 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749]
I20260928 01:56:34.259805 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4]
W20260928 01:56:34.260262 19102 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.509s (SENT) [suppressed 1 similar messages]
I20260928 01:56:34.261065 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417]
I20260928 01:56:34.263027 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4]
W20260928 01:56:34.266433 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 70267.9us
W20260928 01:56:34.275312 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 55659.1us
I20260928 01:56:34.276436 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7]
I20260928 01:56:34.276787 22706 consensus_queue.cc:1048] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:34.278569 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624]
I20260928 01:56:34.279942 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5]
I20260928 01:56:34.281313 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d]
I20260928 01:56:34.282577 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619]
I20260928 01:56:34.284332 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:34.284849 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d]
I20260928 01:56:34.286125 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a]
I20260928 01:56:34.287330 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d]
W20260928 01:56:34.289932 19553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 01:56:34.290560 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b]
I20260928 01:56:34.292515 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed]
I20260928 01:56:34.293794 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331]
I20260928 01:56:34.301997 20545 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Refusing update from remote peer 81ebb46a410e43ebaec3ef4dd13a71fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 391. Preceding OpId from leader: term: 9 index: 392. (index mismatch)
I20260928 01:56:34.302794 19761 raft_consensus.cc:1275] T 29f65b0966c04012bfec3c67a37acc25 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:34.304159 22685 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 392, Last known committed idx: 391, Time since last communication: 0.001s
I20260928 01:56:34.315668 22701 raft_consensus.cc:493] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:34.316409 22701 raft_consensus.cc:515] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:34.317823 19102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 57603.3us
I20260928 01:56:34.318581 22701 leader_election.cc:290] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:34.320674 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2]
I20260928 01:56:34.322077 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87]
I20260928 01:56:34.324904 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02]
I20260928 01:56:34.333467 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14]
I20260928 01:56:34.334817 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6]
I20260928 01:56:34.372781 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5]
I20260928 01:56:34.381770 19556 leader_election.cc:304] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:34.384116 22684 raft_consensus.cc:2804] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:34.384755 22684 raft_consensus.cc:697] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 3 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:34.385681 22684 consensus_queue.cc:237] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:34.236140 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 62) took 12326 ms. Trace:
I20260928 01:56:34.399346 21909 rpcz_store.cc:276] 0928 01:56:22.189622 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:22.189817 (+   195us) service_pool.cc:224] Handling call
0928 01:56:34.235831 (+12046014us) ts_tablet_manager.cc:1151] Deleting tablet 158edf7a5d724c88992fecbadd2cedfa
0928 01:56:34.235883 (+    52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:34.236076 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12045337}
I20260928 01:56:34.400945 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 71) took 7000 ms. Trace:
I20260928 01:56:34.401305 21909 rpcz_store.cc:276] 0928 01:56:27.400184 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:27.400363 (+   179us) service_pool.cc:224] Handling call
0928 01:56:34.400602 (+7000239us) ts_tablet_manager.cc:1151] Deleting tablet 9ca0b52215454a99b6c5d1956088829a
0928 01:56:34.400664 (+    62us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:34.400875 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6999234}
I20260928 01:56:34.402446 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 72) took 6981 ms. Trace:
I20260928 01:56:34.402848 21909 rpcz_store.cc:276] 0928 01:56:27.420806 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:27.420933 (+   127us) service_pool.cc:224] Handling call
0928 01:56:34.402133 (+6981200us) ts_tablet_manager.cc:1151] Deleting tablet e05925303152462e8ca25cd15f3bedff
0928 01:56:34.402189 (+    56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:34.402387 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6973658}
I20260928 01:56:34.376022 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b]
I20260928 01:56:34.406008 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5]
W20260928 01:56:34.405912 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 91345us
I20260928 01:56:34.407684 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb]
I20260928 01:56:34.407877 19703 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:34.407148 22717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81ebb46a410e43ebaec3ef4dd13a71fc. Latest consensus state: current_term: 9 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:34.408655 22717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:56:34.408733 22652 raft_consensus.cc:2749] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260928 01:56:34.423357 22697 catalog_manager.cc:692] Loaded metadata for table default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320]
I20260928 01:56:34.430781 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:34.444000 22652 raft_consensus.cc:493] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:34.444670 22652 raft_consensus.cc:515] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:34.447737 22652 leader_election.cc:290] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:34.475206 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 73) took 7054 ms. Trace:
I20260928 01:56:34.475610 21909 rpcz_store.cc:276] 0928 01:56:27.421185 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:27.421528 (+   343us) service_pool.cc:224] Handling call
0928 01:56:34.474860 (+7053332us) ts_tablet_manager.cc:1151] Deleting tablet 89e1d60db21f4a8294792df3fadf5d90
0928 01:56:34.474917 (+    57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:34.475135 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7046155}
I20260928 01:56:34.476847 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 74) took 7055 ms. Trace:
I20260928 01:56:34.477149 21909 rpcz_store.cc:276] 0928 01:56:27.421503 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:27.422242 (+   739us) service_pool.cc:224] Handling call
0928 01:56:34.476479 (+7054237us) ts_tablet_manager.cc:1151] Deleting tablet 7daa1b799e0d408287edc03988f5b683
0928 01:56:34.476540 (+    61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:34.476788 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7047603}
I20260928 01:56:34.479432 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0669f9f51b05479aa9715e06d4c42423" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
W20260928 01:56:34.481667 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 56974.9us
I20260928 01:56:34.484308 22717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:34.485052 22717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 01:56:34.519865 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 79352.7us
I20260928 01:56:34.552233 22701 consensus_queue.cc:1048] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 01:56:34.558024 22700 consensus_queue.cc:1048] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:34.570868 19616 raft_consensus.cc:1275] T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 37089d44fdba4b6488b5b5aea28af614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260928 01:56:34.577500 22697 tablet_loader.cc:96] loaded metadata for tablet 01cc307b127446958bd4199a1aa60adb (table default.Table_8ed439758c9f4e8caca3ed1a1775855d [id=3cd9214641094ad7adfde052eba73375])
I20260928 01:56:34.592166 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:34.593017 19459 raft_consensus.cc:2468] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:34.597867 22685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 9 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:34.598649 22685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: LEADER
I20260928 01:56:34.605567 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f80b652a19a41968d1bfbaaf020b721" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:34.612299 22697 tablet_loader.cc:96] loaded metadata for tablet 0287060a8d054b15b2252dcf280ca8c2 (table default.Table_57636f8d4c454189ba0a963e19e86f1f [id=3ea8fb9803ee49dbaa28e73ebafebaf6])
I20260928 01:56:34.617888 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 75) took 7196 ms. Trace:
I20260928 01:56:34.618373 21909 rpcz_store.cc:276] 0928 01:56:27.421786 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:27.422864 (+  1078us) service_pool.cc:224] Handling call
0928 01:56:34.617518 (+7194654us) ts_tablet_manager.cc:1151] Deleting tablet 3c6cfc9ff3344a48b09730dfde79d6cf
0928 01:56:34.617582 (+    64us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:34.617821 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7188465}
I20260928 01:56:34.619820 21909 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55034 (request call id 76) took 7197 ms. Trace:
I20260928 01:56:34.620255 21909 rpcz_store.cc:276] 0928 01:56:27.422084 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:27.423496 (+  1412us) service_pool.cc:224] Handling call
0928 01:56:34.619496 (+7196000us) ts_tablet_manager.cc:1151] Deleting tablet 22fc9eff28c4436fb383c3d7169171bb
0928 01:56:34.619552 (+    56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:34.619760 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7190183}
W20260928 01:56:34.630396 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 50191.5us
I20260928 01:56:34.632697 22697 tablet_loader.cc:96] loaded metadata for tablet 043ddb5b0b0e4ad0b30d2927d37971fb (table default.Table_102a74c97b494487ba45f71e2608c6f6 [id=9ec8ebb0cc824d70b5774f56487f84a9])
I20260928 01:56:34.635751 19412 leader_election.cc:304] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:34.636926 22701 raft_consensus.cc:2804] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:56:34.637382 22701 raft_consensus.cc:697] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 2 LEADER]: Becoming Leader. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:34.638146 22701 consensus_queue.cc:237] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:34.634742 22697 tablet_loader.cc:96] loaded metadata for tablet 0669f9f51b05479aa9715e06d4c42423 (table default.Table_bd6fee77f196438ca5e90da78527c241 [id=f071f9c1b9f74504b04a64c5d6a7c8a6])
I20260928 01:56:34.642042 22697 tablet_loader.cc:96] loaded metadata for tablet 0b222e5366a64f52bc97acd551c7a067 (table default.Table_2e85383d510044d6821bd153a9a191df [id=65e97905d20f4bce9e010a056883d7b7])
I20260928 01:56:34.645668 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:34.643998 22697 tablet_loader.cc:96] loaded metadata for tablet 0d5018f065824614a42f93afd49f770e (table default.Table_661da8a82d9f4326a02315d508cd7db7 [id=3a9500403d2d4296aece85cbc88b6bb0])
I20260928 01:56:34.661399 22697 tablet_loader.cc:96] loaded metadata for tablet 0e1ddfab489f4ace921d551c216039bd (table default.Table_06429efed97f45e3a85c5c07ab33b50f [id=a32416cb7e0c43b6929523ee2e71d49f])
I20260928 01:56:34.663511 22697 tablet_loader.cc:96] loaded metadata for tablet 10fa56df34ad44d88f1dd700c823d57c (table default.Table_e1827a496ab34ee084c0c605b5c205da [id=bf48884c89b6431183c4e660e68b23c7])
I20260928 01:56:34.680951 22697 tablet_loader.cc:96] loaded metadata for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117])
I20260928 01:56:34.652673 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:34.654178 19761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:34.682291 22697 tablet_loader.cc:96] loaded metadata for tablet 12b836e20d6b43cba8eaa08887afb076 (table default.Table_ddff92897f304d37977d573dfe022549 [id=ac938e50b49f4ecd81a5258cae0392b4])
I20260928 01:56:34.682520 19758 raft_consensus.cc:2393] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 4: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
W20260928 01:56:34.685751 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 44144.8us
I20260928 01:56:34.701433 22697 tablet_loader.cc:96] loaded metadata for tablet 13c395a6a87f4927b10973720aa4d868 (table default.Table_d18c82a7d33545a9aa3f56592cf6fbc8 [id=29fdbdbfaec94436b6998cde15e4ca92])
I20260928 01:56:34.702626 22697 tablet_loader.cc:96] loaded metadata for tablet 1555e557370a4e92915a9c55107b573b (table default.Table_80fbfbe91c9a46e6b3e9f60c3458dfad [id=a408a60e4b0a43d2b6f53d9d59d051b6])
I20260928 01:56:34.736704 22697 tablet_loader.cc:96] loaded metadata for tablet 15f48cf74a1b4600b5140bf9cc8446e3 (table default.Table_49cf0e3df4ac4673927287e5ff629fbf [id=d689a76d48e64246acec71a6b0e41fc2])
I20260928 01:56:34.737938 22697 tablet_loader.cc:96] loaded metadata for tablet 164564bc2c97430da228a621aa545e5a (table default.Table_f064df9b0ba6484e8b4ff02df3f02433 [id=50e7e099a7b64f7094ba08d3e6871a33])
I20260928 01:56:34.739215 22697 tablet_loader.cc:96] loaded metadata for tablet 2018f8b52f974554924f9ecfbd5a0f51 (table default.Table_1e04bf7deec14195825616379bbf14dc [id=7eb30362c50d4a2ea2e7a2a1990a996b])
W20260928 01:56:34.740772 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 54307.3us
I20260928 01:56:34.742381 19412 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:34.749231 22726 raft_consensus.cc:2749] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260928 01:56:34.750711 22697 tablet_loader.cc:96] loaded metadata for tablet 202f1ead822548a2bbeae4e4d3cf9be8 (table default.Table_f21cff877b0c4aa6a48ec21efd04117d [id=a10c8b1b39b14284af64c639df078975])
I20260928 01:56:34.755940 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
W20260928 01:56:34.760840 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 48905.1us
I20260928 01:56:34.766664 22697 tablet_loader.cc:96] loaded metadata for tablet 2156dae74ee748cd845b6dea1d3b8ea8 (table default.Table_6fceefa6f594468cbc929496b59d8bb3 [id=3e43587428fb4c679f8222cf3c30d08d])
I20260928 01:56:34.767987 22697 tablet_loader.cc:96] loaded metadata for tablet 21906a8380e64d95b9454a57fc01c6f0 (table default.Table_d86b7bc9587e442186ac7891b241c14b [id=c66f0302961b4829b7fc85d74718316a])
I20260928 01:56:34.768399 22701 consensus_queue.cc:1048] T 29f65b0966c04012bfec3c67a37acc25 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260928 01:56:34.771055 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 46434.1us
I20260928 01:56:34.772523 22697 tablet_loader.cc:96] loaded metadata for tablet 219b7dad56a64a3b813344e0ed9bdbdc (table default.Table_6e5d3bc7faaa43e6acaa07748a4c110c [id=c355f9f0b9c449dd8501442b6251680d])
I20260928 01:56:34.778277 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:34.789986 22697 tablet_loader.cc:96] loaded metadata for tablet 22e095aba1cb4fb7be461d625a922751 (table default.Table_3632814358374786adf52342b1b0faa6 [id=f4d5240f021d40ceabce7bc7f3ff64f5])
I20260928 01:56:34.801064 22697 tablet_loader.cc:96] loaded metadata for tablet 27a232fc915a46c1a833ec5f6721eece (table default.Table_b4909725798043e3b60ea75cfa351347 [id=af029d4137e94d8496baca9f9ee25417])
I20260928 01:56:34.803565 22697 tablet_loader.cc:96] loaded metadata for tablet 29f65b0966c04012bfec3c67a37acc25 (table default.Table_93d5b38d864e421eb0f1ebc64ad796ed [id=6f3462830ab142e1a3b8a7a65b142d4e])
I20260928 01:56:34.829355 22697 tablet_loader.cc:96] loaded metadata for tablet 2c007b068b1d414298cce3fe44a91daa (table default.Table_2f8387344a7b436e9f8c612413234c82 [id=53507eb4e104445fbfd4b13898b69dbc])
W20260928 01:56:34.829617 19102 leader_election.cc:336] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c17b7f9972364c76893311539b569e0f (127.18.161.61:43775): Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.509s (SENT)
I20260928 01:56:34.831805 19703 leader_election.cc:304] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:34.832595 22709 raft_consensus.cc:2804] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:34.833142 22709 raft_consensus.cc:493] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:34.833487 22709 raft_consensus.cc:3060] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:34.834735 22697 tablet_loader.cc:96] loaded metadata for tablet 36076aa674b9401b9b76fbf066348d06 (table default.Table_1d52c0fdbf6f457199204d44bfe9a304 [id=40368cee2d4142e1ade6c9bd575c4f6a])
I20260928 01:56:34.849329 22697 tablet_loader.cc:96] loaded metadata for tablet 376b5a87b07b4f87a2a502b5fa1b23f8 (table default.Table_39b9aad9829442b6989cad988795904c [id=73165632ad504828abd4e031ed7bc3e7])
I20260928 01:56:34.851260 19412 leader_election.cc:304] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:34.852008 22726 raft_consensus.cc:2749] T 0669f9f51b05479aa9715e06d4c42423 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:56:34.854313 22697 tablet_loader.cc:96] loaded metadata for tablet 3ca3c16cd3f54ff4bdbfa20accff3fc7 (table default.Table_bf23f63a04b0482b90316c68c5638c2f [id=57839e65399d493fa234a1b84792a535])
I20260928 01:56:34.870103 22697 tablet_loader.cc:96] loaded metadata for tablet 3f4a1c903a04450684ba38081a75559e (table default.Table_66fb8fd3f9fa476dbb31d3e09f4ae465 [id=2d460beedad64691a1c13543f4bf538a])
I20260928 01:56:34.878819 19553 leader_election.cc:304] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:34.879853 19102 leader_election.cc:336] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c17b7f9972364c76893311539b569e0f (127.18.161.61:43775): Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.544s (SENT)
I20260928 01:56:34.880131 22699 raft_consensus.cc:2749] T 3ca3c16cd3f54ff4bdbfa20accff3fc7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 01:56:34.883098 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 53277.4us
I20260928 01:56:34.884860 22697 tablet_loader.cc:96] loaded metadata for tablet 416ccc1323fe41b2a7783dc95bba8d84 (table default.Table_a779e68b4b3c4061a02f75a23a7f97d7 [id=c2acd4d4447b4dffbd5262eaf0feee4d])
W20260928 01:56:34.888983 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 57234.5us
I20260928 01:56:34.893575 22697 tablet_loader.cc:96] loaded metadata for tablet 45d8d07b367b4fafbd7171f8ea7b2a26 (table default.Table_eec015404ccd406f9a1dc1a588d1091c [id=3c2fd3abb1174a21881222affab46921])
I20260928 01:56:34.901672 22697 tablet_loader.cc:96] loaded metadata for tablet 4c6f4708c641414aa59f01703c86aaf1 (table default.Table_fc26a7ce9faf4ea08601641355b17651 [id=45c5c73c65c54701b59cc9552b723fb8])
I20260928 01:56:34.909101 22701 consensus_queue.cc:1048] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:34.910708 22697 tablet_loader.cc:96] loaded metadata for tablet 4d8a70d4a8654947be5ab2eb5539b3c9 (table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67])
I20260928 01:56:34.911163 19553 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:34.912436 22701 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:34.912910 22701 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:34.914499 22699 raft_consensus.cc:2749] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260928 01:56:34.915433 19462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c205176cb94d9f861cc140560944d4" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:34.917094 22697 tablet_loader.cc:96] loaded metadata for tablet 4e6b59144fe14daab98b0965c7f8af02 (table default.Table_3150a3877264403b9dc7b41be25b80f5 [id=09e0de149c7d4ecb87612f5f83e979a2])
I20260928 01:56:34.915472 22701 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:34.933362 22697 tablet_loader.cc:96] loaded metadata for tablet 4ee6d48172044c74aacd4b78683efb66 (table default.Table_3c2b867f1a684d0089c1244ac367c3bb [id=80615f0d230c4c50b8c7162d16d54c88])
I20260928 01:56:34.938724 22697 tablet_loader.cc:96] loaded metadata for tablet 502c0f4e07ff4479af8d33c99031b6fc (table default.Table_20dcad66d10f47f1a1537bf182984f07 [id=1994729b06be440781cb661b44b2f8fd])
I20260928 01:56:34.941998 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6206afe245740b1819069a48e8b548e" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:34.947181 22717 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 81ebb46a410e43ebaec3ef4dd13a71fc)
I20260928 01:56:34.947762 22717 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:34.940066 22697 tablet_loader.cc:96] loaded metadata for tablet 522245da435b40ae84ae6dc5d19a2e95 (table default.Table_c9d9424440ef43bfac25e91841431667 [id=d1291e7b72b94a81b57d0a75398918ed])
I20260928 01:56:34.949512 22697 tablet_loader.cc:96] loaded metadata for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3 (table default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f])
I20260928 01:56:34.950199 22717 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:34.958161 22709 raft_consensus.cc:515] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:34.958189 22697 tablet_loader.cc:96] loaded metadata for tablet 5374596938d64cafb9621a1932ca1f68 (table default.Table_45d6b319a8bc4864a0f443d8c42707d3 [id=74830ae93b5b48ebbcf7059f157fed2f])
I20260928 01:56:34.970209 19616 raft_consensus.cc:1240] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [term 3 LEADER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 2. Current term is 3. Ops: []
I20260928 01:56:34.977317 19466 raft_consensus.cc:1275] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 01:56:34.980026 22709 leader_election.cc:290] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:34.974619 19467 raft_consensus.cc:1240] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Rejecting Update request from peer 8373bfae1f384c36b5e4c5ca26b208da for earlier term 2. Current term is 3. Ops: []
I20260928 01:56:34.990381 22697 tablet_loader.cc:96] loaded metadata for tablet 53c755f16ea1496eb7fa26fb12e01708 (table default.Table_e57125ad4a62414baf5a9466ce680bdc [id=0a76dc3cc7364f14b3ebec246003fd85])
I20260928 01:56:35.009552 22697 tablet_loader.cc:96] loaded metadata for tablet 5442dd0aa28545c8bcf3a0b977c71e98 (table default.Table_3a049c9dbf754d8994b690962634821c [id=7d13ae3ded92490181c0f0bf7ec0729b])
W20260928 01:56:35.029904 19163 debug-util.cc:398] Leaking SignalData structure 0x7b08000377a0 after lost signal to thread 19177
W20260928 01:56:35.030380 19163 kernel_stack_watchdog.cc:198] Thread 19177 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 346ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260928 01:56:35.031213 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:35.031793 19459 raft_consensus.cc:3060] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:35.054364 22706 raft_consensus.cc:493] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:35.054930 22706 raft_consensus.cc:515] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:35.062386 22697 tablet_loader.cc:96] loaded metadata for tablet 6546cfe6f3a6405fab41a4ebdcffb288 (table default.Table_74d8ab066a6d493d8f5fcda388d66055 [id=63fc7bedaab146e3ace17c19e7d055df])
I20260928 01:56:35.070672 22706 leader_election.cc:290] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:35.073120 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:35.074226 19616 raft_consensus.cc:2393] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 4: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:35.078585 22709 raft_consensus.cc:493] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:35.079087 22709 raft_consensus.cc:515] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:35.081714 19556 leader_election.cc:304] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:35.085601 22697 tablet_loader.cc:96] loaded metadata for tablet 65d70a8be7244c86864187420a4fd5f5 (table default.Table_436557f9b1b0478aa8544ec1f3a86132 [id=0bc4ca4de24f45e4843eb09cce780435])
I20260928 01:56:35.087111 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39fce4f0a149a898de678d73052f52" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:35.093712 22699 raft_consensus.cc:2749] T 81c205176cb94d9f861cc140560944d4 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:56:35.096110 19556 leader_election.cc:304] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:35.097497 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:35.098083 19618 raft_consensus.cc:2468] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:35.099941 22703 raft_consensus.cc:2749] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 01:56:35.101303 22697 tablet_loader.cc:96] loaded metadata for tablet 65fdc8575c7440ffbf5c7c4db5d4b35e (table default.Table_b5d200ca309a4ce18e782fb38b238e19 [id=804b1e68ce9949f0b7fe1e527311afee])
I20260928 01:56:35.123473 22652 raft_consensus.cc:493] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:35.124025 22652 raft_consensus.cc:515] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:35.126638 22652 leader_election.cc:290] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
W20260928 01:56:35.133775 22733 log.cc:927] Time spent T 2018f8b52f974554924f9ecfbd5a0f51 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260928 01:56:35.136759 22697 tablet_loader.cc:96] loaded metadata for tablet 664b608bb0f54fc5baa10622f7d916c1 (table default.Table_7b512897d5b14bda99e46dcb3eec147c [id=1a82faaac9e845468ad2467288e2bcc9])
I20260928 01:56:35.137699 22699 consensus_queue.cc:1048] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:35.144912 22697 tablet_loader.cc:96] loaded metadata for tablet 675e1e1f2630411f8b070d8ca99e8ffb (table default.Table_4660abbe85e6487bb791fef30eb47223 [id=8bff1f47f4204111bc81224336cd5f93])
I20260928 01:56:35.147053 22709 leader_election.cc:290] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:35.152153 22697 tablet_loader.cc:96] loaded metadata for tablet 67be39a8cae04ff9ae99c2c3b02713cd (table default.Table_166fa0660a6a4034b6d1aae617f868e0 [id=d54031bc036141b88fcaf6c5f7f55331])
I20260928 01:56:35.158828 22706 consensus_queue.cc:1059] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:35.159615 22706 consensus_queue.cc:1243] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Peer a3ee288ca1464d20a715673422a214a0 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260928 01:56:35.160249 22652 raft_consensus.cc:3055] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Stepping down as leader of term 2
I20260928 01:56:35.160585 22652 raft_consensus.cc:740] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:35.161351 22652 consensus_queue.cc:260] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:35.163256 22697 tablet_loader.cc:96] loaded metadata for tablet 6ea6adefd15a4ea19011419949047e83 (table default.Table_2a43036236e34e2586f541aa2fb3b8b6 [id=292d90fe578e4470bced0890a4e646ef])
I20260928 01:56:35.172619 22697 tablet_loader.cc:96] loaded metadata for tablet 71a064862b854ad4af884e4ca95ffb31 (table default.Table_c559f34b8864494f82ca062207ebbecf [id=94c9af4db37f4a2a8459631624fbc5de])
I20260928 01:56:35.182332 22697 tablet_loader.cc:96] loaded metadata for tablet 7441c2d1a7fa4dc8a89c6717a80d3efb (table default.Table_f6031fcda0b346ff84e0b68824cb54b0 [id=6928d6282eef4aed8b4caa85e754a233])
I20260928 01:56:35.188344 22697 tablet_loader.cc:96] loaded metadata for tablet 75303ee92aae436ea6c46747a23b69b6 (table default.Table_472f586201dd40db9fd84403594d81ed [id=fffee0911a5441c6a2feaea21c32d320])
I20260928 01:56:35.189101 22652 raft_consensus.cc:3060] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:35.146387 19459 raft_consensus.cc:2468] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:35.202719 22697 tablet_loader.cc:96] loaded metadata for tablet 7801c623930d4e4eaf24c5c424b06d26 (table default.Table_4e6ff7b4eef046f1a5376bfa6e2ce76b [id=3d3ba0cfe7894b9b97e32a7258008006])
I20260928 01:56:35.214054 22697 tablet_loader.cc:96] loaded metadata for tablet 7979940c4a2e470bbecc40384edf38c9 (table default.Table_bb3b0337b3684b9caf534914d16688bc [id=d9100dab0c4f45ef88bcd70bff1bca87])
I20260928 01:56:35.233165 19704 leader_election.cc:304] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:35.241313 22726 raft_consensus.cc:493] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:35.242239 22708 raft_consensus.cc:2804] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:35.242592 22708 raft_consensus.cc:493] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:35.242225 22726 raft_consensus.cc:515] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:35.242928 22708 raft_consensus.cc:3060] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:35.245476 22726 leader_election.cc:290] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:35.250126 22697 tablet_loader.cc:96] loaded metadata for tablet 81c205176cb94d9f861cc140560944d4 (table default.Table_67ac9fd1d2164b478671c2457c12241a [id=723a304555a044a4a4e7d86efd8b0765])
I20260928 01:56:35.253484 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:35.254132 19763 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 4.
I20260928 01:56:35.257968 22697 tablet_loader.cc:96] loaded metadata for tablet 86825485bfca479ea63c1a99dddb68d6 (table default.Table_50f66235bc464bdbb3fd48bfac98069e [id=81a780bf887d48bab835a4cc19f773e9])
I20260928 01:56:35.263564 19703 leader_election.cc:304] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:35.266134 22697 tablet_loader.cc:96] loaded metadata for tablet 897503329be649e38473561cea1fdaf1 (table default.Table_74bbe86cdce246d29f4ea5a04ca9809c [id=64ac5096faa341fb94d17e4bbe510780])
I20260928 01:56:35.282116 22706 raft_consensus.cc:2804] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:35.283278 22706 raft_consensus.cc:697] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:35.284319 22706 consensus_queue.cc:237] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:35.288151 19459 raft_consensus.cc:1240] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260928 01:56:35.290968 22697 tablet_loader.cc:96] loaded metadata for tablet 8b48eacc1cec49baabe2d87bdd06cd5c (table default.Table_8fa166d0b57c47e1a0f8e07124585fb9 [id=4d0939ceafa947af9a2fb1c951c34bbd])
I20260928 01:56:35.294508 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:35.295195 19458 raft_consensus.cc:2468] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:35.298046 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:35.298866 19458 raft_consensus.cc:2468] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:35.299520 22697 tablet_loader.cc:96] loaded metadata for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_9a7d932e0ef8485cb1fb0d4450cbd14d [id=55616d2998544e568042a46ef7f958e4])
I20260928 01:56:35.307603 19608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:35.308380 19608 raft_consensus.cc:2468] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:35.308604 22697 tablet_loader.cc:96] loaded metadata for tablet 8dc9a1c5be7c4e519f1415ba70397f01 (table default.Table_1d7ba037c2b94761a1844dd92fec58ad [id=91b9d48a31cc4cd583ffb7e2cc34faca])
I20260928 01:56:35.317224 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:35.317952 19619 raft_consensus.cc:2468] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:35.316862 22697 tablet_loader.cc:96] loaded metadata for tablet 8df69eb3a37445ed8a2be0ef3bf32cdb (table default.Table_00c07b4e719b4bdbab8d16df1d23985c [id=c17480b763084997b1d99b82b6f44624])
I20260928 01:56:35.325013 22697 tablet_loader.cc:96] loaded metadata for tablet 8e39fce4f0a149a898de678d73052f52 (table default.Table_8973fdce291e4b6eaef470916578c577 [id=92ea5396fe744e79973368151a4d6a55])
I20260928 01:56:35.329728 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:35.330551 19762 raft_consensus.cc:2468] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
I20260928 01:56:35.346235 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:35.355844 22697 tablet_loader.cc:96] loaded metadata for tablet 9690a224bb004152ba65d525cc10bd9f (table default.Table_4f172191b146442b95eebfe75c50791b [id=c1dfea1430d247e4961ec62693b4dcb5])
W20260928 01:56:35.361199 19556 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.60:39095, user_credentials={real_user=slave}} blocked reactor thread for 58066.5us
W20260928 01:56:35.383100 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 91152.1us
I20260928 01:56:35.364468 22697 tablet_loader.cc:96] loaded metadata for tablet 982c3e07bcb94230b93764330914630f (table default.Table_60d638e6b7344739abf4bc0c6902b529 [id=091b5a4098aa4735adb1bf56bff7d3f7])
W20260928 01:56:35.388823 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 44044.4us
I20260928 01:56:35.398979 22697 tablet_loader.cc:96] loaded metadata for tablet 99e806ba248746d2bde39a2eb76b17df (table default.Table_3c69a5708b414cb2bc1ab47056127578 [id=8b84ebc494074ac992df97b9d816a542])
I20260928 01:56:35.400246 22697 tablet_loader.cc:96] loaded metadata for tablet 9a9c2db89fb8467d91c6bd01985d8b40 (table default.Table_a7af8fe79805437dbda5a73ebefa0c79 [id=39be653257b843a2ae7ba85c326b2eb3])
I20260928 01:56:35.402245 22697 tablet_loader.cc:96] loaded metadata for tablet 9ec3f279423a46c1acb1cbfecf4a608a (table default.Table_f65413c2f8584805a3186fb775ed4e59 [id=cc2f2b0897a44f25ae60575f0653a46b])
I20260928 01:56:35.403457 22697 tablet_loader.cc:96] loaded metadata for tablet 9f80b652a19a41968d1bfbaaf020b721 (table default.Table_a9b783bb4d0246458d41b4a1a5d99a20 [id=8b20f27ecf5f4ce1bbca6a0ad51f2ff1])
I20260928 01:56:35.407791 22708 raft_consensus.cc:515] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:35.409329 19814 heartbeater.cc:499] Master 127.18.161.61:43775 was elected leader, sending a full tablet report...
I20260928 01:56:35.410250 22708 leader_election.cc:290] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:35.418038 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 49047.6us
I20260928 01:56:35.423607 19704 leader_election.cc:304] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:35.425802 19704 leader_election.cc:304] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:35.428431 22653 raft_consensus.cc:2804] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:35.428937 22653 raft_consensus.cc:493] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:35.429282 22653 raft_consensus.cc:3060] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:35.432458 22709 raft_consensus.cc:2804] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:35.432881 22709 raft_consensus.cc:493] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:35.433444 22709 raft_consensus.cc:3060] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:35.440603 22697 tablet_loader.cc:96] loaded metadata for tablet a01b795606604960bc7cafab4ff6f3d0 (table default.Table_d8b6b2e3f5d241a6a28ca8323b931963 [id=16a2de5d927846c58d32663a3731f1ae])
W20260928 01:56:35.447003 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 56740us
I20260928 01:56:35.450297 22697 tablet_loader.cc:96] loaded metadata for tablet a12bafcc09ef4342bff89b0475f721af (table default.Table_7f96dae07ddf433daee6ef935a5f2d51 [id=5f5eddf6e7514d16b61e163f38fe946b])
I20260928 01:56:35.451572 22697 tablet_loader.cc:96] loaded metadata for tablet a1710b95678440b1bff8a92080d43272 (table default.Table_c9449f6a65b249a6aba571b955c6ab14 [id=c6cb3a85a49c4eb7b327afdede43e12d])
I20260928 01:56:35.455451 22706 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:35.456029 22706 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:35.461118 22706 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:35.462726 22697 tablet_loader.cc:96] loaded metadata for tablet a1e74d73a7eb44cd97c2c1df77b8b20c (table default.Table_8c45cdb1505f4f2c98e33582a08d4915 [id=23e1ba18b554433da62038872faa0ccb])
I20260928 01:56:35.464864 22653 raft_consensus.cc:515] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:35.469230 22697 tablet_loader.cc:96] loaded metadata for tablet a23b494afa1f45988d447519356d2b03 (table default.Table_50e17dbd9fb049d783f55a70bc2d73af [id=302d29574c874caaa5a7403ea4bc0305])
W20260928 01:56:35.479378 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 52629.8us
W20260928 01:56:35.484117 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 47617.2us
W20260928 01:56:35.488566 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 50347.6us
I20260928 01:56:35.489491 22697 tablet_loader.cc:96] loaded metadata for tablet a735102c576640b69323cacb50393a42 (table default.Table_25d654f0414f40418a69e57185765938 [id=088562b068f04679b0da4eb8ea00df7e])
I20260928 01:56:35.493917 22653 leader_election.cc:290] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:35.495339 20456 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.161.62:38511 timed out after 0.543s (SENT)
I20260928 01:56:35.494575 22697 tablet_loader.cc:96] loaded metadata for tablet a82d3233e4514813b22121f75d11eebc (table default.Table_b573e4ef396d40db9c2826cfe0f16a50 [id=86eed90829f74d9ca03b1fda746d3151])
I20260928 01:56:35.472023 22709 raft_consensus.cc:515] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:35.498921 22709 leader_election.cc:290] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:35.507087 22697 tablet_loader.cc:96] loaded metadata for tablet b4b520e89c364692af1aedde2a59c3da (table default.Table_6768d7dba2d94bb7b10a14976016f84b [id=0f8b37abea6f4860b6a9115716e962ca])
I20260928 01:56:35.512041 22697 tablet_loader.cc:96] loaded metadata for tablet b60e7bd679e447d18e340cfaed66d328 (table default.Table_74308c5165a043f7a175675c414ee652 [id=fcc02628377b4bbaaf98b333d59da1d5])
W20260928 01:56:35.521344 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 72447.6us
I20260928 01:56:35.520866 22697 tablet_loader.cc:96] loaded metadata for tablet b8cacb4a90a54cd3b5b3e7a9310e06ed (table default.Table_1c064907f1024f8e96ecbc0422212255 [id=81ec7946e2dd477082677adbcdb8c32d])
I20260928 01:56:35.528787 22532 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:35.529310 22532 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:35.530596 22697 tablet_loader.cc:96] loaded metadata for tablet ba89039dcfa848159112caa76802b5f1 (table default.Table_fc937fcafd1c43aa8dad79a6f33508cf [id=ac18dba12cac41868f3d478b5af79749])
I20260928 01:56:35.531409 22532 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:35.532583 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:35.533093 19619 raft_consensus.cc:3060] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:35.536491 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:35.535553 22697 tablet_loader.cc:96] loaded metadata for tablet bab12ba3e1f542949e3f203dae0fa80e (table default.Table_fc433ca62dc241a89de45a60e9a5db1e [id=7357b42a9f8841be8686aac83d9f47fb])
I20260928 01:56:35.537092 19618 raft_consensus.cc:2468] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 4.
I20260928 01:56:35.538938 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:35.539681 19610 raft_consensus.cc:3060] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:35.540572 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:35.541118 19611 raft_consensus.cc:3060] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:35.545262 22697 tablet_loader.cc:96] loaded metadata for tablet c2597de2c4304074977db5a3c0426814 (table default.Table_35e1185d8a634d25a18a9b67e3ddfb11 [id=88fa341137a549aa8fca64677c98765e])
I20260928 01:56:35.549376 19611 raft_consensus.cc:2468] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:35.551086 19619 raft_consensus.cc:2468] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:35.549387 19610 raft_consensus.cc:2468] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:35.557731 19704 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:35.557408 22697 tablet_loader.cc:96] loaded metadata for tablet c53d75604ee3405d83fe9ecaa824ea68 (table default.Table_a841520189cd409693d77754fa85be49 [id=4905e126b2c94cf7bfeac0abcec89513])
I20260928 01:56:35.559585 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5018f065824614a42f93afd49f770e" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:35.560192 19459 raft_consensus.cc:3060] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 3
I20260928 01:56:35.562515 22697 tablet_loader.cc:96] loaded metadata for tablet c74a4a00552c4a14a871a59465524f1c (table default.Table_2b02108aba00496e82910dfcb4866a83 [id=507854e3bf2d41bdb562e06d1ee4ee0a])
W20260928 01:56:35.570757 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 60668.8us
W20260928 01:56:35.572363 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 54326.2us
I20260928 01:56:35.572686 19459 raft_consensus.cc:2468] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:35.573143 22697 tablet_loader.cc:96] loaded metadata for tablet c8fd6b965d22477aaee9bafccb2069b1 (table default.Table_7fd82b0e9ca64b8e9d4a715fe2957472 [id=e27d950c3bd844ba91512ece0b268b02])
I20260928 01:56:35.579558 22697 tablet_loader.cc:96] loaded metadata for tablet c9f3e966ab0d46d187fb9daa356b16fc (table default.Table_bc7db84520fe44218722802e24b939f1 [id=750ef7d56dfd4d64924804b543090a1b])
I20260928 01:56:35.580061 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:35.581240 19619 raft_consensus.cc:2468] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:35.583973 19704 leader_election.cc:304] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:35.584908 22697 tablet_loader.cc:96] loaded metadata for tablet ca443386942e49d9a66143e1fde777c5 (table default.Table_9fd15739cad24b449aed7e2a9f1066ba [id=4e58aaecd03c4a4ba4c4180c87891b8e])
I20260928 01:56:35.590205 19704 leader_election.cc:304] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:35.586573 19762 raft_consensus.cc:1240] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Rejecting Update request from peer a3ee288ca1464d20a715673422a214a0 for earlier term 2. Current term is 3. Ops: []
I20260928 01:56:35.584619 22740 raft_consensus.cc:2804] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260928 01:56:35.596669 22740 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:35.597151 22740 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Advancing to term 5
I20260928 01:56:35.598814 22697 tablet_loader.cc:96] loaded metadata for tablet d0cb771766b44b149d3ed3ddf75a7474 (table default.Table_26d5ae1cf8d444c2b34571d43922ff0a [id=504c0a60661340feb59f8cb73a219305])
I20260928 01:56:35.591028 22741 raft_consensus.cc:2804] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:35.600937 22741 raft_consensus.cc:697] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:35.604547 22697 tablet_loader.cc:96] loaded metadata for tablet d114d5ba862044b4b88eee27395db7e3 (table default.Table_b8b37004aead4426bc97d72999385fc4 [id=ffe6871a6b254bcaaaf11b6401a782bb])
I20260928 01:56:35.605680 22653 raft_consensus.cc:2804] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:35.606395 22653 raft_consensus.cc:697] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:35.607774 22653 consensus_queue.cc:237] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:35.611888 19704 leader_election.cc:304] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:35.615653 22697 tablet_loader.cc:96] loaded metadata for tablet d7774406b22547d29d9d42c969cf0874 (table default.Table_42b632d0b0ce475d9d3be797e7627a54 [id=1d0852f32fa247efb0395bfde5738daa])
I20260928 01:56:35.602162 22741 consensus_queue.cc:237] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:35.622026 22697 tablet_loader.cc:96] loaded metadata for tablet e2d1238d0a2d45c0a708442fd0b17291 (table default.Table_361dd359d4a94951a2addad1cb55ea43 [id=b68a185fa2a745eb94727852ea87a0a4])
I20260928 01:56:35.618566 22706 raft_consensus.cc:2804] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:35.625568 22697 tablet_loader.cc:96] loaded metadata for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e])
I20260928 01:56:35.626207 22706 raft_consensus.cc:697] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:35.627561 22697 tablet_loader.cc:96] loaded metadata for tablet e6206afe245740b1819069a48e8b548e (table default.Table_8504d275b8c443b4a11c42114c171548 [id=a7cce1c6b87a4f44a73c790058d68d37])
I20260928 01:56:35.627140 22706 consensus_queue.cc:237] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:35.630923 22697 tablet_loader.cc:96] loaded metadata for tablet e927cd8a991f46278c2bb663cee7f753 (table default.Table_4da1fee6daf34cb38d91b8fc6aa55ada [id=3748364f759249e3927a000ebc538a75])
I20260928 01:56:35.632941 22697 tablet_loader.cc:96] loaded metadata for tablet ea77f3197ee5496d9624cc76b3361ace (table default.Table_9f072eb1b00c47a4a86bf2607864b4d4 [id=061fd785787a42ad89ff507723fe0cba])
I20260928 01:56:35.638731 22697 tablet_loader.cc:96] loaded metadata for tablet eb014699060e4a6caf4caaf33c31710a (table default.Table_939a932b08754e3a82655a7da68b403a [id=96389ab8c3ef4c938b50982202dc293f])
I20260928 01:56:35.642148 22697 tablet_loader.cc:96] loaded metadata for tablet ef752c3b4b22490ab42292f61278da52 (table default.Table_944ae66f379b4d43964c05fad29a0868 [id=c2f8952644ed4c05ba4e9d4e07839619])
I20260928 01:56:35.647663 19762 raft_consensus.cc:1275] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260928 01:56:35.648025 19762 pending_rounds.cc:85] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da: Aborting all ops after (but not including) 1
I20260928 01:56:35.648249 19762 pending_rounds.cc:107] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260928 01:56:35.648479 19762 raft_consensus.cc:2889] T 9f80b652a19a41968d1bfbaaf020b721 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 01:56:35.650743 22697 tablet_loader.cc:96] loaded metadata for tablet f7b78eb499d6418f8877bf3b59bbbec2 (table default.Table_a880aa6453b54575a6c2741c2d07be1f [id=49cc3ec3316d4dc991b2ff8a5f126d9d])
I20260928 01:56:35.619410 19704 leader_election.cc:304] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:35.652720 22697 tablet_loader.cc:96] loaded metadata for tablet f887fe10461d40ee9363ce97ebbedd4f (table default.Table_9499fd7d814b4e8c9bdadad20f2c6e24 [id=9aa1a7d5b8204c1f9c63ddd7606ff9c9])
I20260928 01:56:35.653801 22738 raft_consensus.cc:2804] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 01:56:35.654160 22738 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:35.654464 22738 raft_consensus.cc:3060] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:56:35.654616 22697 tablet_loader.cc:96] loaded metadata for tablet fa3b9ec9f88342c0aa77c0fc92d26205 (table default.Table_03092b9603354c0db5923e1d87791230 [id=8784b0acf3764063b2962f69928ced87])
I20260928 01:56:35.656553 22697 tablet_loader.cc:96] loaded metadata for tablet fb159b3aad31479f80683b0d80549cc3 (table default.Table_df1a47a6c1694b6aae398d41b675186e [id=fc46b47bb22f4be1abc44b9101985f5b])
I20260928 01:56:35.658535 22697 tablet_loader.cc:96] loaded metadata for tablet fc428ccbf88e4d5cbae197cb67e9a0a5 (table default.Table_45790ef1ddd242aeac56787eb4a556e1 [id=ee2ce0ea67fc482c8e3d65304ceb1a14])
I20260928 01:56:35.660396 22697 tablet_loader.cc:96] loaded metadata for tablet fcf1b727e86a43b08bd464647fa529a3 (table default.Table_5a6972316f7940d88c5a2f5d5a17284f [id=074f473600834c4996599b29fe087619])
I20260928 01:56:35.684592 22703 consensus_queue.cc:1059] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:35.685289 22703 consensus_queue.cc:1243] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Peer 8373bfae1f384c36b5e4c5ca26b208da log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260928 01:56:35.685709 22703 raft_consensus.cc:3055] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Stepping down as leader of term 2
I20260928 01:56:35.686002 22703 raft_consensus.cc:740] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:35.686777 22703 consensus_queue.cc:260] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:35.687873 22703 raft_consensus.cc:3060] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:35.690517 22740 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:35.691495 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 10 candidate_status { last_received { term: 9 index: 392 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:56:35.691532 19120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 10 candidate_status { last_received { term: 9 index: 392 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
W20260928 01:56:35.692338 19126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54824 (request call id 47) took 740 ms (client timeout 543 ms). Trace:
W20260928 01:56:35.692662 19126 rpcz_store.cc:269] 0928 01:56:34.951510 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:34.951659 (+   149us) service_pool.cc:224] Handling call
0928 01:56:35.692275 (+740616us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 01:56:35.693324 22697 catalog_manager.cc:1525] Time spent T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Loading table and tablet metadata into memory: real 1.786s	user 0.432s	sys 0.057s
I20260928 01:56:35.693564 22697 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 01:56:35.706372 22684 consensus_queue.cc:1048] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:35.716755 22697 catalog_manager.cc:1308] Loaded cluster ID: 726a03a5ce124d548da65567db2a283d
I20260928 01:56:35.717046 22697 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:56:35.739591 22697 catalog_manager.cc:1553] Loading token signing keys...
I20260928 01:56:35.759676 19409 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: a3ee288ca1464d20a715673422a214a0
W20260928 01:56:35.791455 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 202672us
I20260928 01:56:35.795936 22697 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Loaded TSK: 0
I20260928 01:56:35.797457 22697 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 01:56:35.799116 19619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:35.799883 19619 raft_consensus.cc:2368] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:35.812949 22614 raft_consensus.cc:2804] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 01:56:35.813819 22614 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:35.814522 22614 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:56:35.837235 22740 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 5 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:35.842731 22649 raft_consensus.cc:493] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:35.843454 22649 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:35.845079 22738 raft_consensus.cc:515] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:35.846410 22649 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:35.846977 22649 raft_consensus.cc:493] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:35.847323 22738 leader_election.cc:290] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 4 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:35.847740 22649 raft_consensus.cc:515] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:35.850432 22649 leader_election.cc:290] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:35.872550 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 108393us
I20260928 01:56:35.902107 22614 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
W20260928 01:56:35.938441 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 139985us
I20260928 01:56:35.956830 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:35.957551 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:35.958194 19611 raft_consensus.cc:3060] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:56:35.957502 19616 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Advancing to term 5
I20260928 01:56:35.965699 22703 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:35.966338 22703 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:35.970645 22703 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:35.973902 19113 catalog_manager.cc:5838] T 2018f8b52f974554924f9ecfbd5a0f51 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:35.975193 19611 raft_consensus.cc:2468] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 4.
I20260928 01:56:35.976153 19616 raft_consensus.cc:2468] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 5.
I20260928 01:56:35.980022 19116 catalog_manager.cc:5838] T 29f65b0966c04012bfec3c67a37acc25 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
W20260928 01:56:36.031013 19163 debug-util.cc:398] Leaking SignalData structure 0x7b0800028e40 after lost signal to thread 19178
W20260928 01:56:36.031396 19163 kernel_stack_watchdog.cc:198] Thread 19178 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 325ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260928 01:56:35.923751 19409 leader_election.cc:304] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
W20260928 01:56:36.048738 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 125180us
I20260928 01:56:36.049898 22614 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:36.050624 22614 raft_consensus.cc:2804] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:36.050966 22614 raft_consensus.cc:493] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:36.051430 22614 raft_consensus.cc:3060] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:35.929760 19459 raft_consensus.cc:1275] T 9f80b652a19a41968d1bfbaaf020b721 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:35.943693 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:35.949147 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:35.998518 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982c3e07bcb94230b93764330914630f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:36.002283 19469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:36.057981 19469 raft_consensus.cc:2468] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
W20260928 01:56:36.061542 20447 leader_election.cc:336] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c17b7f9972364c76893311539b569e0f (127.18.161.61:43775): Timed out: RequestConsensusVote RPC to 127.18.161.61:43775 timed out after 0.543s (SENT)
I20260928 01:56:36.062022 20447 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:36.066538 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:36.067305 19768 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 4.
I20260928 01:56:36.084136 22614 raft_consensus.cc:515] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:36.085230 19458 raft_consensus.cc:3060] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:36.095377 22614 leader_election.cc:290] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:36.096024 19458 raft_consensus.cc:2468] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:36.111449 22703 raft_consensus.cc:493] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:36.111948 22703 raft_consensus.cc:515] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:36.117265 22703 leader_election.cc:290] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:36.133565 19704 leader_election.cc:304] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:36.134914 22754 raft_consensus.cc:2804] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Leader election won for term 4
I20260928 01:56:36.136785 22754 raft_consensus.cc:697] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:36.137574 22754 consensus_queue.cc:237] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:36.143463 19704 leader_election.cc:304] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:36.144572 22738 raft_consensus.cc:2804] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 5 FOLLOWER]: Leader election won for term 5
I20260928 01:56:36.146772 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:36.147388 19458 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 4.
I20260928 01:56:36.149255 19460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:36.149887 19460 raft_consensus.cc:2468] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:36.150174 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:36.150980 19611 raft_consensus.cc:2368] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 3. Current term is 4.
I20260928 01:56:36.165505 22767 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260928 01:56:36.228276 19460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:36.229827 19460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:36.230407 19460 raft_consensus.cc:3060] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 4
W20260928 01:56:36.244381 22768 log.cc:927] Time spent T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260928 01:56:36.245153 22738 raft_consensus.cc:697] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [term 5 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:36.246012 22738 consensus_queue.cc:237] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:36.252164 19668 heartbeater.cc:499] Master 127.18.161.62:38511 was elected leader, sending a full tablet report...
W20260928 01:56:36.246042 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 101577us
I20260928 01:56:36.261507 19553 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:36.263535 22684 raft_consensus.cc:2804] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260928 01:56:36.263887 22684 raft_consensus.cc:493] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:36.264266 22684 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Advancing to term 5
I20260928 01:56:36.275494 22684 raft_consensus.cc:515] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:36.277398 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:36.278221 19611 raft_consensus.cc:2393] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 2: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:36.316856 22755 raft_consensus.cc:493] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:36.317340 22755 raft_consensus.cc:515] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:36.318383 22684 leader_election.cc:290] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 5 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:36.322606 22755 leader_election.cc:290] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:36.335764 19611 raft_consensus.cc:1240] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3. Ops: []
I20260928 01:56:36.340924 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:36.341723 19611 raft_consensus.cc:2468] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:36.345373 19704 leader_election.cc:304] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:36.346252 22753 raft_consensus.cc:2804] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:36.346590 22753 raft_consensus.cc:493] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:36.346891 22753 raft_consensus.cc:3060] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:36.355520 19460 raft_consensus.cc:2468] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 4.
I20260928 01:56:36.356603 22753 raft_consensus.cc:515] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:36.360879 19611 raft_consensus.cc:1275] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260928 01:56:36.361279 19611 pending_rounds.cc:85] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0: Aborting all ops after (but not including) 1
I20260928 01:56:36.361493 19611 pending_rounds.cc:107] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260928 01:56:36.361706 19611 raft_consensus.cc:2889] T 8e39fce4f0a149a898de678d73052f52 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 01:56:36.364003 22755 consensus_queue.cc:1048] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:36.374816 22753 leader_election.cc:290] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:36.377928 19611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:36.378734 19611 raft_consensus.cc:3060] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:36.387723 19761 raft_consensus.cc:1240] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Rejecting Update request from peer 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3. Ops: []
I20260928 01:56:36.388130 19611 raft_consensus.cc:2468] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:36.415518 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:36.416384 19616 raft_consensus.cc:2368] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 4. Current term is 5.
I20260928 01:56:36.418081 22684 consensus_queue.cc:1048] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:36.425383 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:36.426419 19616 raft_consensus.cc:2368] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:36.428678 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60e7bd679e447d18e340cfaed66d328" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:36.431962 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:36.433701 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:36.434510 19762 raft_consensus.cc:2368] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:36.441016 19768 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 4.
I20260928 01:56:36.444631 19704 leader_election.cc:304] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:36.450783 22738 raft_consensus.cc:2804] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:36.452487 22738 raft_consensus.cc:697] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:36.453344 22738 consensus_queue.cc:237] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } }
I20260928 01:56:36.460716 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:36.461656 19458 raft_consensus.cc:2468] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:36.468686 19114 catalog_manager.cc:5838] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:36.473429 19447 tablet_service.cc:1511] Processing CreateTablet for tablet 164564bc2c97430da228a621aa545e5a (DEFAULT_TABLE table=default.Table_f064df9b0ba6484e8b4ff02df3f02433 [id=50e7e099a7b64f7094ba08d3e6871a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:36.474886 19447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 164564bc2c97430da228a621aa545e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:36.477458 19446 tablet_service.cc:1511] Processing CreateTablet for tablet 4d8a70d4a8654947be5ab2eb5539b3c9 (DEFAULT_TABLE table=default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:36.478619 19446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8a70d4a8654947be5ab2eb5539b3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:36.485590 19591 tablet_service.cc:1511] Processing CreateTablet for tablet 164564bc2c97430da228a621aa545e5a (DEFAULT_TABLE table=default.Table_f064df9b0ba6484e8b4ff02df3f02433 [id=50e7e099a7b64f7094ba08d3e6871a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:36.471975 19114 catalog_manager.cc:5838] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3, leader changed from 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:36.488497 19114 catalog_manager.cc:5838] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 2, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:36.490600 19114 catalog_manager.cc:5838] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:36.496351 22753 raft_consensus.cc:493] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:36.496893 22753 raft_consensus.cc:515] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:36.498814 19758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cb771766b44b149d3ed3ddf75a7474" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:36.499428 22753 leader_election.cc:290] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:36.514827 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:36.515550 19458 raft_consensus.cc:3060] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 3
I20260928 01:56:36.521088 19460 raft_consensus.cc:1275] T 8e39fce4f0a149a898de678d73052f52 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:36.525583 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:36.526280 19591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 164564bc2c97430da228a621aa545e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:36.526314 19616 raft_consensus.cc:2468] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 2.
I20260928 01:56:36.539883 19412 leader_election.cc:400] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) with higher term. Message: Invalid argument: T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:36.543748 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:36.544382 19466 raft_consensus.cc:2468] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:36.533499 19704 leader_election.cc:304] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:36.547119 19592 tablet_service.cc:1511] Processing CreateTablet for tablet 4d8a70d4a8654947be5ab2eb5539b3c9 (DEFAULT_TABLE table=default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:36.548303 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8a70d4a8654947be5ab2eb5539b3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:36.548385 19460 raft_consensus.cc:3055] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 2 LEADER]: Stepping down as leader of term 2
I20260928 01:56:36.548810 19460 raft_consensus.cc:740] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Running, Role: LEADER
I20260928 01:56:36.549712 19460 consensus_queue.cc:260] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:36.550803 19460 raft_consensus.cc:3060] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:36.554260 19114 catalog_manager.cc:5838] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:36.556262 19114 catalog_manager.cc:5838] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3, leader changed from 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:36.561065 19114 catalog_manager.cc:5838] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:36.569589 22706 raft_consensus.cc:2804] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:36.569965 22706 raft_consensus.cc:493] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:36.570267 22706 raft_consensus.cc:3060] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:36.579381 19441 tablet_service.cc:1511] Processing CreateTablet for tablet 71a064862b854ad4af884e4ca95ffb31 (DEFAULT_TABLE table=default.Table_c559f34b8864494f82ca062207ebbecf [id=94c9af4db37f4a2a8459631624fbc5de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:36.581243 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a064862b854ad4af884e4ca95ffb31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:36.587375 22780 tablet_bootstrap.cc:492] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:36.597052 19458 raft_consensus.cc:2468] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:36.605109 22780 tablet_bootstrap.cc:654] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:36.623193 19592 tablet_service.cc:1511] Processing CreateTablet for tablet 71a064862b854ad4af884e4ca95ffb31 (DEFAULT_TABLE table=default.Table_c559f34b8864494f82ca062207ebbecf [id=94c9af4db37f4a2a8459631624fbc5de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:36.608453 19412 leader_election.cc:400] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Vote denied by peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) with higher term. Message: Invalid argument: T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 3. Current term is 4.
I20260928 01:56:36.626767 19412 leader_election.cc:403] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260928 01:56:36.632078 22780 tablet_bootstrap.cc:492] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:36.632894 22780 ts_tablet_manager.cc:1403] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.010s
I20260928 01:56:36.634199 22706 raft_consensus.cc:515] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:36.636219 22706 leader_election.cc:290] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:36.636370 22780 raft_consensus.cc:359] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:36.637295 22780 raft_consensus.cc:385] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:36.637630 22780 raft_consensus.cc:740] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:36.638633 22780 consensus_queue.cc:260] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:36.643874 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:36.644695 19616 raft_consensus.cc:3060] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:36.648680 19590 tablet_service.cc:1511] Processing CreateTablet for tablet a1e74d73a7eb44cd97c2c1df77b8b20c (DEFAULT_TABLE table=default.Table_8c45cdb1505f4f2c98e33582a08d4915 [id=23e1ba18b554433da62038872faa0ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:36.654827 22780 ts_tablet_manager.cc:1434] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.021s	user 0.000s	sys 0.006s
W20260928 01:56:36.655313 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 47007us
I20260928 01:56:36.656023 19592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a064862b854ad4af884e4ca95ffb31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:36.660320 19590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e74d73a7eb44cd97c2c1df77b8b20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:36.669301 19616 raft_consensus.cc:2468] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:36.672106 19704 leader_election.cc:304] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:36.672950 22753 raft_consensus.cc:2804] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:36.673450 22753 raft_consensus.cc:697] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:36.674407 22753 consensus_queue.cc:237] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:36.675575 19114 catalog_manager.cc:5838] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:36.679117 19114 catalog_manager.cc:5838] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:36.699337 22780 tablet_bootstrap.cc:492] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:36.707248 22780 tablet_bootstrap.cc:654] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:36.709380 19611 raft_consensus.cc:1275] T 0d5018f065824614a42f93afd49f770e P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260928 01:56:36.712512 19445 tablet_service.cc:1511] Processing CreateTablet for tablet a1e74d73a7eb44cd97c2c1df77b8b20c (DEFAULT_TABLE table=default.Table_8c45cdb1505f4f2c98e33582a08d4915 [id=23e1ba18b554433da62038872faa0ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:36.713639 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e74d73a7eb44cd97c2c1df77b8b20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:36.715708 19460 raft_consensus.cc:1275] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260928 01:56:36.716053 19460 pending_rounds.cc:85] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614: Aborting all ops after (but not including) 2
I20260928 01:56:36.716295 19460 pending_rounds.cc:107] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260928 01:56:36.718520 19460 raft_consensus.cc:2889] T 982c3e07bcb94230b93764330914630f P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 01:56:36.716728 22751 raft_consensus.cc:2749] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) with higher term. Message: Invalid argument: T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 3. Current term is 4.
W20260928 01:56:36.761063 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 50516.2us
I20260928 01:56:36.762533 22780 tablet_bootstrap.cc:492] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:36.763008 22780 ts_tablet_manager.cc:1403] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.001s
I20260928 01:56:36.763103 19412 leader_election.cc:400] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 election: Vote denied by peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) with higher term. Message: Invalid argument: T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 4. Current term is 5.
I20260928 01:56:36.763487 19412 leader_election.cc:403] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260928 01:56:36.765874 22784 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Advancing to term 5
I20260928 01:56:36.771045 22703 raft_consensus.cc:493] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:36.771659 22738 consensus_queue.cc:1048] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:36.771633 22703 raft_consensus.cc:515] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:36.773725 22703 leader_election.cc:290] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:36.777846 22780 raft_consensus.cc:359] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:36.778811 22780 raft_consensus.cc:385] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:36.779168 22780 raft_consensus.cc:740] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:36.780004 22780 consensus_queue.cc:260] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:36.795683 22780 ts_tablet_manager.cc:1434] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.004s
I20260928 01:56:36.795832 22785 tablet_bootstrap.cc:492] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:36.799885 22780 tablet_bootstrap.cc:492] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
I20260928 01:56:36.802028 22784 raft_consensus.cc:2749] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) with higher term. Message: Invalid argument: T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 4. Current term is 5.
I20260928 01:56:36.804669 22684 raft_consensus.cc:493] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:36.805143 22684 raft_consensus.cc:515] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:36.805950 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 114673us
I20260928 01:56:36.807106 22684 leader_election.cc:290] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:36.826911 22780 tablet_bootstrap.cc:654] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
W20260928 01:56:36.802639 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 103865us
W20260928 01:56:36.837348 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 74400.6us
I20260928 01:56:36.854399 19527 heartbeater.cc:499] Master 127.18.161.62:38511 was elected leader, sending a full tablet report...
I20260928 01:56:36.869115 19409 leader_election.cc:400] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) with higher term. Message: Invalid argument: T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:36.869407 19409 leader_election.cc:403] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260928 01:56:36.869975 22788 raft_consensus.cc:2749] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) with higher term. Message: Invalid argument: T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:36.872622 19412 leader_election.cc:400] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Vote denied by peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) with higher term. Message: Invalid argument: T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:36.883319 22780 tablet_bootstrap.cc:492] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:36.883787 22780 ts_tablet_manager.cc:1403] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.000s
I20260928 01:56:36.886598 22780 raft_consensus.cc:359] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:36.887320 22780 raft_consensus.cc:385] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:36.887610 22780 raft_consensus.cc:740] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:36.894384 22780 consensus_queue.cc:260] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:36.909149 22780 ts_tablet_manager.cc:1434] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.006s
I20260928 01:56:36.910295 22780 tablet_bootstrap.cc:492] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0: Bootstrap starting.
W20260928 01:56:36.919400 22782 log.cc:927] Time spent T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260928 01:56:36.928444 22780 tablet_bootstrap.cc:654] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:36.928885 19412 leader_election.cc:403] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260928 01:56:36.930636 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 55508.7us
I20260928 01:56:36.943075 19608 raft_consensus.cc:1275] T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260928 01:56:36.948175 19748 tablet_service.cc:1511] Processing CreateTablet for tablet 4d8a70d4a8654947be5ab2eb5539b3c9 (DEFAULT_TABLE table=default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:36.949306 22780 tablet_bootstrap.cc:492] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0: No bootstrap required, opened a new log
I20260928 01:56:36.949416 19748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8a70d4a8654947be5ab2eb5539b3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:36.949781 22780 ts_tablet_manager.cc:1403] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.006s
I20260928 01:56:36.948073 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 164564bc2c97430da228a621aa545e5a (DEFAULT_TABLE table=default.Table_f064df9b0ba6484e8b4ff02df3f02433 [id=50e7e099a7b64f7094ba08d3e6871a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:36.952530 22780 raft_consensus.cc:359] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:36.953167 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 164564bc2c97430da228a621aa545e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:36.953214 22780 raft_consensus.cc:385] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:36.953469 22780 raft_consensus.cc:740] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Initialized, Role: FOLLOWER
I20260928 01:56:36.954144 22780 consensus_queue.cc:260] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:36.955878 22780 ts_tablet_manager.cc:1434] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260928 01:56:36.965597 22794 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 81ebb46a410e43ebaec3ef4dd13a71fc)
I20260928 01:56:36.967411 22794 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:36.973423 22794 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
W20260928 01:56:36.975802 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 56686.1us
I20260928 01:56:36.980276 22754 consensus_queue.cc:1048] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260928 01:56:36.984982 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 53692.1us
W20260928 01:56:36.996744 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 124243us
I20260928 01:56:37.003863 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 10 candidate_status { last_received { term: 9 index: 395 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:56:37.008975 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 71a064862b854ad4af884e4ca95ffb31 (DEFAULT_TABLE table=default.Table_c559f34b8864494f82ca062207ebbecf [id=94c9af4db37f4a2a8459631624fbc5de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:37.010459 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a064862b854ad4af884e4ca95ffb31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:37.020583 22751 raft_consensus.cc:2749] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) with higher term. Message: Invalid argument: T d0cb771766b44b149d3ed3ddf75a7474 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:37.025342 19740 tablet_service.cc:1511] Processing CreateTablet for tablet a1e74d73a7eb44cd97c2c1df77b8b20c (DEFAULT_TABLE table=default.Table_8c45cdb1505f4f2c98e33582a08d4915 [id=23e1ba18b554433da62038872faa0ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:56:37.026505 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e74d73a7eb44cd97c2c1df77b8b20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:56:37.031596 22684 raft_consensus.cc:493] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:37.032106 22684 raft_consensus.cc:515] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.034211 22684 leader_election.cc:290] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:37.039641 19768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f887fe10461d40ee9363ce97ebbedd4f" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:37.042083 19556 leader_election.cc:304] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:37.044875 22703 raft_consensus.cc:2764] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260928 01:56:37.053858 19409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 67375.8us
I20260928 01:56:37.087898 22785 tablet_bootstrap.cc:654] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:37.117795 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:37.118364 19751 raft_consensus.cc:3060] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Advancing to term 5
I20260928 01:56:37.126001 19751 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 5.
I20260928 01:56:37.155174 22754 consensus_queue.cc:1048] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260928 01:56:37.156741 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 173669us
I20260928 01:56:37.192193 22754 consensus_queue.cc:1048] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:37.159350 19460 raft_consensus.cc:1275] T 0d5018f065824614a42f93afd49f770e P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260928 01:56:37.161983 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7774406b22547d29d9d42c969cf0874" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:37.214741 19458 raft_consensus.cc:3060] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 3
I20260928 01:56:37.222510 19458 raft_consensus.cc:2468] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 3.
I20260928 01:56:37.166396 19466 raft_consensus.cc:1275] T d0cb771766b44b149d3ed3ddf75a7474 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260928 01:56:37.226064 22684 raft_consensus.cc:493] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:37.226548 22684 raft_consensus.cc:515] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.229714 22684 leader_election.cc:290] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:37.234794 22618 op_tracker.cc:284] OpTracker waiting for 2 outstanding ops to complete now for 5.312s
I20260928 01:56:37.235136 22618 op_tracker.cc:286] Dumping up to 50 currently running ops: 
I20260928 01:56:37.235371 22618 op_tracker.cc:290] R-P WriteOp [type=LEADER, start_time=2026-09-28 01:56:33, state=WriteOpState 0x7b5800100e00 [op_id=(), ts=7334136189723095040, rows=[MUTATE (int8 entry_type=<redacted>, string entry_id=<redacted>) SET metadata=<redacted>]]]
W20260928 01:56:37.236276 19163 debug-util.cc:398] Leaking SignalData structure 0x7b0800037f60 after lost signal to thread 19177
W20260928 01:56:37.236547 19163 kernel_stack_watchdog.cc:198] Thread 19177 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 2549ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260928 01:56:37.240121 22795 raft_consensus.cc:493] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:37.240767 22795 raft_consensus.cc:515] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:37.235960 22618 op_tracker.cc:290] RD-P WriteOp [type=LEADER, start_time=2026-09-28 01:56:32, state=WriteOpState 0x7b5800110a00 [op_id=(term: 8 index: 391), ts=7334136188630769664, rows=[INSERT (int8 entry_type=<redacted>, string entry_id=<redacted>, string metadata=<redacted>), MUTATE (int8 entry_type=<redacted>, string entry_id=<redacted>) SET metadata=<redacted>]]]
I20260928 01:56:37.251963 22795 leader_election.cc:290] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:37.252557 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 60557.5us
W20260928 01:56:37.266569 19114 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 130) took 1173 ms (client timeout 1000 ms). Trace:
I20260928 01:56:37.268649 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:37.269579 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a064862b854ad4af884e4ca95ffb31" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:37.269583 19751 raft_consensus.cc:2468] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 2.
I20260928 01:56:37.273371 22799 tablet_bootstrap.cc:492] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:37.282692 22786 raft_consensus.cc:493] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8373bfae1f384c36b5e4c5ca26b208da)
I20260928 01:56:37.283288 22786 raft_consensus.cc:515] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.285557 22786 leader_election.cc:290] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:37.299171 19114 rpcz_store.cc:269] 0928 01:56:36.092686 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:36.092845 (+   159us) service_pool.cc:224] Handling call
0928 01:56:36.157623 (+ 64778us) spinlock_profiling.cc:243] Waited 58.3 ms on lock 0x7b5400030554. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19fd6b75c0 00007f19fd7566fa 00007f19ff4c7d8c 00007f19ff5c601e 00007f19fd16afb4 00007f19fd16af42 00007f19fd16ae71 00007f19fd16adec 00007f19fd16a0a2 00007f19fb41c09c 00007f19fb41b4d6
0928 01:56:37.266481 (+1108858us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:37.048162 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:37.048780 (+   618us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:37.048838 (+    58us) write_op.cc:435] Acquired schema lock
0928 01:56:37.048872 (+    34us) tablet.cc:662] Decoding operations
0928 01:56:37.049908 (+  1036us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:37.049984 (+    76us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:37.050014 (+    30us) tablet.cc:685] Acquiring locks for 9 operations
0928 01:56:37.050783 (+   769us) tablet.cc:701] Row locks acquired
0928 01:56:37.050811 (+    28us) write_op.cc:260] PREPARE: finished
0928 01:56:37.050967 (+   156us) write_op.cc:270] Start()
0928 01:56:37.051082 (+   115us) write_op.cc:276] Timestamp: P: 1790560597050918 usec, L: 0
0928 01:56:37.051100 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:37.051795 (+   695us) log.cc:844] Serialized 3547 byte log entry
0928 01:56:37.180330 (+128535us) op_driver.cc:464] REPLICATION: finished
0928 01:56:37.214494 (+ 34164us) write_op.cc:301] APPLY: starting
0928 01:56:37.216821 (+  2327us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:37.217077 (+   256us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:37.217201 (+   124us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:37.218174 (+   973us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:37.218487 (+   313us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0928 01:56:37.218537 (+    50us) write_op.cc:312] APPLY: finished
0928 01:56:37.218858 (+   321us) log.cc:844] Serialized 71 byte log entry
0928 01:56:37.219030 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:37.219148 (+   118us) write_op.cc:454] Released schema lock
0928 01:56:37.219187 (+    39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":11,"spinlock_wait_cycles":134105344,"child_traces":[["op",{"apply.queue_time_us":33953,"apply.run_cpu_time_us":2832,"apply.run_wall_time_us":96874,"num_ops":9,"prepare.queue_time_us":43705,"raft.queue_time_us":56762,"raft.run_cpu_time_us":776,"raft.run_wall_time_us":776,"replication_time_us":129085,"thread_start_us":80788,"threads_started":3}]]}
I20260928 01:56:37.318005 20545 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Rejecting Update request from peer c17b7f9972364c76893311539b569e0f for earlier term 8. Current term is 9. Ops: []
I20260928 01:56:37.320152 22690 consensus_queue.cc:1059] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 }, Status: INVALID_TERM, Last received: 8.391, Next index: 392, Last known committed idx: 396, Time since last communication: 0.001s
W20260928 01:56:37.322793 19178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.618s	user 0.007s	sys 0.001s
W20260928 01:56:37.323195 19178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.619s	user 0.007s	sys 0.001s
I20260928 01:56:37.324558 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 10 candidate_status { last_received { term: 9 index: 392 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:56:37.325378 19177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.642s	user 0.004s	sys 0.004s
W20260928 01:56:37.325634 19177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.643s	user 0.004s	sys 0.004s
I20260928 01:56:37.326365 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet f709eccf4ab5413bbbd8b4746f185db4 (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]) successfully deleted
I20260928 01:56:37.326493 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 10 candidate_status { last_received { term: 9 index: 392 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:37.327021 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 49a73835e2854976b40b31fe752d1b1b (table default.Table_63f36a8d22184eac8a38565457441d09 [id=102958783e204ded94a67a96b0dec09b]) successfully deleted
W20260928 01:56:37.327678 19177 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 0ae3663fbe024a4e946e47339a4b9090 because the tablet was not found. No further retry: Not found: Tablet not found: 0ae3663fbe024a4e946e47339a4b9090
W20260928 01:56:37.328347 19177 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet eac01fc222dd480cbed7cac37a0e6693 because the tablet was not found. No further retry: Not found: Tablet not found: eac01fc222dd480cbed7cac37a0e6693
W20260928 01:56:37.328964 19177 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 7ab79c6ad03e481a903a0f95ae0512e6 because the tablet was not found. No further retry: Not found: Tablet not found: 7ab79c6ad03e481a903a0f95ae0512e6
I20260928 01:56:37.329432 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 10 candidate_status { last_received { term: 9 index: 395 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
W20260928 01:56:37.329552 19177 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 158edf7a5d724c88992fecbadd2cedfa because the tablet was not found. No further retry: Not found: Tablet not found: 158edf7a5d724c88992fecbadd2cedfa
W20260928 01:56:37.333020 19177 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 9ca0b52215454a99b6c5d1956088829a because the tablet was not found. No further retry: Not found: Tablet not found: 9ca0b52215454a99b6c5d1956088829a
I20260928 01:56:37.333201 22689 consensus_queue.cc:765] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Error trying to read ahead of the log while preparing peer request: Incomplete: Op with index 396 is ahead of the local log (next sequential op: 392). Destination peer: Peer: permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 }, Status: INVALID_TERM, Last received: 9.396, Next index: 397, Last known committed idx: 396, Time since last communication: 0.014s
W20260928 01:56:37.334182 19177 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet e05925303152462e8ca25cd15f3bedff because the tablet was not found. No further retry: Not found: Tablet not found: e05925303152462e8ca25cd15f3bedff
W20260928 01:56:37.334836 19177 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 89e1d60db21f4a8294792df3fadf5d90 because the tablet was not found. No further retry: Not found: Tablet not found: 89e1d60db21f4a8294792df3fadf5d90
I20260928 01:56:37.335047 20447 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
W20260928 01:56:37.335492 19177 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 7daa1b799e0d408287edc03988f5b683 because the tablet was not found. No further retry: Not found: Tablet not found: 7daa1b799e0d408287edc03988f5b683
I20260928 01:56:37.335856 22794 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260928 01:56:37.336021 19177 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 3c6cfc9ff3344a48b09730dfde79d6cf because the tablet was not found. No further retry: Not found: Tablet not found: 3c6cfc9ff3344a48b09730dfde79d6cf
W20260928 01:56:37.336596 19177 catalog_manager.cc:5030] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): delete failed for tablet 22fc9eff28c4436fb383c3d7169171bb because the tablet was not found. No further retry: Not found: Tablet not found: 22fc9eff28c4436fb383c3d7169171bb
I20260928 01:56:37.337671 19185 catalog_manager.cc:6133] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: Sending DeleteTablet for 3 replicas of tablet e8f6ce7612d4463ebe95e07557bca4e7
I20260928 01:56:37.338346 22785 tablet_bootstrap.cc:492] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:37.338841 22785 ts_tablet_manager.cc:1403] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.543s	user 0.011s	sys 0.000s
I20260928 01:56:37.339254 19185 catalog_manager.cc:6934] ReplaceTablet: tablet e8f6ce7612d4463ebe95e07557bca4e7 deleted and replaced by tablet 4d8a70d4a8654947be5ab2eb5539b3c9
I20260928 01:56:37.339624 19185 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:60098 (request call id 31) took 8066 ms. Trace:
I20260928 01:56:37.340320 19186 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:60098 (request call id 53) took 4228 ms. Trace:
I20260928 01:56:37.340651 19186 rpcz_store.cc:276] 0928 01:56:33.111890 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:33.112023 (+   133us) service_pool.cc:224] Handling call
0928 01:56:37.339784 (+4227761us) spinlock_profiling.cc:243] Waited 4.23 s on lock 0x7b5400030554. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbb5c0 00007f2fcdc5a6fa 00007f2fcf9cbd8c 00007f2fcfacd2f9 00007f2fcd671534 00007f2fcd6714c2 00007f2fcd6713f1 00007f2fcd67136c 00007f2fcd670622 00007f2fcb92009c 00007f2fcb91f4d6
0928 01:56:37.340249 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9721674496}
I20260928 01:56:37.339389 22689 consensus_queue.cc:765] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [LEADER]: Error trying to read ahead of the log while preparing peer request: Incomplete: Op with index 396 is ahead of the local log (next sequential op: 393). Destination peer: Peer: permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 }, Status: INVALID_TERM, Last received: 9.396, Next index: 397, Last known committed idx: 396, Time since last communication: 0.020s
I20260928 01:56:37.341706 19591 tablet_service.cc:1558] Processing DeleteTablet for tablet e8f6ce7612d4463ebe95e07557bca4e7 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d8a70d4a8654947be5ab2eb5539b3c9) from {username='slave'} at 127.0.0.1:57616
W20260928 01:56:37.341728 19186 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 285) took 4137 ms (client timeout 1000 ms). Trace:
W20260928 01:56:37.345974 19186 rpcz_store.cc:269] 0928 01:56:33.204768 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:37.341566 (+4136798us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:37.341669 (+   103us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:37.347214 19186 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 264) took 3999 ms (client timeout 1000 ms). Trace:
W20260928 01:56:37.347544 19186 rpcz_store.cc:269] 0928 01:56:33.347648 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:37.347052 (+3999404us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:37.347156 (+   104us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 01:56:37.348547 19446 tablet_service.cc:1558] Processing DeleteTablet for tablet e8f6ce7612d4463ebe95e07557bca4e7 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d8a70d4a8654947be5ab2eb5539b3c9) from {username='slave'} at 127.0.0.1:50444
W20260928 01:56:37.351181 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 90477.7us
W20260928 01:56:37.351421 19186 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:53391 (request call id 263) took 3601 ms (client timeout 1000 ms). Trace:
W20260928 01:56:37.352159 19186 rpcz_store.cc:269] 0928 01:56:33.749698 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:37.348186 (+3598488us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:37.351361 (+  3175us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:37.353351 19186 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 286) took 2643 ms (client timeout 1000 ms). Trace:
I20260928 01:56:37.354192 19459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664b608bb0f54fc5baa10622f7d916c1" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:37.355147 19610 raft_consensus.cc:1275] T b60e7bd679e447d18e340cfaed66d328 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260928 01:56:37.342206 22647 raft_consensus.cc:3055] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 8 LEADER]: Stepping down as leader of term 8
I20260928 01:56:37.345366 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 391 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:37.339937 19185 rpcz_store.cc:276] 0928 01:56:29.273021 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.283545 (+ 10524us) service_pool.cc:224] Handling call
0928 01:56:37.339563 (+8056018us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:32.848476 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:32.848945 (+   469us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:32.848972 (+    27us) write_op.cc:435] Acquired schema lock
0928 01:56:32.848988 (+    16us) tablet.cc:662] Decoding operations
0928 01:56:32.894776 (+ 45788us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:32.894859 (+    83us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:32.894940 (+    81us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:56:32.927208 (+ 32268us) tablet.cc:701] Row locks acquired
0928 01:56:32.927239 (+    31us) write_op.cc:260] PREPARE: finished
0928 01:56:32.927507 (+   268us) write_op.cc:270] Start()
0928 01:56:32.927618 (+   111us) write_op.cc:276] Timestamp: P: 1790560592927434 usec, L: 0
0928 01:56:32.927637 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:33.046205 (+118568us) log.cc:844] Serialized 659 byte log entry
0928 01:56:33.089334 (+ 43129us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400030554. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbaaa1 00007f2fcdc4d5e8 00007f2fce0dd791 00007f2fce0dcf68 00007f2fce0e1c01 00007f2fce0e1bb9 00007f2fce0e1b49 00007f2fce0e1b11 00007f2fce0e0d3d 00000000005bd4e4 00000000005bd319
0928 01:56:37.232912 (+4143578us) op_driver.cc:464] REPLICATION: finished
0928 01:56:37.323697 (+ 90785us) write_op.cc:301] APPLY: starting
0928 01:56:37.323761 (+    64us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:37.323878 (+   117us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:37.323896 (+    18us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:37.324354 (+   458us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:37.324564 (+   210us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:37.324606 (+    42us) write_op.cc:312] APPLY: finished
0928 01:56:37.324796 (+   190us) log.cc:844] Serialized 29 byte log entry
0928 01:56:37.336814 (+ 12018us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:37.336946 (+   132us) write_op.cc:454] Released schema lock
0928 01:56:37.336979 (+    33us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":90574,"num_ops":2,"prepare.queue_time_us":118000,"prepare.run_cpu_time_us":5661,"prepare.run_wall_time_us":241127,"raft.queue_time_us":3519,"raft.run_cpu_time_us":1939,"raft.run_wall_time_us":71851,"replication_time_us":170185,"spinlock_wait_cycles":267720448,"thread_start_us":99639,"threads_started":2,"wal-append.queue_time_us":11938}]]}
W20260928 01:56:37.356401 19185 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 265) took 2620 ms (client timeout 1000 ms). Trace:
W20260928 01:56:37.356698 19185 rpcz_store.cc:269] 0928 01:56:34.736490 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:37.356242 (+2619752us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:37.356345 (+   103us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 01:56:37.357571 19185 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 287) took 1340 ms (client timeout 1000 ms). Trace:
W20260928 01:56:37.357849 19185 rpcz_store.cc:269] 0928 01:56:36.017201 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:37.357414 (+1340213us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:37.357520 (+   106us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 01:56:37.363797 22647 raft_consensus.cc:740] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c17b7f9972364c76893311539b569e0f, State: Running, Role: LEADER
W20260928 01:56:37.354025 19186 rpcz_store.cc:269] 0928 01:56:34.710391 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:37.353203 (+2642812us) service_pool.cc:211] Skipping call since client already timed out
0928 01:56:37.353300 (+    97us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 01:56:37.359872 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164564bc2c97430da228a621aa545e5a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:37.369029 22809 tablet_replica.cc:333] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:37.374511 22799 tablet_bootstrap.cc:654] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:37.379004 22647 consensus_queue.cc:260] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 391, Committed index: 391, Last appended: 8.392, Last appended by leader: 392, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:37.380105 22647 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 8 FOLLOWER]: Advancing to term 9
I20260928 01:56:37.382318 19553 leader_election.cc:304] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:37.383397 22703 raft_consensus.cc:2804] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 5 FOLLOWER]: Leader election won for term 5
I20260928 01:56:37.383913 22703 raft_consensus.cc:697] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [term 5 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:37.385637 22703 consensus_queue.cc:237] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:37.386957 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 391 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f"
I20260928 01:56:37.388851 19198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 391 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f"
I20260928 01:56:37.389567 19195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 391 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:37.394357 19126 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [term 9 LEADER]: Rejecting Update request from peer c17b7f9972364c76893311539b569e0f for earlier term 8. Current term is 9. Ops: []
I20260928 01:56:37.395047 22785 raft_consensus.cc:359] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.395833 22785 raft_consensus.cc:385] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:37.396154 22785 raft_consensus.cc:740] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:37.396948 22785 consensus_queue.cc:260] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.397512 22809 raft_consensus.cc:2243] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:37.398118 22809 raft_consensus.cc:2272] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:37.398895 22684 raft_consensus.cc:493] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:37.399406 22684 raft_consensus.cc:515] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.408275 22684 leader_election.cc:290] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:37.408764 19197 raft_consensus.cc:2410] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 81ebb46a410e43ebaec3ef4dd13a71fc for term 9 because replica has last-logged OpId of term: 8 index: 392, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 391.
I20260928 01:56:37.411114 19202 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 9 FOLLOWER]: Refusing update from remote peer 81ebb46a410e43ebaec3ef4dd13a71fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 392. Preceding OpId from leader: term: 9 index: 392. (term mismatch)
I20260928 01:56:37.411526 19202 pending_rounds.cc:85] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: Aborting all ops after (but not including) 391
I20260928 01:56:37.411782 19202 pending_rounds.cc:107] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: Aborting uncommitted WRITE_OP operation due to leader change: 8.392
I20260928 01:56:37.412110 19113 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_b8264f1458f942c8b96c2608b66f6fdb" } modify_external_catalogs: true
I20260928 01:56:37.413007 19113 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51212:
table { table_name: "default.Table_b8264f1458f942c8b96c2608b66f6fdb" } modify_external_catalogs: true
E20260928 01:56:37.413793 19184 catalog_manager.cc:6001] Error updating tablets from 37089d44fdba4b6488b5b5aea28af614: Aborted: Op aborted by new leader. Tablet report was: is_incremental: true updated_tablets { tablet_id: "99e806ba248746d2bde39a2eb76b17df" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "eb014699060e4a6caf4caaf33c31710a" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27506 live_row_count: 0 } } updated_tablets { tablet_id: "a735102c576640b69323cacb50393a42" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "12b836e20d6b43cba8eaa08887afb076" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "fb159b3aad31479f80683b0d80549cc3" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "13c395a6a87f4927b10973720aa4d868" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "e43bec2c4274497ea73872d0db233eac" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27506 live_row_count: 0 } } updated_tablets { tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" state: RUNNING consensus_state { current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" state: RUNNING consensus_state { current_term: 2 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27759 live_row_count: 0 } } updated_tablets { tablet_id: "81c205176cb94d9f861cc140560944d4" state: RUNNING consensus_state { current_term: 3 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27581 live_row_count: 0 } } sequence_number: 258
I20260928 01:56:37.417296 22751 raft_consensus.cc:493] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:37.419445 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:56:37.419886 19184 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 260) took 8519 ms (client timeout 1000 ms). Trace:
I20260928 01:56:37.420037 19466 raft_consensus.cc:2468] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 1.
I20260928 01:56:37.418136 22751 raft_consensus.cc:515] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.423878 22751 leader_election.cc:290] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:37.433286 19608 raft_consensus.cc:1275] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 5 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260928 01:56:37.436058 22798 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 392, Last known committed idx: 391, Time since last communication: 0.001s
W20260928 01:56:37.435832 19184 rpcz_store.cc:269] 0928 01:56:28.900988 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:28.903026 (+  2038us) service_pool.cc:224] Handling call
0928 01:56:37.419789 (+8516763us) inbound_call.cc:177] Queueing failure response
Related trace 'op':
0928 01:56:33.089750 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:33.139223 (+ 49473us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:33.139254 (+    31us) write_op.cc:435] Acquired schema lock
0928 01:56:33.139269 (+    15us) tablet.cc:662] Decoding operations
0928 01:56:33.139725 (+   456us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:33.139784 (+    59us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:33.139831 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:33.140091 (+   260us) tablet.cc:701] Row locks acquired
0928 01:56:33.140122 (+    31us) write_op.cc:260] PREPARE: finished
0928 01:56:33.194190 (+ 54068us) write_op.cc:270] Start()
0928 01:56:33.194308 (+   118us) write_op.cc:276] Timestamp: P: 1790560593194115 usec, L: 0
0928 01:56:33.194332 (+    24us) op_driver.cc:348] REPLICATION: starting
0928 01:56:37.338245 (+4143913us) log.cc:844] Serialized 530 byte log entry
0928 01:56:37.338881 (+   636us) spinlock_profiling.cc:243] Waited 4.14 s on lock 0x7b5400030554. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbaaa1 00007f2fcdc4d5e8 00007f2fce0dd791 00007f2fce0dcf68 00007f2fce0e1c01 00007f2fce0e1bb9 00007f2fce0e1b49 00007f2fce0e1b11 00007f2fce0e0d3d 00000000005bd4e4 00000000005bd319
0928 01:56:37.412245 (+ 73364us) op_driver.cc:464] REPLICATION: finished
0928 01:56:37.412341 (+    96us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0928 01:56:37.412373 (+    32us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:37.412437 (+    64us) write_op.cc:454] Released schema lock
0928 01:56:37.412469 (+    32us) write_op.cc:335] FINISH: Op aborted
Metrics: {"reported_tablets":10,"child_traces":[["op",{"num_ops":1,"prepare.queue_time_us":343251,"prepare.run_cpu_time_us":10573,"prepare.run_wall_time_us":4249365,"raft.queue_time_us":98,"raft.run_cpu_time_us":895,"raft.run_wall_time_us":6924,"replication_time_us":4217684,"spinlock_wait_cycles":9529351552}]]}
I20260928 01:56:37.445482 22810 tablet_replica.cc:333] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:37.452440 19738 tablet_service.cc:1558] Processing DeleteTablet for tablet e8f6ce7612d4463ebe95e07557bca4e7 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d8a70d4a8654947be5ab2eb5539b3c9) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:37.453981 22754 consensus_queue.cc:1048] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260928 01:56:37.464524 22809 ts_tablet_manager.cc:1916] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:37.466598 19763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:37.467271 19763 raft_consensus.cc:2393] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 2: Already voted for candidate 8373bfae1f384c36b5e4c5ca26b208da in this term.
I20260928 01:56:37.472380 22818 tablet_replica.cc:333] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:37.466447 22738 consensus_queue.cc:1048] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:37.476521 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:37.478045 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8a70d4a8654947be5ab2eb5539b3c9" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:37.497730 22785 ts_tablet_manager.cc:1434] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.159s	user 0.004s	sys 0.005s
I20260928 01:56:37.498418 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a064862b854ad4af884e4ca95ffb31" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:37.502064 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8a70d4a8654947be5ab2eb5539b3c9" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:37.502687 19458 raft_consensus.cc:2468] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 0.
I20260928 01:56:37.518991 19458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e74d73a7eb44cd97c2c1df77b8b20c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:37.533512 22799 tablet_bootstrap.cc:492] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:37.534024 22799 ts_tablet_manager.cc:1403] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.261s	user 0.012s	sys 0.000s
I20260928 01:56:37.544605 22818 raft_consensus.cc:2243] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:37.549937 19467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164564bc2c97430da228a621aa545e5a" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
W20260928 01:56:37.551822 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 68198.3us
I20260928 01:56:37.557453 22658 mvcc.cc:204] Tried to move back new op lower bound from 7334136201328246784 to 7334136192473034752. Current Snapshot: MvccSnapshot[applied={T|T < 7334136201328246784 or (T in {7334136201328246784})}]
I20260928 01:56:37.561424 22818 raft_consensus.cc:2272] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:37.549731 22785 tablet_bootstrap.cc:492] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:37.581398 22647 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81ebb46a410e43ebaec3ef4dd13a71fc. Latest consensus state: current_term: 9 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:37.582319 22647 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: FOLLOWER
W20260928 01:56:37.587136 19185 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:53391 (request call id 264) took 964 ms (client timeout 1000 ms). Trace:
W20260928 01:56:37.587541 19185 rpcz_store.cc:269] 0928 01:56:36.623069 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:37.358742 (+735673us) service_pool.cc:224] Handling call
0928 01:56:37.577842 (+219100us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b5400030554. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbb5c0 00007f2fcdc5a6fa 00007f2fcf9cbd8c 00007f2fcfaca01e 00007f2fcd66efb4 00007f2fcd66ef42 00007f2fcd66ee71 00007f2fcd66edec 00007f2fcd66e0a2 00007f2fcb92009c 00007f2fcb91f4d6
0928 01:56:37.587036 (+  9194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201702656}
I20260928 01:56:37.589035 22689 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:37.589851 22689 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:56:37.589967 19608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:37.590902 19608 raft_consensus.cc:2468] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 2.
W20260928 01:56:37.597002 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 148616us
I20260928 01:56:37.600183 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6546cfe6f3a6405fab41a4ebdcffb288" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:37.529920 19459 raft_consensus.cc:2468] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 5.
I20260928 01:56:37.603014 19610 raft_consensus.cc:2368] T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 4. Current term is 5.
I20260928 01:56:37.607724 22802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 9 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:37.609002 22802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc [sys.catalog]: This master's current role is: LEADER
W20260928 01:56:37.614718 19553 leader_election.cc:343] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Not found: Tablet not found: 4d8a70d4a8654947be5ab2eb5539b3c9
W20260928 01:56:37.615628 19553 leader_election.cc:343] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:37.617172 19553 leader_election.cc:304] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:37.617861 22684 raft_consensus.cc:2804] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:56:37.618191 22684 raft_consensus.cc:493] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:37.618505 22684 raft_consensus.cc:3060] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:37.628139 22684 raft_consensus.cc:515] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:37.566082 22799 raft_consensus.cc:359] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.649436 22799 raft_consensus.cc:385] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:37.649871 22799 raft_consensus.cc:740] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:37.650848 22799 consensus_queue.cc:260] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:37.601935 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 48499us
I20260928 01:56:37.564172 22818 ts_tablet_manager.cc:1916] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:37.658267 22799 ts_tablet_manager.cc:1434] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.000s
I20260928 01:56:37.659504 22799 tablet_bootstrap.cc:492] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
W20260928 01:56:37.686669 19412 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 44136.8us
I20260928 01:56:37.630115 22684 leader_election.cc:290] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Requested vote from peers 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521), 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953)
I20260928 01:56:37.689020 19611 raft_consensus.cc:1275] T 982c3e07bcb94230b93764330914630f P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260928 01:56:37.641745 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8a70d4a8654947be5ab2eb5539b3c9" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:37.694046 19616 raft_consensus.cc:2468] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
W20260928 01:56:37.660698 19553 leader_election.cc:343] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:37.666926 22809 ts_tablet_manager.cc:1929] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:37.701836 22809 log.cc:1199] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/e8f6ce7612d4463ebe95e07557bca4e7
I20260928 01:56:37.710394 22809 ts_tablet_manager.cc:1950] T e8f6ce7612d4463ebe95e07557bca4e7 P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:37.711441 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e74d73a7eb44cd97c2c1df77b8b20c" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:37.708817 19192 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:37.720748 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:37.721498 19756 raft_consensus.cc:3060] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Advancing to term 3
W20260928 01:56:37.728075 19409 leader_election.cc:343] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
W20260928 01:56:37.728763 19556 leader_election.cc:343] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:37.729169 19556 leader_election.cc:304] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:37.731319 19553 leader_election.cc:343] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:37.747921 22817 raft_consensus.cc:2749] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:37.767691 19556 leader_election.cc:304] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:37.769518 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet e8f6ce7612d4463ebe95e07557bca4e7 (table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]) successfully deleted
I20260928 01:56:37.770538 22817 raft_consensus.cc:2804] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:37.771091 22817 raft_consensus.cc:493] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:37.771569 22817 raft_consensus.cc:3060] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:37.776871 22752 consensus_queue.cc:1048] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 01:56:37.779279 22752 consensus_queue.cc:1048] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 01:56:37.784219 19412 leader_election.cc:304] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:37.799047 22817 raft_consensus.cc:515] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.801054 19412 leader_election.cc:400] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Vote denied by peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) with higher term. Message: Invalid argument: T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 4. Current term is 5.
I20260928 01:56:37.801384 19412 leader_election.cc:403] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260928 01:56:37.808377 19701 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.18.161.61:43775, user_credentials={real_user=slave}} blocked reactor thread for 81770.1us
I20260928 01:56:37.816527 22786 raft_consensus.cc:2804] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:56:37.817231 22786 raft_consensus.cc:493] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ee288ca1464d20a715673422a214a0)
I20260928 01:56:37.817798 22786 raft_consensus.cc:3060] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:56:37.822171 22817 leader_election.cc:290] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:37.822888 22799 tablet_bootstrap.cc:654] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:37.829522 22788 raft_consensus.cc:3060] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Advancing to term 5
I20260928 01:56:37.829625 19468 raft_consensus.cc:1275] T b60e7bd679e447d18e340cfaed66d328 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260928 01:56:37.839570 22785 tablet_bootstrap.cc:654] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:37.799947 19192 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:37.846838 19756 raft_consensus.cc:2468] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
I20260928 01:56:37.849905 22786 raft_consensus.cc:515] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:37.852362 22788 raft_consensus.cc:2749] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) with higher term. Message: Invalid argument: T 6546cfe6f3a6405fab41a4ebdcffb288 P a3ee288ca1464d20a715673422a214a0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 4. Current term is 5.
I20260928 01:56:37.861290 22706 consensus_queue.cc:1048] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:37.865301 19412 leader_election.cc:304] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0; no voters: 8373bfae1f384c36b5e4c5ca26b208da
W20260928 01:56:37.860095 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 63884.4us
I20260928 01:56:37.866336 22810 raft_consensus.cc:2243] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 LEADER]: Raft consensus shutting down.
W20260928 01:56:37.866751 19556 leader_election.cc:343] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:37.867152 19556 leader_election.cc:304] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:37.867660 22810 raft_consensus.cc:2272] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:37.854219 19192 catalog_manager.cc:5838] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 2, leader changed from 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:37.871734 22810 ts_tablet_manager.cc:1916] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:37.866329 22788 raft_consensus.cc:2804] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:37.876791 22788 raft_consensus.cc:493] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:37.877210 22788 raft_consensus.cc:3060] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:37.877832 22817 raft_consensus.cc:2749] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:37.862438 19116 catalog_manager.cc:5838] T 219b7dad56a64a3b813344e0ed9bdbdc P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:37.885535 19668 heartbeater.cc:499] Master 127.18.161.62:38511 was elected leader, sending a full tablet report...
I20260928 01:56:37.906028 22738 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:37.906531 22738 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.910778 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8a70d4a8654947be5ab2eb5539b3c9" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:37.911538 19608 raft_consensus.cc:1275] T f887fe10461d40ee9363ce97ebbedd4f P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260928 01:56:37.913776 19556 leader_election.cc:343] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:37.914335 19556 leader_election.cc:304] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:37.914705 19553 leader_election.cc:304] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
W20260928 01:56:37.915589 19553 leader_election.cc:343] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:37.916282 22738 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:37.916386 22684 raft_consensus.cc:2749] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:37.916965 22684 raft_consensus.cc:2804] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:56:37.917407 22684 raft_consensus.cc:697] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [term 3 LEADER]: Becoming Leader. State: Replica: a3ee288ca1464d20a715673422a214a0, State: Running, Role: LEADER
I20260928 01:56:37.918217 22684 consensus_queue.cc:237] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } }
I20260928 01:56:37.918787 22788 raft_consensus.cc:515] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.932982 19618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:37.933631 19618 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 4.
I20260928 01:56:37.940871 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8a70d4a8654947be5ab2eb5539b3c9" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:37.941955 22785 tablet_bootstrap.cc:492] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:37.942766 22785 ts_tablet_manager.cc:1403] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.444s	user 0.011s	sys 0.008s
I20260928 01:56:37.941458 22788 leader_election.cc:290] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
W20260928 01:56:37.942708 19409 leader_election.cc:343] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:37.945899 22786 leader_election.cc:290] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Requested vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:37.947901 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da"
I20260928 01:56:37.948699 19762 raft_consensus.cc:2368] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:37.950011 19409 leader_election.cc:400] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Vote denied by peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) with higher term. Message: Invalid argument: T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:37.950417 19409 leader_election.cc:403] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260928 01:56:37.950832 22738 consensus_queue.cc:1048] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260928 01:56:37.952941 19704 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:37.953111 22783 raft_consensus.cc:3060] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:56:37.956566 22618 catalog_manager.cc:1471] Term changed from 8 to 9 while waiting for master leader catchup. Not loading sys catalog metadata
W20260928 01:56:37.957602 22618 catalog_manager.cc:1458] Failed waiting for node to catch up after master election: Illegal state: Node c17b7f9972364c76893311539b569e0f not leader. Raft Consensus state: current_term: 9 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
W20260928 01:56:37.958467 22618 catalog_manager.cc:1458] Failed waiting for node to catch up after master election: Illegal state: Node c17b7f9972364c76893311539b569e0f not leader. Raft Consensus state: current_term: 9 leader_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } } }
I20260928 01:56:37.954831 19192 catalog_manager.cc:5838] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
W20260928 01:56:37.956033 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 90363us
I20260928 01:56:37.899467 19116 catalog_manager.cc:5838] T b4b520e89c364692af1aedde2a59c3da P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:37.974370 22785 raft_consensus.cc:359] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.974841 22779 raft_consensus.cc:2804] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260928 01:56:37.975183 22779 raft_consensus.cc:493] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:37.975306 22785 raft_consensus.cc:385] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:37.975512 22779 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 4 FOLLOWER]: Advancing to term 5
I20260928 01:56:37.975716 22785 raft_consensus.cc:740] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:37.976534 22785 consensus_queue.cc:260] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:37.989003 19116 catalog_manager.cc:5838] T 9690a224bb004152ba65d525cc10bd9f P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:37.991065 19116 catalog_manager.cc:5838] T a12bafcc09ef4342bff89b0475f721af P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:37.994254 22799 tablet_bootstrap.cc:492] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:37.994887 22799 ts_tablet_manager.cc:1403] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.336s	user 0.007s	sys 0.006s
I20260928 01:56:37.997686 22799 raft_consensus.cc:359] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.005240 22785 ts_tablet_manager.cc:1434] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.001s
I20260928 01:56:38.023572 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8a70d4a8654947be5ab2eb5539b3c9" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:38.024463 19616 raft_consensus.cc:2393] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:38.037962 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:38.040437 19116 catalog_manager.cc:5838] T 21906a8380e64d95b9454a57fc01c6f0 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 1 to 2, leader changed from 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } }
I20260928 01:56:38.006686 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a735102c576640b69323cacb50393a42" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:38.017019 19468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8a70d4a8654947be5ab2eb5539b3c9" candidate_uuid: "a3ee288ca1464d20a715673422a214a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:38.044950 19468 raft_consensus.cc:2393] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a3ee288ca1464d20a715673422a214a0 in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:38.046386 22785 tablet_bootstrap.cc:492] T 71a064862b854ad4af884e4ca95ffb31 P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:38.052276 19468 raft_consensus.cc:1275] T 6546cfe6f3a6405fab41a4ebdcffb288 P 37089d44fdba4b6488b5b5aea28af614 [term 5 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260928 01:56:38.079267 22799 raft_consensus.cc:385] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:38.079620 22799 raft_consensus.cc:740] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:38.080293 22799 consensus_queue.cc:260] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.019096 22818 ts_tablet_manager.cc:1929] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:38.088445 22818 log.cc:1199] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/e8f6ce7612d4463ebe95e07557bca4e7
I20260928 01:56:38.089475 22818 ts_tablet_manager.cc:1950] T e8f6ce7612d4463ebe95e07557bca4e7 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:38.024020 22738 raft_consensus.cc:493] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:38.069448 22752 consensus_queue.cc:1048] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260928 01:56:38.092727 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet e8f6ce7612d4463ebe95e07557bca4e7 (table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]) successfully deleted
I20260928 01:56:38.095109 22810 ts_tablet_manager.cc:1929] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:56:38.095556 22810 log.cc:1199] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/e8f6ce7612d4463ebe95e07557bca4e7
I20260928 01:56:38.096590 22810 ts_tablet_manager.cc:1950] T e8f6ce7612d4463ebe95e07557bca4e7 P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:38.097746 19458 raft_consensus.cc:1275] T f887fe10461d40ee9363ce97ebbedd4f P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260928 01:56:38.093767 22738 raft_consensus.cc:515] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.099789 19412 leader_election.cc:304] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614; no voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:38.101797 22832 raft_consensus.cc:2749] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:56:38.005311 22783 raft_consensus.cc:2749] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) with higher term. Message: Invalid argument: T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37089d44fdba4b6488b5b5aea28af614 for earlier term 2. Current term is 3.
I20260928 01:56:38.107993 22738 leader_election.cc:290] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:38.044026 19116 catalog_manager.cc:5838] T 27a232fc915a46c1a833ec5f6721eece P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 1 to 3, leader changed from 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3) to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 3 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:38.112445 19608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a064862b854ad4af884e4ca95ffb31" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:38.113211 19608 raft_consensus.cc:2468] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:38.113896 19473 raft_consensus.cc:2468] T a735102c576640b69323cacb50393a42 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ee288ca1464d20a715673422a214a0 in term 3.
I20260928 01:56:38.124725 22779 raft_consensus.cc:515] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.126809 22779 leader_election.cc:290] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 5 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:38.109329 19116 catalog_manager.cc:5838] T 9f80b652a19a41968d1bfbaaf020b721 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 1 to 3, leader changed from 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1) to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 3 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:38.124451 22799 ts_tablet_manager.cc:1434] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.129s	user 0.005s	sys 0.002s
I20260928 01:56:38.130895 22785 tablet_bootstrap.cc:654] T 71a064862b854ad4af884e4ca95ffb31 P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:38.135305 22754 consensus_queue.cc:1048] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:38.146775 19556 leader_election.cc:304] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3ee288ca1464d20a715673422a214a0; no voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da
I20260928 01:56:38.147917 22813 raft_consensus.cc:2749] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 01:56:38.161355 19704 leader_election.cc:304] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:38.162469 22837 raft_consensus.cc:2804] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:38.162851 22837 raft_consensus.cc:493] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:38.163189 22837 raft_consensus.cc:3060] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:38.166496 19473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:38.167264 19473 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 4.
I20260928 01:56:38.170276 19476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a064862b854ad4af884e4ca95ffb31" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:38.174852 19458 raft_consensus.cc:1275] T d7774406b22547d29d9d42c969cf0874 P 37089d44fdba4b6488b5b5aea28af614 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:38.175274 22837 raft_consensus.cc:515] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.176066 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:38.176720 19474 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 4 FOLLOWER]: Advancing to term 5
I20260928 01:56:38.184149 22799 tablet_bootstrap.cc:492] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:38.186053 19474 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P 37089d44fdba4b6488b5b5aea28af614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 5.
W20260928 01:56:38.195523 19532 tablet.cc:2433] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 01:56:38.190677 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 49738us
I20260928 01:56:38.203321 22752 consensus_queue.cc:1048] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260928 01:56:38.208760 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 46521.9us
I20260928 01:56:38.226812 22837 leader_election.cc:290] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:38.235459 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet e8f6ce7612d4463ebe95e07557bca4e7 (table default.Table_c9b8cc5045734f0c8720e704b8391c0f [id=432c9d2c193d42aebe19118125995b67]) successfully deleted
W20260928 01:56:38.237095 19163 debug-util.cc:398] Leaking SignalData structure 0x7b0800028d00 after lost signal to thread 19178
E20260928 01:56:38.099016 19192 catalog_manager.cc:6001] Error updating tablets from 8373bfae1f384c36b5e4c5ca26b208da: Illegal state: replica c17b7f9972364c76893311539b569e0f is not leader of this config: current role FOLLOWER. Tablet report was: is_incremental: false updated_tablets { tablet_id: "6ea6adefd15a4ea19011419949047e83" state: INITIALIZED consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "53c755f16ea1496eb7fa26fb12e01708" state: INITIALIZED consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "9690a224bb004152ba65d525cc10bd9f" state: BOOTSTRAPPING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "a1710b95678440b1bff8a92080d43272" state: RUNNING consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "eb014699060e4a6caf4caaf33c31710a" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "e6206afe245740b1819069a48e8b548e" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "d114d5ba862044b4b88eee27395db7e3" state: RUNNING consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "a735102c576640b69323cacb50393a42" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "fb159b3aad31479f80683b0d80549cc3" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27550 live_row_count: 0 } } updated_tablets { tablet_id: "a01b795606604960bc7cafab4ff6f3d0" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "e927cd8a991f46278c2bb663cee7f753" state: RUNNING consensus_state { current_term: 2 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" state: RUNNING consensus_state { current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "7441c2d1a7fa4dc8a89c6717a80d3efb" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "7979940c4a2e470bbecc40384edf38c9" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "9f80b652a19a41968d1bfbaaf020b721" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "12c7284250084d6299cafe8310cfd257" state: RUNNING consensus_state { current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "2c007b068b1d414298cce3fe44a91daa" state: RUNNING consensus_state { current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "376b5a87b07b4f87a2a502b5fa1b23f8" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "13c395a6a87f4927b10973720aa4d868" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27612 live_row_count: 0 } } updated_tablets { tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "75303ee92aae436ea6c46747a23b69b6" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "22606f012f1c44bd92c8e0341e9ca2b7" state: RUNNING consensus_state { current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "27a232fc915a46c1a833ec5f6721eece" state: RUNNING consensus_state { current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "58c61408724e4a70b39e5dbdab9a3e8a" state: RUNNING consensus_state { current_term: 2 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "c74a4a00552c4a14a871a59465524f1c" state: RUNNING consensus_state { current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27612 live_row_count: 0 } } updated_tablets { tablet_id: "22e095aba1cb4fb7be461d625a922751" state: RUNNING consensus_state { current_term: 2 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "8e39fce4f0a149a898de678d73052f52" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27759 live_row_count: 0 } } updated_tablets { tablet_id: "c320eb2ca2ac4ac68293ef8f7400b45f" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "ba89039dcfa848159112caa76802b5f1" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "49a73835e2854976b40b31fe752d1b1b" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "bab12ba3e1f542949e3f203dae0fa80e" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" state: RUNNING consensus_state { current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "b8cacb4a90a54cd3b5b3e7a9310e06ed" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "7602706a3fbc438d8d448c9ac057087c" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27612 live_row_count: 0 } } updated_tablets { tablet_id: "664b608bb0f54fc5baa10622f7d916c1" state: RUNNING consensus_state { current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "a12bafcc0
I20260928 01:56:38.244747 19116 catalog_manager.cc:5838] T e6206afe245740b1819069a48e8b548e P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 2, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 2 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } }
I20260928 01:56:38.247596 22799 tablet_bootstrap.cc:654] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:38.255054 19116 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_9a7d932e0ef8485cb1fb0d4450cbd14d [id=55616d2998544e568042a46ef7f958e4]). Expected version 2 got 1
W20260928 01:56:38.256263 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 46877.9us
I20260928 01:56:38.255964 19116 catalog_manager.cc:5838] T 6ea6adefd15a4ea19011419949047e83 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } }
W20260928 01:56:38.266695 19192 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:53391 (request call id 260) took 10437 ms (client timeout 1000 ms). Trace:
I20260928 01:56:38.267581 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c395a6a87f4927b10973720aa4d868" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
W20260928 01:56:38.267073 19192 rpcz_store.cc:269] 0928 01:56:27.828907 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:27.829064 (+   157us) service_pool.cc:224] Handling call
0928 01:56:38.098754 (+10269690us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:38.098775 (+    21us) write_op.cc:454] Released schema lock
0928 01:56:38.266611 (+167836us) inbound_call.cc:177] Queueing failure response
Related trace 'op':
0928 01:56:38.098517 (+     0us) op_driver.cc:389] HandleFailure(Illegal state: replica c17b7f9972364c76893311539b569e0f is not leader of this config: current role FOLLOWER)
0928 01:56:38.098565 (+    48us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:38.098584 (+    19us) write_op.cc:454] Released schema lock
0928 01:56:38.098602 (+    18us) write_op.cc:335] FINISH: Op aborted
Metrics: {"reported_tablets":105,"child_traces":[["op",{}]]}
I20260928 01:56:38.268173 19616 raft_consensus.cc:3060] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 4 FOLLOWER]: Advancing to term 5
I20260928 01:56:38.278385 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a064862b854ad4af884e4ca95ffb31" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:38.279137 19610 raft_consensus.cc:3060] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:38.287509 19610 raft_consensus.cc:2468] T 71a064862b854ad4af884e4ca95ffb31 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
W20260928 01:56:38.300264 19703 leader_election.cc:343] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:38.301216 22785 tablet_bootstrap.cc:492] T 71a064862b854ad4af884e4ca95ffb31 P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
I20260928 01:56:38.301682 22785 ts_tablet_manager.cc:1403] T 71a064862b854ad4af884e4ca95ffb31 P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.256s	user 0.007s	sys 0.008s
I20260928 01:56:38.302289 22835 consensus_queue.cc:1048] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:38.257038 19116 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 6ea6adefd15a4ea19011419949047e83 (table default.Table_2a43036236e34e2586f541aa2fb3b8b6 [id=292d90fe578e4470bced0890a4e646ef]). Expected version 1 got 0
I20260928 01:56:38.304473 19703 leader_election.cc:304] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:38.305153 22835 raft_consensus.cc:2804] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 5 FOLLOWER]: Leader election won for term 5
I20260928 01:56:38.305581 22835 raft_consensus.cc:697] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [term 5 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:38.306393 22835 consensus_queue.cc:237] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.315600 19116 catalog_manager.cc:5838] T 53c755f16ea1496eb7fa26fb12e01708 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ee288ca1464d20a715673422a214a0 (127.18.161.2). New cstate: current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:38.322436 22785 raft_consensus.cc:359] T 71a064862b854ad4af884e4ca95ffb31 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.338579 22785 raft_consensus.cc:385] T 71a064862b854ad4af884e4ca95ffb31 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:38.348345 22785 raft_consensus.cc:740] T 71a064862b854ad4af884e4ca95ffb31 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
W20260928 01:56:38.350478 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 52598.3us
I20260928 01:56:38.351639 22785 consensus_queue.cc:260] T 71a064862b854ad4af884e4ca95ffb31 P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.359566 19191 catalog_manager.cc:5838] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:38.368795 19191 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:38.370081 19191 catalog_manager.cc:5838] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:38.372432 22785 ts_tablet_manager.cc:1434] T 71a064862b854ad4af884e4ca95ffb31 P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260928 01:56:38.377503 19191 catalog_manager.cc:5938] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521) does not have the latest schema for tablet 11a7c70dba4e4b3b97104b5d65704b9d (table default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117]). Expected version 1 got 0
I20260928 01:56:38.380426 22785 tablet_bootstrap.cc:492] T a1e74d73a7eb44cd97c2c1df77b8b20c P 37089d44fdba4b6488b5b5aea28af614: Bootstrap starting.
I20260928 01:56:38.389513 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a064862b854ad4af884e4ca95ffb31" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614"
I20260928 01:56:38.390383 19474 raft_consensus.cc:3060] T 71a064862b854ad4af884e4ca95ffb31 P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:38.401309 19474 raft_consensus.cc:2468] T 71a064862b854ad4af884e4ca95ffb31 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:38.411147 19191 catalog_manager.cc:5838] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 2, leader changed from 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:38.413661 19191 catalog_manager.cc:5838] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:38.421559 19191 catalog_manager.cc:5838] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:38.423236 22853 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 81ebb46a410e43ebaec3ef4dd13a71fc)
I20260928 01:56:38.426168 22853 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:38.427167 19189 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60098 (request call id 27) took 9170 ms. Trace:
I20260928 01:56:38.430258 22799 tablet_bootstrap.cc:492] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:38.430749 22799 ts_tablet_manager.cc:1403] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.247s	user 0.012s	sys 0.000s
I20260928 01:56:38.432313 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 10 candidate_status { last_received { term: 9 index: 397 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:56:38.432608 19202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 10 candidate_status { last_received { term: 9 index: 397 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:38.427489 19189 rpcz_store.cc:276] 0928 01:56:29.256592 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.256858 (+   266us) service_pool.cc:224] Handling call
0928 01:56:29.258859 (+  2001us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:56:29.288295 (+ 29436us) catalog_manager.cc:3764] Apply alter schema
0928 01:56:29.289173 (+   878us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 01:56:29.289518 (+   345us) catalog_manager.cc:3954] Updating metadata on disk
0928 01:56:29.763079 (+473561us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 01:56:38.427082 (+8664003us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:29.633225 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:29.633769 (+   544us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:29.633796 (+    27us) write_op.cc:435] Acquired schema lock
0928 01:56:29.633813 (+    17us) tablet.cc:662] Decoding operations
0928 01:56:29.634127 (+   314us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:29.634167 (+    40us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:29.634190 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:29.634381 (+   191us) tablet.cc:701] Row locks acquired
0928 01:56:29.634411 (+    30us) write_op.cc:260] PREPARE: finished
0928 01:56:29.634544 (+   133us) write_op.cc:270] Start()
0928 01:56:29.634648 (+   104us) write_op.cc:276] Timestamp: P: 1790560589634495 usec, L: 0
0928 01:56:29.634666 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:29.635290 (+   624us) log.cc:844] Serialized 405 byte log entry
0928 01:56:29.708961 (+ 73671us) op_driver.cc:464] REPLICATION: finished
0928 01:56:29.718622 (+  9661us) write_op.cc:301] APPLY: starting
0928 01:56:29.718690 (+    68us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:29.718819 (+   129us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:29.718948 (+   129us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:29.757762 (+ 38814us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:29.757907 (+   145us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:29.757950 (+    43us) write_op.cc:312] APPLY: finished
0928 01:56:29.758222 (+   272us) log.cc:844] Serialized 23 byte log entry
0928 01:56:29.762260 (+  4038us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:29.762339 (+    79us) write_op.cc:454] Released schema lock
0928 01:56:29.762377 (+    38us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:29.763583 (+  1206us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:29.763620 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":9451,"apply.run_cpu_time_us":1763,"apply.run_wall_time_us":44926,"num_ops":1,"prepare.queue_time_us":342214,"prepare.run_cpu_time_us":2351,"prepare.run_wall_time_us":2351,"replication_time_us":74146,"thread_start_us":25277,"threads_started":1}]]}
I20260928 01:56:38.434320 20447 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:38.436798 19076 master-stress-test.cc:581] Killed test thread 5/10
I20260928 01:56:38.437218 19076 master-stress-test.cc:579] Killing test thread 6/10
I20260928 01:56:38.438148 19188 catalog_manager.cc:6133] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f: Sending DeleteTablet for 3 replicas of tablet 3505a502bff747deaf1e03c03375aafa
I20260928 01:56:38.439814 19188 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:60098 (request call id 29) took 9182 ms. Trace:
I20260928 01:56:38.440131 19188 rpcz_store.cc:276] 0928 01:56:29.257627 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.269207 (+ 11580us) service_pool.cc:224] Handling call
0928 01:56:29.270949 (+  1742us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:56:29.280690 (+  9741us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:56:29.280952 (+   262us) catalog_manager.cc:2863] Locking tablets
0928 01:56:32.713656 (+3432704us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:56:32.878201 (+164545us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:56:32.878434 (+   233us) catalog_manager.cc:2911] Committing in-memory state
0928 01:56:38.438044 (+5559610us) catalog_manager.cc:2915] Aborting table tasks
0928 01:56:38.439745 (+  1701us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:32.746149 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:32.746672 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:32.746702 (+    30us) write_op.cc:435] Acquired schema lock
0928 01:56:32.746714 (+    12us) tablet.cc:662] Decoding operations
0928 01:56:32.747083 (+   369us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:32.747147 (+    64us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:32.747178 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:56:32.747497 (+   319us) tablet.cc:701] Row locks acquired
0928 01:56:32.747513 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:56:32.747642 (+   129us) write_op.cc:270] Start()
0928 01:56:32.747732 (+    90us) write_op.cc:276] Timestamp: P: 1790560592747593 usec, L: 0
0928 01:56:32.747753 (+    21us) op_driver.cc:348] REPLICATION: starting
0928 01:56:32.825118 (+ 77365us) log.cc:844] Serialized 768 byte log entry
0928 01:56:32.835657 (+ 10539us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b5400030554. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbaaa1 00007f2fcdc4d5e8 00007f2fce0dd791 00007f2fce0dcf68 00007f2fce0e1c01 00007f2fce0e1bb9 00007f2fce0e1b49 00007f2fce0e1b11 00007f2fce0e0d3d 00000000005bd4e4 00000000005bd319
0928 01:56:32.849357 (+ 13700us) op_driver.cc:464] REPLICATION: finished
0928 01:56:32.874265 (+ 24908us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b1800053aa0. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcf9e9b81 00007f2fcf9f6571 00007f2fc6aef363 00007f2fc6af1751 00007f2fc6af1709 00007f2fc6af1699 00007f2fc6af1661 00007f2fc6af095d 00000000005bd4e4 00000000005bd319 00007f2fc6ad281a
0928 01:56:32.874876 (+   611us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800053aa0. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcf9e9b81 00007f2fcf9f6571 00007f2fc6aef363 00007f2fc6af1751 00007f2fc6af1709 00007f2fc6af1699 00007f2fc6af1661 00007f2fc6af095d 00000000005bd4e4 00000000005bd319 00007f2fc6ad281a
0928 01:56:32.874973 (+    97us) write_op.cc:301] APPLY: starting
0928 01:56:32.875035 (+    62us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:32.875162 (+   127us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:32.875187 (+    25us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:32.875548 (+   361us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:32.875700 (+   152us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:56:32.875749 (+    49us) write_op.cc:312] APPLY: finished
0928 01:56:32.875967 (+   218us) log.cc:844] Serialized 29 byte log entry
0928 01:56:32.877222 (+  1255us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:32.877373 (+   151us) write_op.cc:454] Released schema lock
0928 01:56:32.877443 (+    70us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":319,"apply.run_cpu_time_us":1853,"apply.run_wall_time_us":3701,"num_ops":2,"prepare.queue_time_us":30348,"prepare.run_cpu_time_us":3640,"prepare.run_wall_time_us":98353,"raft.queue_time_us":307,"raft.run_cpu_time_us":1050,"raft.run_wall_time_us":1463,"replication_time_us":101511,"spinlock_wait_cycles":208412288}]]}
I20260928 01:56:38.450917 19738 tablet_service.cc:1558] Processing DeleteTablet for tablet 3505a502bff747deaf1e03c03375aafa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:56:29 UTC) from {username='slave'} at 127.0.0.1:55034
I20260928 01:56:38.451795 22818 tablet_replica.cc:333] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:38.456347 22853 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:38.456905 22853 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260928 01:56:38.460367 19446 tablet_service.cc:1558] Processing DeleteTablet for tablet 3505a502bff747deaf1e03c03375aafa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:56:29 UTC) from {username='slave'} at 127.0.0.1:50444
I20260928 01:56:38.461210 22810 tablet_replica.cc:333] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:38.472728 22799 raft_consensus.cc:359] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.473471 22799 raft_consensus.cc:385] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:38.473758 22799 raft_consensus.cc:740] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:38.474586 22799 consensus_queue.cc:260] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.481487 22810 raft_consensus.cc:2243] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:38.482206 22810 raft_consensus.cc:2272] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:38.485235 22810 ts_tablet_manager.cc:1916] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:38.503943 22818 raft_consensus.cc:2243] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:38.507107 22818 raft_consensus.cc:2272] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:38.508359 22785 tablet_bootstrap.cc:654] T a1e74d73a7eb44cd97c2c1df77b8b20c P 37089d44fdba4b6488b5b5aea28af614: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:38.510023 22818 ts_tablet_manager.cc:1916] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:38.524096 19703 leader_election.cc:304] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:38.525691 22837 raft_consensus.cc:2804] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:38.526263 22837 raft_consensus.cc:697] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:38.527436 22837 consensus_queue.cc:237] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.542649 22799 ts_tablet_manager.cc:1434] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.112s	user 0.003s	sys 0.004s
E20260928 01:56:38.449949 19191 catalog_manager.cc:6001] Error updating tablets from 8373bfae1f384c36b5e4c5ca26b208da: Illegal state: replica c17b7f9972364c76893311539b569e0f is not leader of this config: current role FOLLOWER. Tablet report was: is_incremental: false updated_tablets { tablet_id: "6ea6adefd15a4ea19011419949047e83" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "53c755f16ea1496eb7fa26fb12e01708" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "9690a224bb004152ba65d525cc10bd9f" state: RUNNING consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "a1710b95678440b1bff8a92080d43272" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27462 live_row_count: 0 } } updated_tablets { tablet_id: "eb014699060e4a6caf4caaf33c31710a" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "e6206afe245740b1819069a48e8b548e" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "d114d5ba862044b4b88eee27395db7e3" state: RUNNING consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "a735102c576640b69323cacb50393a42" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "fb159b3aad31479f80683b0d80549cc3" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27550 live_row_count: 0 } } updated_tablets { tablet_id: "a01b795606604960bc7cafab4ff6f3d0" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "e927cd8a991f46278c2bb663cee7f753" state: RUNNING consensus_state { current_term: 2 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" state: RUNNING consensus_state { current_term: 3 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "7441c2d1a7fa4dc8a89c6717a80d3efb" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "7979940c4a2e470bbecc40384edf38c9" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "9f80b652a19a41968d1bfbaaf020b721" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "12c7284250084d6299cafe8310cfd257" state: RUNNING consensus_state { current_term: 3 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "043ddb5b0b0e4ad0b30d2927d37971fb" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "2c007b068b1d414298cce3fe44a91daa" state: RUNNING consensus_state { current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "3ca3c16cd3f54ff4bdbfa20accff3fc7" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "202f1ead822548a2bbeae4e4d3cf9be8" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "376b5a87b07b4f87a2a502b5fa1b23f8" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "13c395a6a87f4927b10973720aa4d868" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27612 live_row_count: 0 } } updated_tablets { tablet_id: "9ec3f279423a46c1acb1cbfecf4a608a" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "75303ee92aae436ea6c46747a23b69b6" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "27a232fc915a46c1a833ec5f6721eece" state: RUNNING consensus_state { current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "58c61408724e4a70b39e5dbdab9a3e8a" state: RUNNING consensus_state { current_term: 2 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "c74a4a00552c4a14a871a59465524f1c" state: RUNNING consensus_state { current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "fc428ccbf88e4d5cbae197cb67e9a0a5" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27612 live_row_count: 0 } } updated_tablets { tablet_id: "22e095aba1cb4fb7be461d625a922751" state: RUNNING consensus_state { current_term: 2 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "8e39fce4f0a149a898de678d73052f52" state: RUNNING consensus_state { current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "65fdc8575c7440ffbf5c7c4db5d4b35e" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27759 live_row_count: 0 } } updated_tablets { tablet_id: "c320eb2ca2ac4ac68293ef8f7400b45f" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "15f48cf74a1b4600b5140bf9cc8446e3" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "c8fd6b965d22477aaee9bafccb2069b1" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "ba89039dcfa848159112caa76802b5f1" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "49a73835e2854976b40b31fe752d1b1b" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "bab12ba3e1f542949e3f203dae0fa80e" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "f709eccf4ab5413bbbd8b4746f185db4" state: RUNNING consensus_state { current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "b8cacb4a90a54cd3b5b3e7a9310e06ed" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "664b608bb0f54fc5baa10622f7d916c1" state: RUNNING consensus_state { current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "a12bafcc09ef4342bff89b0475f721af" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "8dc9a1c5be7c4e519f1415ba70397f01" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_u
W20260928 01:56:38.565689 19191 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:53391 (request call id 261) took 8967 ms (client timeout 1000 ms). Trace:
I20260928 01:56:38.566143 19187 catalog_manager.cc:5838] T 27a232fc915a46c1a833ec5f6721eece P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 1 to 3, leader changed from 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3) to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 3 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:38.567752 22799 tablet_bootstrap.cc:492] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da: Bootstrap starting.
I20260928 01:56:38.568286 19187 catalog_manager.cc:5838] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 2, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 2 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:38.574249 19187 catalog_manager.cc:5838] T 6ea6adefd15a4ea19011419949047e83 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1). New cstate: current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:38.582231 19187 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet e43bec2c4274497ea73872d0db233eac (table default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e]). Expected version 2 got 0
I20260928 01:56:38.585655 19187 catalog_manager.cc:5838] T a1710b95678440b1bff8a92080d43272 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } }
I20260928 01:56:38.589429 22785 tablet_bootstrap.cc:492] T a1e74d73a7eb44cd97c2c1df77b8b20c P 37089d44fdba4b6488b5b5aea28af614: No bootstrap required, opened a new log
W20260928 01:56:38.566041 19191 rpcz_store.cc:269] 0928 01:56:29.598293 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.723935 (+125642us) service_pool.cc:224] Handling call
0928 01:56:29.837476 (+113541us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b5400030554. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbb5c0 00007f2fcdc5a6fa 00007f2fcf9cbd8c 00007f2fcfaca01e 00007f2fcd66efb4 00007f2fcd66ef42 00007f2fcd66ee71 00007f2fcd66edec 00007f2fcd66e0a2 00007f2fcb92009c 00007f2fcb91f4d6
0928 01:56:38.449693 (+8612217us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:38.449716 (+    23us) write_op.cc:454] Released schema lock
0928 01:56:38.565610 (+115894us) inbound_call.cc:177] Queueing failure response
Related trace 'op':
0928 01:56:38.449513 (+     0us) op_driver.cc:389] HandleFailure(Illegal state: replica c17b7f9972364c76893311539b569e0f is not leader of this config: current role FOLLOWER)
0928 01:56:38.449546 (+    33us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:38.449566 (+    20us) write_op.cc:454] Released schema lock
0928 01:56:38.449586 (+    20us) write_op.cc:335] FINISH: Op aborted
Metrics: {"reported_tablets":102,"spinlock_wait_cycles":122231680,"child_traces":[["op",{}]]}
I20260928 01:56:38.589924 22785 ts_tablet_manager.cc:1403] T a1e74d73a7eb44cd97c2c1df77b8b20c P 37089d44fdba4b6488b5b5aea28af614: Time spent bootstrapping tablet: real 0.210s	user 0.012s	sys 0.000s
I20260928 01:56:38.591343 19187 catalog_manager.cc:5838] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 1 to 3, leader changed from a3ee288ca1464d20a715673422a214a0 (127.18.161.2) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } }
I20260928 01:56:38.593083 22754 raft_consensus.cc:493] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:38.593547 22754 raft_consensus.cc:515] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.605798 19187 catalog_manager.cc:5838] T 21906a8380e64d95b9454a57fc01c6f0 P 37089d44fdba4b6488b5b5aea28af614 reported cstate change: term changed from 1 to 2, leader changed from 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1) to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } }
W20260928 01:56:38.611148 19190 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ea6adefd15a4ea19011419949047e83 consensus state has no leader
I20260928 01:56:38.611729 19190 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60098 (request call id 28) took 9354 ms. Trace:
I20260928 01:56:38.612020 19190 rpcz_store.cc:276] 0928 01:56:29.257100 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:29.267782 (+ 10682us) service_pool.cc:224] Handling call
0928 01:56:29.269000 (+  1218us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:56:29.291706 (+ 22706us) catalog_manager.cc:3764] Apply alter schema
0928 01:56:29.292417 (+   711us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 01:56:29.292650 (+   233us) catalog_manager.cc:3954] Updating metadata on disk
0928 01:56:29.780231 (+487581us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 01:56:38.611662 (+8831431us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:29.635728 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:29.749687 (+113959us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:29.749729 (+    42us) write_op.cc:435] Acquired schema lock
0928 01:56:29.749745 (+    16us) tablet.cc:662] Decoding operations
0928 01:56:29.750081 (+   336us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:29.750119 (+    38us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:29.750148 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:29.750320 (+   172us) tablet.cc:701] Row locks acquired
0928 01:56:29.750336 (+    16us) write_op.cc:260] PREPARE: finished
0928 01:56:29.750487 (+   151us) write_op.cc:270] Start()
0928 01:56:29.750589 (+   102us) write_op.cc:276] Timestamp: P: 1790560589750431 usec, L: 0
0928 01:56:29.750604 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:56:29.751234 (+   630us) log.cc:844] Serialized 405 byte log entry
0928 01:56:29.775877 (+ 24643us) op_driver.cc:464] REPLICATION: finished
0928 01:56:29.776115 (+   238us) write_op.cc:301] APPLY: starting
0928 01:56:29.776164 (+    49us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:29.776293 (+   129us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:29.776388 (+    95us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:29.776551 (+   163us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:29.776670 (+   119us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:29.776712 (+    42us) write_op.cc:312] APPLY: finished
0928 01:56:29.776881 (+   169us) log.cc:844] Serialized 23 byte log entry
0928 01:56:29.779322 (+  2441us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:29.779392 (+    70us) write_op.cc:454] Released schema lock
0928 01:56:29.779435 (+    43us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:29.856448 (+ 77013us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:29.856481 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":82,"apply.run_cpu_time_us":1310,"apply.run_wall_time_us":4426,"num_ops":1,"prepare.queue_time_us":341675,"prepare.run_cpu_time_us":2530,"prepare.run_wall_time_us":220664,"raft.queue_time_us":116,"raft.run_cpu_time_us":834,"raft.run_wall_time_us":1897,"replication_time_us":25147}]]}
I20260928 01:56:38.618937 19076 master-stress-test.cc:581] Killed test thread 6/10
I20260928 01:56:38.619230 19076 master-stress-test.cc:579] Killing test thread 7/10
I20260928 01:56:38.300132 19608 raft_consensus.cc:1275] T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0 [term 3 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:38.658708 19591 tablet_service.cc:1558] Processing DeleteTablet for tablet 3505a502bff747deaf1e03c03375aafa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:56:29 UTC) from {username='slave'} at 127.0.0.1:57616
W20260928 01:56:38.664700 19178 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 6ea6adefd15a4ea19011419949047e83 (table default.Table_2a43036236e34e2586f541aa2fb3b8b6 [id=292d90fe578e4470bced0890a4e646ef], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6ea6adefd15a4ea19011419949047e83 consensus state has no leader
I20260928 01:56:38.666919 19616 raft_consensus.cc:2468] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 5.
W20260928 01:56:38.604719 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 46452.2us
E20260928 01:56:38.626081 19187 catalog_manager.cc:6001] Error updating tablets from 37089d44fdba4b6488b5b5aea28af614: Illegal state: replica c17b7f9972364c76893311539b569e0f is not leader of this config: current role FOLLOWER. Tablet report was: is_incremental: true updated_tablets { tablet_id: "21906a8380e64d95b9454a57fc01c6f0" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "a1710b95678440b1bff8a92080d43272" state: RUNNING consensus_state { current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "664b608bb0f54fc5baa10622f7d916c1" state: RUNNING consensus_state { current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "8b48eacc1cec49baabe2d87bdd06cd5c" state: RUNNING consensus_state { current_term: 3 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "8df69eb3a37445ed8a2be0ef3bf32cdb" state: RUNNING consensus_state { current_term: 3 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "52b9f4b9caea4354bcec4f4cbb4fa0d3" state: RUNNING consensus_state { current_term: 2 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27462 live_row_count: 0 } } updated_tablets { tablet_id: "01cc307b127446958bd4199a1aa60adb" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27462 live_row_count: 0 } } updated_tablets { tablet_id: "27a232fc915a46c1a833ec5f6721eece" state: RUNNING consensus_state { current_term: 3 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27537 live_row_count: 0 } } updated_tablets { tablet_id: "6ea6adefd15a4ea19011419949047e83" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27462 live_row_count: 0 } } updated_tablets { tablet_id: "99e806ba248746d2bde39a2eb76b17df" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "eb014699060e4a6caf4caaf33c31710a" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27506 live_row_count: 0 } } updated_tablets { tablet_id: "a735102c576640b69323cacb50393a42" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "12b836e20d6b43cba8eaa08887afb076" state: RUNNING consensus_state { current_term: 1 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "fb159b3aad31479f80683b0d80549cc3" state: RUNNING consensus_state { current_term: 2 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "13c395a6a87f4927b10973720aa4d868" state: RUNNING consensus_state { current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "e43bec2c4274497ea73872d0db233eac" state: RUNNING consensus_state { current_term: 1 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27506 live_row_count: 0 } } updated_tablets { tablet_id: "11a7c70dba4e4b3b97104b5d65704b9d" state: RUNNING consensus_state { current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "502c0f4e07ff4479af8d33c99031b6fc" state: RUNNING consensus_state { current_term: 4 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "219b7dad56a64a3b813344e0ed9bdbdc" state: RUNNING consensus_state { current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "81c205176cb94d9f861cc140560944d4" state: RUNNING consensus_state { current_term: 3 leader_uuid: "37089d44fdba4b6488b5b5aea28af614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27581 live_row_count: 0 } } sequence_number: 259
W20260928 01:56:38.682909 19187 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:57059 (request call id 261) took 8451 ms (client timeout 1000 ms). Trace:
W20260928 01:56:38.684345 19187 rpcz_store.cc:269] 0928 01:56:30.223628 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:30.957836 (+734208us) service_pool.cc:224] Handling call
0928 01:56:30.985522 (+ 27686us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5400030554. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbb5c0 00007f2fcdc5a6fa 00007f2fcf9cbd8c 00007f2fcfaca01e 00007f2fcd66efb4 00007f2fcd66ef42 00007f2fcd66ee71 00007f2fcd66edec 00007f2fcd66e0a2 00007f2fcb92009c 00007f2fcb91f4d6
0928 01:56:38.616520 (+7630998us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:38.616543 (+    23us) write_op.cc:454] Released schema lock
0928 01:56:38.675170 (+ 58627us) inbound_call.cc:177] Queueing failure response
Related trace 'op':
0928 01:56:38.616324 (+     0us) op_driver.cc:389] HandleFailure(Illegal state: replica c17b7f9972364c76893311539b569e0f is not leader of this config: current role FOLLOWER)
0928 01:56:38.616360 (+    36us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:38.616381 (+    21us) write_op.cc:454] Released schema lock
0928 01:56:38.616401 (+    20us) write_op.cc:335] FINISH: Op aborted
Metrics: {"reported_tablets":20,"spinlock_wait_cycles":48052992,"child_traces":[["op",{}]]}
I20260928 01:56:38.697172 22754 leader_election.cc:290] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:38.721233 22785 raft_consensus.cc:359] T a1e74d73a7eb44cd97c2c1df77b8b20c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.722055 22785 raft_consensus.cc:385] T a1e74d73a7eb44cd97c2c1df77b8b20c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:38.722401 22785 raft_consensus.cc:740] T a1e74d73a7eb44cd97c2c1df77b8b20c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37089d44fdba4b6488b5b5aea28af614, State: Initialized, Role: FOLLOWER
I20260928 01:56:38.736655 19527 heartbeater.cc:499] Master 127.18.161.62:38511 was elected leader, sending a full tablet report...
I20260928 01:56:38.764921 22786 raft_consensus.cc:493] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:38.765532 22786 raft_consensus.cc:515] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.767688 22786 leader_election.cc:290] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591), 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521)
I20260928 01:56:38.773067 19762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164564bc2c97430da228a621aa545e5a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8373bfae1f384c36b5e4c5ca26b208da" is_pre_election: true
I20260928 01:56:38.772015 19465 raft_consensus.cc:1275] T 664b608bb0f54fc5baa10622f7d916c1 P 37089d44fdba4b6488b5b5aea28af614 [term 5 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260928 01:56:38.775235 19409 leader_election.cc:343] T 164564bc2c97430da228a621aa545e5a P 37089d44fdba4b6488b5b5aea28af614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:56:38.776659 22754 raft_consensus.cc:493] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:38.777226 22754 raft_consensus.cc:515] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:38.781824 19591 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5e07078b2a4fe59d9293d9511cbb6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:40 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:38.788916 19591 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c6cfc9ff3344a48b09730dfde79d6cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:38.789709 19590 tablet_service.cc:1558] Processing DeleteTablet for tablet 7daa1b799e0d408287edc03988f5b683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:42 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:38.791055 22876 tablet.cc:1751] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:56:38.801390 22818 ts_tablet_manager.cc:1929] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 01:56:38.802003 22818 log.cc:1199] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/3505a502bff747deaf1e03c03375aafa
I20260928 01:56:38.792322 22785 consensus_queue.cc:260] T a1e74d73a7eb44cd97c2c1df77b8b20c P 37089d44fdba4b6488b5b5aea28af614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:38.823500 19556 consensus_peers.cc:597] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:38.825400 22785 ts_tablet_manager.cc:1434] T a1e74d73a7eb44cd97c2c1df77b8b20c P 37089d44fdba4b6488b5b5aea28af614: Time spent starting tablet: real 0.235s	user 0.005s	sys 0.002s
I20260928 01:56:38.825320 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 89e1d60db21f4a8294792df3fadf5d90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:35 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:38.827155 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet f709eccf4ab5413bbbd8b4746f185db4 with delete_type TABLET_DATA_DELETED (replaced by tablet e43bec2c4274497ea73872d0db233eac) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:38.828310 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 7602706a3fbc438d8d448c9ac057087c with delete_type TABLET_DATA_DELETED (replaced by tablet 4c6f4708c641414aa59f01703c86aaf1) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:38.829344 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a73835e2854976b40b31fe752d1b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:39 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:38.830322 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet c320eb2ca2ac4ac68293ef8f7400b45f with delete_type TABLET_DATA_DELETED (replaced by tablet 6546cfe6f3a6405fab41a4ebdcffb288) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:38.831496 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 12c7284250084d6299cafe8310cfd257 with delete_type TABLET_DATA_DELETED (replaced by tablet 13c395a6a87f4927b10973720aa4d868) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:38.849711 22703 consensus_queue.cc:1048] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 01:56:38.861637 22810 ts_tablet_manager.cc:1929] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 01:56:38.862125 22810 log.cc:1199] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/3505a502bff747deaf1e03c03375aafa
I20260928 01:56:38.863075 22810 ts_tablet_manager.cc:1950] T 3505a502bff747deaf1e03c03375aafa P 37089d44fdba4b6488b5b5aea28af614: Deleting consensus metadata
I20260928 01:56:38.869964 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e74d73a7eb44cd97c2c1df77b8b20c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:38.870595 19465 raft_consensus.cc:2468] T a1e74d73a7eb44cd97c2c1df77b8b20c P 37089d44fdba4b6488b5b5aea28af614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:38.847348 22754 leader_election.cc:290] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:38.868656 22799 tablet_bootstrap.cc:654] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da: Neither blocks nor log segments found. Creating new log.
I20260928 01:56:38.889273 22818 ts_tablet_manager.cc:1950] T 3505a502bff747deaf1e03c03375aafa P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:38.890280 19610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e74d73a7eb44cd97c2c1df77b8b20c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:38.891314 19610 raft_consensus.cc:2468] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 0.
I20260928 01:56:38.893639 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8a70d4a8654947be5ab2eb5539b3c9" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:38.894479 19616 raft_consensus.cc:2393] T 4d8a70d4a8654947be5ab2eb5539b3c9 P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate a3ee288ca1464d20a715673422a214a0 in this term.
I20260928 01:56:38.898334 22837 consensus_queue.cc:1048] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 01:56:38.905638 19616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "164564bc2c97430da228a621aa545e5a" candidate_uuid: "37089d44fdba4b6488b5b5aea28af614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0" is_pre_election: true
I20260928 01:56:38.906200 22874 tablet_replica.cc:333] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0: stopping tablet replica
I20260928 01:56:38.906333 19616 raft_consensus.cc:2468] T 164564bc2c97430da228a621aa545e5a P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37089d44fdba4b6488b5b5aea28af614 in term 0.
I20260928 01:56:38.908105 19177 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]) successfully deleted
I20260928 01:56:38.913007 19474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8a70d4a8654947be5ab2eb5539b3c9" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37089d44fdba4b6488b5b5aea28af614" is_pre_election: true
I20260928 01:56:38.913765 19474 raft_consensus.cc:2393] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 37089d44fdba4b6488b5b5aea28af614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8373bfae1f384c36b5e4c5ca26b208da in current term 1: Already voted for candidate 37089d44fdba4b6488b5b5aea28af614 in this term.
I20260928 01:56:38.913944 19179 catalog_manager.cc:5063] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]) successfully deleted
W20260928 01:56:38.922573 19193 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:58541 (request call id 282) took 11704 ms (client timeout 1000 ms). Trace:
W20260928 01:56:38.923275 19193 rpcz_store.cc:269] 0928 01:56:27.218124 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:27.218268 (+   144us) service_pool.cc:224] Handling call
0928 01:56:38.922247 (+11703979us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:30.845656 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:30.846192 (+   536us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:30.846220 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:56:30.846232 (+    12us) tablet.cc:662] Decoding operations
0928 01:56:30.846576 (+   344us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:30.846613 (+    37us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:30.846643 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:56:30.846951 (+   308us) tablet.cc:701] Row locks acquired
0928 01:56:30.846970 (+    19us) write_op.cc:260] PREPARE: finished
0928 01:56:30.847103 (+   133us) write_op.cc:270] Start()
0928 01:56:30.847215 (+   112us) write_op.cc:276] Timestamp: P: 1790560590847024 usec, L: 0
0928 01:56:30.847233 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:30.983164 (+135931us) log.cc:844] Serialized 907 byte log entry
0928 01:56:30.998319 (+ 15155us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400030554. stack: 00007f2fc6abd323 00007f2fc6abd220 00007f2fc6661574 0000000000516964 00000000005168f9 00007f2fcdbbaaa1 00007f2fcdc4d5e8 00007f2fce0dd791 00007f2fce0dcf68 00007f2fce0e1c01 00007f2fce0e1bb9 00007f2fce0e1b49 00007f2fce0e1b11 00007f2fce0e0d3d 00000000005bd4e4 00000000005bd319
0928 01:56:32.644460 (+1646141us) op_driver.cc:464] REPLICATION: finished
0928 01:56:32.701769 (+ 57309us) write_op.cc:301] APPLY: starting
0928 01:56:32.701828 (+    59us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:32.701943 (+   115us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:32.701966 (+    23us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:32.702272 (+   306us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:32.702416 (+   144us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:56:32.702463 (+    47us) write_op.cc:312] APPLY: finished
0928 01:56:32.702744 (+   281us) log.cc:844] Serialized 29 byte log entry
0928 01:56:32.703533 (+   789us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:32.703607 (+    74us) write_op.cc:454] Released schema lock
0928 01:56:32.703639 (+    32us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":108,"child_traces":[["op",{"apply.queue_time_us":57107,"apply.run_cpu_time_us":1487,"apply.run_wall_time_us":2195,"num_ops":2,"prepare.queue_time_us":480676,"prepare.run_cpu_time_us":4829,"prepare.run_wall_time_us":152811,"replication_time_us":1797076,"spinlock_wait_cycles":310970240,"thread_start_us":9185,"threads_started":1}]]}
I20260928 01:56:38.976552 22799 tablet_bootstrap.cc:492] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da: No bootstrap required, opened a new log
I20260928 01:56:38.977062 22799 ts_tablet_manager.cc:1403] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent bootstrapping tablet: real 0.410s	user 0.015s	sys 0.000s
I20260928 01:56:38.978385 19114 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_9a7d932e0ef8485cb1fb0d4450cbd14d [id=55616d2998544e568042a46ef7f958e4]). Expected version 2 got 1
I20260928 01:56:39.009788 22878 tablet.cc:1751] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 37089d44fdba4b6488b5b5aea28af614: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:56:39.015435 19114 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 6ea6adefd15a4ea19011419949047e83 (table default.Table_2a43036236e34e2586f541aa2fb3b8b6 [id=292d90fe578e4470bced0890a4e646ef]). Expected version 1 got 0
I20260928 01:56:39.027789 19113 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: Sending DeleteTablet for 3 replicas of tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3
I20260928 01:56:39.033914 19113 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51212 (request call id 346) took 1623 ms. Trace:
I20260928 01:56:39.042740 22885 raft_consensus.cc:493] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 81ebb46a410e43ebaec3ef4dd13a71fc)
I20260928 01:56:39.045053 19738 tablet_service.cc:1558] Processing DeleteTablet for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:56:37 UTC) from {username='slave'} at 127.0.0.1:44964
I20260928 01:56:39.034288 19113 rpcz_store.cc:276] 0928 01:56:37.410449 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:37.410708 (+   259us) service_pool.cc:224] Handling call
0928 01:56:37.413489 (+  2781us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 01:56:37.427646 (+ 14157us) catalog_manager.cc:2854] Modifying in-memory table state
0928 01:56:37.427823 (+   177us) catalog_manager.cc:2863] Locking tablets
0928 01:56:37.428979 (+  1156us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 01:56:37.450818 (+ 21839us) catalog_manager.cc:2895] Removing table from by-name map
0928 01:56:37.524561 (+ 73743us) catalog_manager.cc:2911] Committing in-memory state
0928 01:56:39.027684 (+1503123us) catalog_manager.cc:2915] Aborting table tasks
0928 01:56:39.033825 (+  6141us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:37.431330 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:37.431906 (+   576us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:37.431934 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:56:37.431959 (+    25us) tablet.cc:662] Decoding operations
0928 01:56:37.432584 (+   625us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:37.432644 (+    60us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:37.432677 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:56:37.433232 (+   555us) tablet.cc:701] Row locks acquired
0928 01:56:37.433278 (+    46us) write_op.cc:260] PREPARE: finished
0928 01:56:37.433481 (+   203us) write_op.cc:270] Start()
0928 01:56:37.433583 (+   102us) write_op.cc:276] Timestamp: P: 1790560597433422 usec, L: 0
0928 01:56:37.433598 (+    15us) op_driver.cc:348] REPLICATION: starting
0928 01:56:37.434484 (+   886us) log.cc:844] Serialized 728 byte log entry
0928 01:56:37.447698 (+ 13214us) op_driver.cc:464] REPLICATION: finished
0928 01:56:37.448050 (+   352us) write_op.cc:301] APPLY: starting
0928 01:56:37.448112 (+    62us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:37.448250 (+   138us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:37.448361 (+   111us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:37.448645 (+   284us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:37.448794 (+   149us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 01:56:37.448836 (+    42us) write_op.cc:312] APPLY: finished
0928 01:56:37.449031 (+   195us) log.cc:844] Serialized 29 byte log entry
0928 01:56:37.449200 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:37.449268 (+    68us) write_op.cc:454] Released schema lock
0928 01:56:37.449304 (+    36us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:37.449528 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:37.449555 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":189,"apply.run_cpu_time_us":1440,"apply.run_wall_time_us":1440,"num_ops":2,"prepare.queue_time_us":100,"prepare.run_cpu_time_us":3225,"prepare.run_wall_time_us":8668,"raft.queue_time_us":93,"raft.run_cpu_time_us":754,"raft.run_wall_time_us":4454,"replication_time_us":13983}]]}
I20260928 01:56:39.049281 19446 tablet_service.cc:1558] Processing DeleteTablet for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:56:37 UTC) from {username='slave'} at 127.0.0.1:39104
I20260928 01:56:39.050195 22810 tablet_replica.cc:333] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614: stopping tablet replica
I20260928 01:56:39.051254 22810 raft_consensus.cc:2243] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 LEADER]: Raft consensus shutting down.
I20260928 01:56:39.052320 22810 raft_consensus.cc:2272] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:39.056730 22810 ts_tablet_manager.cc:1916] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 37089d44fdba4b6488b5b5aea28af614: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:56:39.062126 19076 master-stress-test.cc:581] Killed test thread 7/10
I20260928 01:56:39.062407 19076 master-stress-test.cc:579] Killing test thread 8/10
I20260928 01:56:39.062707 19076 master-stress-test.cc:581] Killed test thread 8/10
I20260928 01:56:39.062928 19076 master-stress-test.cc:579] Killing test thread 9/10
I20260928 01:56:39.063242 19076 master-stress-test.cc:581] Killed test thread 9/10
I20260928 01:56:39.063448 19076 master-stress-test.cc:579] Killing test thread 10/10
I20260928 01:56:39.063706 19076 master-stress-test.cc:581] Killed test thread 10/10
I20260928 01:56:39.064077 19076 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu with pid 19366
I20260928 01:56:39.065982 22886 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 81ebb46a410e43ebaec3ef4dd13a71fc)
I20260928 01:56:39.067606 22886 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:39.073503 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 10 candidate_status { last_received { term: 9 index: 398 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:56:39.074018 19117 catalog_manager.cc:5838] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:39.076836 19117 catalog_manager.cc:5838] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:39.080035 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 22606f012f1c44bd92c8e0341e9ca2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:32 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:39.083123 22885 raft_consensus.cc:515] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 38511 } } peers { permanent_uuid: "c17b7f9972364c76893311539b569e0f" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43775 } } peers { permanent_uuid: "04e48edd841a42d08a480be209f0d294" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 39095 } }
I20260928 01:56:39.084924 19117 catalog_manager.cc:5838] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:39.085243 19197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e48edd841a42d08a480be209f0d294" candidate_term: 10 candidate_status { last_received { term: 9 index: 398 } } ignore_live_leader: false dest_uuid: "c17b7f9972364c76893311539b569e0f" is_pre_election: true
I20260928 01:56:39.087844 20447 leader_election.cc:304] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e48edd841a42d08a480be209f0d294; no voters: 81ebb46a410e43ebaec3ef4dd13a71fc, c17b7f9972364c76893311539b569e0f
I20260928 01:56:39.092312 19126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 398 } } ignore_live_leader: false dest_uuid: "81ebb46a410e43ebaec3ef4dd13a71fc" is_pre_election: true
I20260928 01:56:39.085837 22886 leader_election.cc:290] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), c17b7f9972364c76893311539b569e0f (127.18.161.61:43775)
I20260928 01:56:39.093338 22886 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e48edd841a42d08a480be209f0d294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260928 01:56:39.095192 19117 catalog_manager.cc:5838] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:39.096789 19117 catalog_manager.cc:5838] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260928 01:56:39.098848 22885 leader_election.cc:290] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 81ebb46a410e43ebaec3ef4dd13a71fc (127.18.161.62:38511), 04e48edd841a42d08a480be209f0d294 (127.18.161.60:39095)
W20260928 01:56:39.101399 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 89534.7us
I20260928 01:56:39.102192 19703 leader_election.cc:304] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37089d44fdba4b6488b5b5aea28af614, 8373bfae1f384c36b5e4c5ca26b208da; no voters: 
I20260928 01:56:39.103302 22779 raft_consensus.cc:2804] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:56:39.103679 22779 raft_consensus.cc:493] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:56:39.104012 22779 raft_consensus.cc:3060] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:39.109746 20553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c17b7f9972364c76893311539b569e0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 398 } } ignore_live_leader: false dest_uuid: "04e48edd841a42d08a480be209f0d294" is_pre_election: true
I20260928 01:56:39.111907 19179 leader_election.cc:304] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c17b7f9972364c76893311539b569e0f; no voters: 04e48edd841a42d08a480be209f0d294, 81ebb46a410e43ebaec3ef4dd13a71fc
I20260928 01:56:39.116796 22799 raft_consensus.cc:359] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:39.117581 22799 raft_consensus.cc:385] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:56:39.117877 22799 raft_consensus.cc:740] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Initialized, Role: FOLLOWER
I20260928 01:56:39.118643 22799 consensus_queue.cc:260] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:39.130712 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 202093us
I20260928 01:56:39.132655 19704 leader_election.cc:304] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da; no voters: 37089d44fdba4b6488b5b5aea28af614, a3ee288ca1464d20a715673422a214a0
I20260928 01:56:39.135063 22835 raft_consensus.cc:3060] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:39.142769 22835 raft_consensus.cc:2749] T 4d8a70d4a8654947be5ab2eb5539b3c9 P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:56:39.145287 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet c1f73a301c84482f897990ac5e5dd162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:55:37 UTC) from {username='slave'} at 127.0.0.1:57616
I20260928 01:56:39.148131 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:56:37 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:56:38.908152 22874 raft_consensus.cc:2243] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:56:39.153682 22874 raft_consensus.cc:2272] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:39.172832 19762 raft_consensus.cc:1275] T 664b608bb0f54fc5baa10622f7d916c1 P 8373bfae1f384c36b5e4c5ca26b208da [term 5 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260928 01:56:39.177919 22818 tablet_replica.cc:333] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da: stopping tablet replica
I20260928 01:56:39.178169 22874 ts_tablet_manager.cc:1916] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:39.179642 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 76089us
I20260928 01:56:39.214591 22799 ts_tablet_manager.cc:1434] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da: Time spent starting tablet: real 0.237s	user 0.008s	sys 0.000s
I20260928 01:56:39.214473 22885 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c17b7f9972364c76893311539b569e0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260928 01:56:39.235723 19116 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: default.Table_dc5c9c73f0b144d3b46128870b65d40f [id=8e39f7a29aaa45e4914447ea47c3c81e] alter complete (version 2)
I20260928 01:56:39.244853 22818 raft_consensus.cc:2243] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 01:56:39.245548 22818 raft_consensus.cc:2272] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 01:56:39.247942 22818 ts_tablet_manager.cc:1916] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:56:39.257380 19704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.2:33591, user_credentials={real_user=slave}} blocked reactor thread for 123195us
I20260928 01:56:39.257745 19116 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: default.Table_662047afe0034f4fb6ba274ef435e974 [id=2cc97459d82f44da97d833209e2af117] alter complete (version 1)
W20260928 01:56:39.285776 19117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.3:60925 (request call id 131) took 1313 ms (client timeout 1000 ms). Trace:
W20260928 01:56:39.286262 19117 rpcz_store.cc:269] 0928 01:56:37.971996 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:37.972228 (+   232us) service_pool.cc:224] Handling call
0928 01:56:39.285690 (+1313462us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:39.104713 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:39.105401 (+   688us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:39.105442 (+    41us) write_op.cc:435] Acquired schema lock
0928 01:56:39.105476 (+    34us) tablet.cc:662] Decoding operations
0928 01:56:39.106433 (+   957us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:39.106644 (+   211us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:39.106693 (+    49us) tablet.cc:685] Acquiring locks for 5 operations
0928 01:56:39.107586 (+   893us) tablet.cc:701] Row locks acquired
0928 01:56:39.107618 (+    32us) write_op.cc:260] PREPARE: finished
0928 01:56:39.107817 (+   199us) write_op.cc:270] Start()
0928 01:56:39.107953 (+   136us) write_op.cc:276] Timestamp: P: 1790560599107763 usec, L: 0
0928 01:56:39.107971 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:39.108837 (+   866us) log.cc:844] Serialized 2039 byte log entry
0928 01:56:39.229309 (+120472us) op_driver.cc:464] REPLICATION: finished
0928 01:56:39.233002 (+  3693us) write_op.cc:301] APPLY: starting
0928 01:56:39.233067 (+    65us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:39.233237 (+   170us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:39.233368 (+   131us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:39.234040 (+   672us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:39.234215 (+   175us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0928 01:56:39.234269 (+    54us) write_op.cc:312] APPLY: finished
0928 01:56:39.234482 (+   213us) log.cc:844] Serialized 47 byte log entry
0928 01:56:39.234617 (+   135us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:39.234702 (+    85us) write_op.cc:454] Released schema lock
0928 01:56:39.234739 (+    37us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:39.275867 (+ 41128us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:39.275895 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4788,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":3495,"apply.run_cpu_time_us":2056,"apply.run_wall_time_us":42830,"num_ops":5,"prepare.queue_time_us":1419,"prepare.run_cpu_time_us":4420,"prepare.run_wall_time_us":4419,"replication_time_us":121212,"thread_start_us":7555,"threads_started":1}]]}
W20260928 01:56:39.315630 19116 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 143) took 2568 ms (client timeout 1000 ms). Trace:
W20260928 01:56:39.333942 19553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.3:44521, user_credentials={real_user=slave}} blocked reactor thread for 82363.3us
W20260928 01:56:39.316305 19116 rpcz_store.cc:269] 0928 01:56:36.747397 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:36.747641 (+   244us) service_pool.cc:224] Handling call
0928 01:56:39.315538 (+2567897us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:38.433243 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:38.446162 (+ 12919us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:38.446210 (+    48us) write_op.cc:435] Acquired schema lock
0928 01:56:38.446229 (+    19us) tablet.cc:662] Decoding operations
0928 01:56:38.447193 (+   964us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:38.447257 (+    64us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:38.447286 (+    29us) tablet.cc:685] Acquiring locks for 10 operations
0928 01:56:38.448035 (+   749us) tablet.cc:701] Row locks acquired
0928 01:56:38.448055 (+    20us) write_op.cc:260] PREPARE: finished
0928 01:56:38.448227 (+   172us) write_op.cc:270] Start()
0928 01:56:38.448328 (+   101us) write_op.cc:276] Timestamp: P: 1790560598448134 usec, L: 0
0928 01:56:38.448348 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:56:38.448983 (+   635us) log.cc:844] Serialized 3924 byte log entry
0928 01:56:38.516095 (+ 67112us) op_driver.cc:464] REPLICATION: finished
0928 01:56:38.609785 (+ 93690us) write_op.cc:301] APPLY: starting
0928 01:56:38.609854 (+    69us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:38.610101 (+   247us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:38.610217 (+   116us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:38.681096 (+ 70879us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:38.681317 (+   221us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0928 01:56:38.681359 (+    42us) write_op.cc:312] APPLY: finished
0928 01:56:38.682325 (+   966us) log.cc:844] Serialized 77 byte log entry
0928 01:56:38.683183 (+   858us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:38.683348 (+   165us) write_op.cc:454] Released schema lock
0928 01:56:38.683391 (+    43us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:38.780463 (+ 97072us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:38.780490 (+    27us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:39.098762 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:39.099281 (+   519us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:39.099308 (+    27us) write_op.cc:435] Acquired schema lock
0928 01:56:39.099325 (+    17us) tablet.cc:662] Decoding operations
0928 01:56:39.099634 (+   309us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:39.099684 (+    50us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:39.099712 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:39.099883 (+   171us) tablet.cc:701] Row locks acquired
0928 01:56:39.099900 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:56:39.100038 (+   138us) write_op.cc:270] Start()
0928 01:56:39.100140 (+   102us) write_op.cc:276] Timestamp: P: 1790560599099995 usec, L: 0
0928 01:56:39.100157 (+    17us) op_driver.cc:348] REPLICATION: starting
0928 01:56:39.100786 (+   629us) log.cc:844] Serialized 356 byte log entry
0928 01:56:39.217660 (+116874us) op_driver.cc:464] REPLICATION: finished
0928 01:56:39.218000 (+   340us) write_op.cc:301] APPLY: starting
0928 01:56:39.218058 (+    58us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:39.218160 (+   102us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:39.218246 (+    86us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:39.218445 (+   199us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:39.233797 (+ 15352us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:39.233852 (+    55us) write_op.cc:312] APPLY: finished
0928 01:56:39.234077 (+   225us) log.cc:844] Serialized 23 byte log entry
0928 01:56:39.235268 (+  1191us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:39.235337 (+    69us) write_op.cc:454] Released schema lock
0928 01:56:39.235368 (+    31us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:39.236142 (+   774us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:39.236168 (+    26us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 01:56:39.242865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:39.243375 (+   510us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:39.243403 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:56:39.243415 (+    12us) tablet.cc:662] Decoding operations
0928 01:56:39.243760 (+   345us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:39.243811 (+    51us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:39.243839 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:39.244011 (+   172us) tablet.cc:701] Row locks acquired
0928 01:56:39.244030 (+    19us) write_op.cc:260] PREPARE: finished
0928 01:56:39.244177 (+   147us) write_op.cc:270] Start()
0928 01:56:39.244311 (+   134us) write_op.cc:276] Timestamp: P: 1790560599244128 usec, L: 0
0928 01:56:39.244330 (+    19us) op_driver.cc:348] REPLICATION: starting
0928 01:56:39.244900 (+   570us) log.cc:844] Serialized 356 byte log entry
0928 01:56:39.253002 (+  8102us) op_driver.cc:464] REPLICATION: finished
0928 01:56:39.254405 (+  1403us) write_op.cc:301] APPLY: starting
0928 01:56:39.254468 (+    63us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:39.254575 (+   107us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:39.254688 (+   113us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:39.254910 (+   222us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:39.255056 (+   146us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:39.255099 (+    43us) write_op.cc:312] APPLY: finished
0928 01:56:39.255291 (+   192us) log.cc:844] Serialized 23 byte log entry
0928 01:56:39.255445 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:39.257363 (+  1918us) write_op.cc:454] Released schema lock
0928 01:56:39.257405 (+    42us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:39.257672 (+   267us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:39.257695 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46465,"reported_tablets":97,"child_traces":[["op",{"apply.queue_time_us":93351,"apply.run_cpu_time_us":2972,"apply.run_wall_time_us":170632,"num_ops":10,"prepare.queue_time_us":49128,"prepare.run_cpu_time_us":3958,"prepare.run_wall_time_us":36526,"raft.queue_time_us":6639,"raft.run_cpu_time_us":1870,"raft.run_wall_time_us":1870,"replication_time_us":67610,"thread_start_us":142781,"threads_started":2}],["op",{"apply.queue_time_us":179,"apply.run_cpu_time_us":7834,"apply.run_wall_time_us":18103,"num_ops":1,"prepare.queue_time_us":14148,"prepare.run_cpu_time_us":2458,"prepare.run_wall_time_us":5774,"raft.queue_time_us":6996,"raft.run_cpu_time_us":1930,"raft.run_wall_time_us":1929,"replication_time_us":117393,"spinlock_wait_cycles":48256,"thread_start_us":16528,"threads_started":1}],["op",{"apply.queue_time_us":1202,"apply.run_cpu_time_us":1416,"apply.run_wall_time_us":3247,"num_ops":1,"prepare.queue_time_us":188,"prepare.run_cpu_time_us":2371,"prepare.run_wall_time_us":2370,"raft.queue_time_us":290,"raft.run_cpu_time_us":860,"raft.run_wall_time_us":859,"replication_time_us":8565}]]}
I20260928 01:56:39.357151 22779 raft_consensus.cc:515] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
W20260928 01:56:39.359587 19618 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.006s	sys 0.025s
W20260928 01:56:39.360102 19618 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.006s	sys 0.025s
I20260928 01:56:39.363205 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet e8f6ce7612d4463ebe95e07557bca4e7 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d8a70d4a8654947be5ab2eb5539b3c9) from {username='slave'} at 127.0.0.1:47670
I20260928 01:56:39.364490 19592 tablet_service.cc:1558] Processing DeleteTablet for tablet 3505a502bff747deaf1e03c03375aafa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 01:56:29 UTC) from {username='slave'} at 127.0.0.1:47670
I20260928 01:56:39.368716 22873 consensus_queue.cc:1048] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260928 01:56:39.381042 19114 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 188) took 1634 ms (client timeout 1000 ms). Trace:
W20260928 01:56:39.381511 19114 rpcz_store.cc:269] 0928 01:56:37.746879 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:37.747046 (+   167us) service_pool.cc:224] Handling call
0928 01:56:39.380960 (+1633914us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":101}
W20260928 01:56:39.404577 22889 log.cc:927] Time spent T d7774406b22547d29d9d42c969cf0874 P a3ee288ca1464d20a715673422a214a0: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260928 01:56:39.405740 22779 leader_election.cc:290] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Requested vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
I20260928 01:56:39.413830 22818 ts_tablet_manager.cc:1929] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260928 01:56:39.414402 22818 log.cc:1199] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/52b9f4b9caea4354bcec4f4cbb4fa0d3
I20260928 01:56:39.415305 22818 ts_tablet_manager.cc:1950] T 52b9f4b9caea4354bcec4f4cbb4fa0d3 P 8373bfae1f384c36b5e4c5ca26b208da: Deleting consensus metadata
I20260928 01:56:39.428265 19102 catalog_manager.cc:5063] TS 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3:44521): tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3 (table default.Table_b8264f1458f942c8b96c2608b66f6fdb [id=8fab3d5874c2478b91abc9583524361f]) successfully deleted
I20260928 01:56:39.454231 19762 raft_consensus.cc:1275] T a735102c576640b69323cacb50393a42 P 8373bfae1f384c36b5e4c5ca26b208da [term 3 FOLLOWER]: Refusing update from remote peer a3ee288ca1464d20a715673422a214a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260928 01:56:39.456032 19608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e74d73a7eb44cd97c2c1df77b8b20c" candidate_uuid: "8373bfae1f384c36b5e4c5ca26b208da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ee288ca1464d20a715673422a214a0"
I20260928 01:56:39.456717 19608 raft_consensus.cc:3060] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:56:39.468780 19610 raft_consensus.cc:1275] T 13c395a6a87f4927b10973720aa4d868 P a3ee288ca1464d20a715673422a214a0 [term 5 FOLLOWER]: Refusing update from remote peer 8373bfae1f384c36b5e4c5ca26b208da: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260928 01:56:39.471179 22884 consensus_queue.cc:1048] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 01:56:39.475440 19608 raft_consensus.cc:2468] T a1e74d73a7eb44cd97c2c1df77b8b20c P a3ee288ca1464d20a715673422a214a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373bfae1f384c36b5e4c5ca26b208da in term 1.
I20260928 01:56:39.481801 19704 leader_election.cc:304] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373bfae1f384c36b5e4c5ca26b208da, a3ee288ca1464d20a715673422a214a0; no voters: 
I20260928 01:56:39.484726 22779 raft_consensus.cc:2804] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:56:39.485370 22779 raft_consensus.cc:697] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [term 1 LEADER]: Becoming Leader. State: Replica: 8373bfae1f384c36b5e4c5ca26b208da, State: Running, Role: LEADER
I20260928 01:56:39.489552 22779 consensus_queue.cc:237] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:39.525393 22898 tablet.cc:1751] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P a3ee288ca1464d20a715673422a214a0: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 2
I20260928 01:56:39.546396 22873 consensus_queue.cc:1048] T a735102c576640b69323cacb50393a42 P a3ee288ca1464d20a715673422a214a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260928 01:56:39.611421 22874 ts_tablet_manager.cc:1929] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 01:56:39.666958 19111 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_9a7d932e0ef8485cb1fb0d4450cbd14d [id=55616d2998544e568042a46ef7f958e4]). Expected version 2 got 1
I20260928 01:56:39.692459 22874 log.cc:1199] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/3505a502bff747deaf1e03c03375aafa
I20260928 01:56:39.693492 22874 ts_tablet_manager.cc:1950] T 3505a502bff747deaf1e03c03375aafa P a3ee288ca1464d20a715673422a214a0: Deleting consensus metadata
I20260928 01:56:39.703862 22884 consensus_queue.cc:1048] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:56:39.718627 22874 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57616 (request call id 84) took 1161 ms. Trace:
I20260928 01:56:39.719049 22874 rpcz_store.cc:276] 0928 01:56:38.557218 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:38.658253 (+101035us) service_pool.cc:224] Handling call
0928 01:56:38.798734 (+140481us) ts_tablet_manager.cc:1151] Deleting tablet 3505a502bff747deaf1e03c03375aafa
0928 01:56:38.905885 (+107151us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0928 01:56:39.391099 (+485214us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:39.611278 (+220179us) tablet_metadata.cc:665] Metadata flushed
0928 01:56:39.718534 (+107256us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":139117,"thread_start_us":83537,"threads_started":1}
I20260928 01:56:39.720665 19111 catalog_manager.cc:5938] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953) does not have the latest schema for tablet 6ea6adefd15a4ea19011419949047e83 (table default.Table_2a43036236e34e2586f541aa2fb3b8b6 [id=292d90fe578e4470bced0890a4e646ef]). Expected version 1 got 0
W20260928 01:56:39.722864 19556 connection.cc:573] server connection from 127.18.161.1:38687 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:56:39.723963 20456 connection.cc:573] server connection from 127.18.161.1:58377 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:56:39.725064 19556 connection.cc:573] client connection to 127.18.161.1:41953 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:56:39.725455 19556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
I20260928 01:56:39.743817 19180 catalog_manager.cc:5063] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): tablet 3505a502bff747deaf1e03c03375aafa (table default.Table_81323d2c6d8441fe93083d127876a785 [id=c0c2961b24dd4e1580eb67f7a43c5e12]) successfully deleted
W20260928 01:56:39.746585 19180 catalog_manager.cc:5030] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): delete failed for tablet 8a5e07078b2a4fe59d9293d9511cbb6b because the tablet was not found. No further retry: Not found: Tablet not found: 8a5e07078b2a4fe59d9293d9511cbb6b
W20260928 01:56:39.749462 19703 connection.cc:573] client connection to 127.18.161.1:41953 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:56:39.749480 19104 connection.cc:573] client connection to 127.18.161.1:41953 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:56:39.749596 19102 connection.cc:573] server connection from 127.18.161.1:35041 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:56:39.749934 19104 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
W20260928 01:56:39.749953 19703 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:56:39.751267 19180 connection.cc:573] server connection from 127.18.161.1:57059 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 01:56:39.773099 19076 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu with pid 19526
W20260928 01:56:39.784224 19178 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 6ea6adefd15a4ea19011419949047e83 (table default.Table_2a43036236e34e2586f541aa2fb3b8b6 [id=292d90fe578e4470bced0890a4e646ef], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6ea6adefd15a4ea19011419949047e83 consensus state has no leader
W20260928 01:56:39.786335 19104 catalog_manager.cc:4790] TS 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 52b9f4b9caea4354bcec4f4cbb4fa0d3: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111)
I20260928 01:56:39.790447 19114 catalog_manager.cc:5838] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 0 to 1, leader changed from <none> to 8373bfae1f384c36b5e4c5ca26b208da (127.18.161.3). New cstate: current_term: 1 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
I20260928 01:56:39.793072 19114 catalog_manager.cc:5838] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "8373bfae1f384c36b5e4c5ca26b208da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: HEALTHY } } }
W20260928 01:56:39.795344 19703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.161.1:41953, user_credentials={real_user=slave}} blocked reactor thread for 45443.1us
W20260928 01:56:39.810900 19703 consensus_peers.cc:597] T 10fa56df34ad44d88f1dd700c823d57c P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.811406 19703 consensus_peers.cc:597] T d7774406b22547d29d9d42c969cf0874 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.835907 19703 consensus_peers.cc:597] T ea77f3197ee5496d9624cc76b3361ace P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.844671 19703 consensus_peers.cc:597] T 2156dae74ee748cd845b6dea1d3b8ea8 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.845155 19703 consensus_peers.cc:597] T 202f1ead822548a2bbeae4e4d3cf9be8 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.845533 19703 consensus_peers.cc:597] T 982c3e07bcb94230b93764330914630f P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.845878 19703 consensus_peers.cc:597] T b60e7bd679e447d18e340cfaed66d328 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.846196 19703 consensus_peers.cc:597] T a1710b95678440b1bff8a92080d43272 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.846516 19703 consensus_peers.cc:597] T 5374596938d64cafb9621a1932ca1f68 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.846823 19703 consensus_peers.cc:597] T c2597de2c4304074977db5a3c0426814 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.847137 19703 consensus_peers.cc:597] T 0287060a8d054b15b2252dcf280ca8c2 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.847436 19703 leader_election.cc:336] T a1e74d73a7eb44cd97c2c1df77b8b20c P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 election: RPC error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111)
W20260928 01:56:39.848091 19703 consensus_peers.cc:597] T 4c6f4708c641414aa59f01703c86aaf1 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.869931 19703 consensus_peers.cc:597] T 0669f9f51b05479aa9715e06d4c42423 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.877257 19703 consensus_peers.cc:597] T 99e806ba248746d2bde39a2eb76b17df P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.877804 19703 consensus_peers.cc:597] T 21906a8380e64d95b9454a57fc01c6f0 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.878232 19703 consensus_peers.cc:597] T ef752c3b4b22490ab42292f61278da52 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.878646 19703 consensus_peers.cc:597] T 65fdc8575c7440ffbf5c7c4db5d4b35e P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.879079 19703 consensus_peers.cc:597] T 45d8d07b367b4fafbd7171f8ea7b2a26 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.879492 19703 consensus_peers.cc:597] T 376b5a87b07b4f87a2a502b5fa1b23f8 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.879963 19703 consensus_peers.cc:597] T 13c395a6a87f4927b10973720aa4d868 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.884236 19111 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 189) took 896 ms (client timeout 1000 ms). Trace:
W20260928 01:56:39.884617 19111 rpcz_store.cc:269] 0928 01:56:38.987737 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:38.987977 (+   240us) service_pool.cc:224] Handling call
0928 01:56:39.884143 (+896166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50669,"reported_tablets":100}
W20260928 01:56:39.885617 19102 connection.cc:466] server connection from 127.18.161.1:35041 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.18.161.1:35041 (request call id 189) could send its response
W20260928 01:56:39.880419 19703 consensus_peers.cc:597] T 3f4a1c903a04450684ba38081a75559e P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.890511 19703 consensus_peers.cc:597] T 86825485bfca479ea63c1a99dddb68d6 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.891650 19703 consensus_peers.cc:597] T 9a9c2db89fb8467d91c6bd01985d8b40 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.892165 19703 consensus_peers.cc:597] T f7b78eb499d6418f8877bf3b59bbbec2 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.892620 19703 consensus_peers.cc:597] T 71a064862b854ad4af884e4ca95ffb31 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.893031 19703 consensus_peers.cc:597] T 0d5018f065824614a42f93afd49f770e P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.893419 19703 consensus_peers.cc:597] T d114d5ba862044b4b88eee27395db7e3 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.893832 19703 consensus_peers.cc:597] T ba89039dcfa848159112caa76802b5f1 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.918136 19703 consensus_peers.cc:597] T 8c6a5cb9b09e4e5a8400bf71dbf99987 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.918725 19703 consensus_peers.cc:597] T 7979940c4a2e470bbecc40384edf38c9 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.919205 19703 consensus_peers.cc:597] T 1555e557370a4e92915a9c55107b573b P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.922595 19703 consensus_peers.cc:597] T 2c007b068b1d414298cce3fe44a91daa P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.923810 19703 consensus_peers.cc:597] T 65d70a8be7244c86864187420a4fd5f5 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.925206 19703 consensus_peers.cc:597] T 6546cfe6f3a6405fab41a4ebdcffb288 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.931833 19703 consensus_peers.cc:597] T 7801c623930d4e4eaf24c5c424b06d26 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.938474 19703 consensus_peers.cc:597] T 4e6b59144fe14daab98b0965c7f8af02 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.939070 19703 consensus_peers.cc:597] T 5442dd0aa28545c8bcf3a0b977c71e98 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.939519 19703 consensus_peers.cc:597] T f887fe10461d40ee9363ce97ebbedd4f P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.945186 19703 consensus_peers.cc:597] T d0cb771766b44b149d3ed3ddf75a7474 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.945752 19703 consensus_peers.cc:597] T fb159b3aad31479f80683b0d80549cc3 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.946267 19703 consensus_peers.cc:597] T 8dc9a1c5be7c4e519f1415ba70397f01 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.946688 19703 consensus_peers.cc:597] T 11a7c70dba4e4b3b97104b5d65704b9d P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.947129 19703 consensus_peers.cc:597] T 8e39fce4f0a149a898de678d73052f52 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:39.954566 22837 raft_consensus.cc:493] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:56:39.955085 22837 raft_consensus.cc:515] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } } peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } }
I20260928 01:56:39.957190 22837 leader_election.cc:290] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953), a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591)
W20260928 01:56:39.958267 19703 consensus_peers.cc:597] T 416ccc1323fe41b2a7783dc95bba8d84 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.959039 19703 consensus_peers.cc:597] T a23b494afa1f45988d447519356d2b03 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260928 01:56:39.977917 19703 leader_election.cc:336] T 164564bc2c97430da228a621aa545e5a P 8373bfae1f384c36b5e4c5ca26b208da [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111)
W20260928 01:56:40.046320 19703 consensus_peers.cc:597] T fc428ccbf88e4d5cbae197cb67e9a0a5 P 8373bfae1f384c36b5e4c5ca26b208da -> Peer 37089d44fdba4b6488b5b5aea28af614 (127.18.161.1:41953): Couldn't send request to peer 37089d44fdba4b6488b5b5aea28af614. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.1:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 01:56:40.047780 19113 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 8c6a5cb9b09e4e5a8400bf71dbf99987 (table default.Table_9a7d932e0ef8485cb1fb0d4450cbd14d [id=55616d2998544e568042a46ef7f958e4]). Expected version 2 got 1
I20260928 01:56:40.051586 19113 catalog_manager.cc:5838] T 664b608bb0f54fc5baa10622f7d916c1 P a3ee288ca1464d20a715673422a214a0 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "a3ee288ca1464d20a715673422a214a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373bfae1f384c36b5e4c5ca26b208da" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ee288ca1464d20a715673422a214a0" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37089d44fdba4b6488b5b5aea28af614" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 41953 } health_report { overall_health: UNKNOWN } } }
W20260928 01:56:40.092330 19180 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.161.2:33591 (error 108)
W20260928 01:56:40.092804 20455 connection.cc:573] server connection from 127.18.161.2:48011 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:56:40.093439 19704 connection.cc:573] client connection to 127.18.161.2:33591 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 01:56:40.100498 19113 catalog_manager.cc:5938] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591) does not have the latest schema for tablet 6ea6adefd15a4ea19011419949047e83 (table default.Table_2a43036236e34e2586f541aa2fb3b8b6 [id=292d90fe578e4470bced0890a4e646ef]). Expected version 1 got 0
I20260928 01:56:40.103902 19076 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu with pid 19676
I20260928 01:56:40.105280 19114 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 81ebb46a410e43ebaec3ef4dd13a71fc: default.Table_9a7d932e0ef8485cb1fb0d4450cbd14d [id=55616d2998544e568042a46ef7f958e4] alter complete (version 2)
W20260928 01:56:40.141392 19180 catalog_manager.cc:4790] TS a3ee288ca1464d20a715673422a214a0 (127.18.161.2:33591): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3c6cfc9ff3344a48b09730dfde79d6cf: Network error: Client connection negotiation failed: client connection to 127.18.161.2:33591: connect: Connection refused (error 111)
W20260928 01:56:40.173051 19113 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 144) took 1100 ms (client timeout 1000 ms). Trace:
W20260928 01:56:40.173395 19113 rpcz_store.cc:269] 0928 01:56:39.072793 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:56:39.073305 (+   512us) service_pool.cc:224] Handling call
0928 01:56:40.172960 (+1099655us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:56:40.110822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:56:40.111297 (+   475us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:56:40.111325 (+    28us) write_op.cc:435] Acquired schema lock
0928 01:56:40.111337 (+    12us) tablet.cc:662] Decoding operations
0928 01:56:40.111672 (+   335us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:56:40.111719 (+    47us) write_op.cc:641] Partition lock acquired for write op
0928 01:56:40.111745 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0928 01:56:40.111908 (+   163us) tablet.cc:701] Row locks acquired
0928 01:56:40.111925 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:56:40.112056 (+   131us) write_op.cc:270] Start()
0928 01:56:40.112147 (+    91us) write_op.cc:276] Timestamp: P: 1790560600112011 usec, L: 0
0928 01:56:40.112165 (+    18us) op_driver.cc:348] REPLICATION: starting
0928 01:56:40.112732 (+   567us) log.cc:844] Serialized 530 byte log entry
0928 01:56:40.115115 (+  2383us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b180008e600. stack: 00007f19f65b9323 00007f19f65b9220 00007f19f615d574 0000000000516964 00000000005168f9 00007f19ff4e5b81 00007f19ff4f2571 00007f19f65eb4c7 00007f19f65ed751 00007f19f65ed709 00007f19f65ed699 00007f19f65ed661 00007f19f65ec95d 00000000005bd4e4 00000000005bd319 00007f19f65ce81a
0928 01:56:40.125888 (+ 10773us) op_driver.cc:464] REPLICATION: finished
0928 01:56:40.126363 (+   475us) write_op.cc:301] APPLY: starting
0928 01:56:40.126431 (+    68us) tablet.cc:1394] starting BulkCheckPresence
0928 01:56:40.126537 (+   106us) tablet.cc:1397] finished BulkCheckPresence
0928 01:56:40.126552 (+    15us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:56:40.126759 (+   207us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:56:40.126901 (+   142us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 01:56:40.126945 (+    44us) write_op.cc:312] APPLY: finished
0928 01:56:40.127133 (+   188us) log.cc:844] Serialized 23 byte log entry
0928 01:56:40.127287 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:40.127352 (+    65us) write_op.cc:454] Released schema lock
0928 01:56:40.127385 (+    33us) write_op.cc:341] FINISH: Updating metrics
0928 01:56:40.127616 (+   231us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:56:40.127640 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3049,"reported_tablets":100,"child_traces":[["op",{"apply.queue_time_us":316,"apply.run_cpu_time_us":1223,"apply.run_wall_time_us":1222,"num_ops":1,"prepare.queue_time_us":107,"prepare.run_cpu_time_us":2265,"prepare.run_wall_time_us":2264,"raft.queue_time_us":897,"raft.run_cpu_time_us":1764,"raft.run_wall_time_us":1942,"replication_time_us":13615,"spinlock_wait_cycles":2812032}]]}
W20260928 01:56:40.176432 19103 connection.cc:466] server connection from 127.18.161.2:55041 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.18.161.2:55041 (request call id 144) could send its response
W20260928 01:56:40.213471 19102 connection.cc:573] client connection to 127.18.161.3:44521 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:56:40.214794 19102 connection.cc:573] server connection from 127.18.161.3:60925 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 01:56:40.224466 19076 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu with pid 19085
I20260928 01:56:40.283620 19076 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu with pid 19155
I20260928 01:56:40.332628 19076 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu with pid 19881
2026-09-28T01:56:40Z chronyd exiting
I20260928 01:56:40.387008 19076 master-stress-test.cc:587] Tables created: 144
I20260928 01:56:40.387223 19076 master-stress-test.cc:588] Tables altered: 68
I20260928 01:56:40.387349 19076 master-stress-test.cc:589] Tables deleted: 48
I20260928 01:56:40.387465 19076 master-stress-test.cc:590] Tablets replaced: 24
I20260928 01:56:40.387583 19076 master-stress-test.cc:591] Masters restarted: 1
[       OK ] CatalogManagerConfigurations/MasterStressTest.Test/0 (97143 ms)
[ RUN      ] CatalogManagerConfigurations/MasterStressTest.Test/3
2026-09-28T01:56:40Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
Could not open connection to daemon
2026-09-28T01:56:40Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskfkv_xo/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskfkv_xo/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL:	 jdbc:derby:/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/metadb;create=true
Metastore Connection Driver :	 org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User:	 APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 

 
 
 
 

 
 
 
 


 
 
 

 
 
 


 
 
 
 
 
 
 


 
 
 

 
 
 

 
 

 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 


 
 
 
 
 
 



 
 
 
 
 


 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 


Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/security.properties
2026-09-28 01:56:49: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskfkv_xo/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskfkv_xo/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20260928 01:56:58.682333 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.62:36529
--webserver_interface=127.18.161.62
--webserver_port=0
--builtin_ntp_servers=127.18.161.20:36379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--hive_metastore_uris=thrift://127.0.0.1:35181
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260928 01:56:59.023862 23207 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:56:59.024572 23207 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:56:59.025050 23207 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 01:56:59.065034 23207 flags.cc:432] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260928 01:56:59.065297 23207 flags.cc:432] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260928 01:56:59.065593 23207 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 01:56:59.065837 23207 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:56:59.066087 23207 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 01:56:59.066335 23207 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 01:56:59.106379 23207 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:36379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35181
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.62:36529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.161.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:56:59.107791 23207 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:56:59.109768 23207 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 01:56:59.122416 23213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:56:59.124452 23214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:56:59.126227 23207 server_base.cc:1061] running on GCE node
W20260928 01:56:59.125384 23216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:00.258913 23207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:57:00.261910 23207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:57:00.263346 23207 hybrid_clock.cc:648] HybridClock initialized: now 1790560620263287 us; error 72 us; skew 500 ppm
I20260928 01:57:00.264575 23207 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:57:00.271482 23207 webserver.cc:533] Webserver started at http://127.18.161.62:40935/ using document root <none> and password file <none>
I20260928 01:57:00.272553 23207 fs_manager.cc:362] Metadata directory not provided
I20260928 01:57:00.272791 23207 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:57:00.273274 23207 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 01:57:00.277805 23207 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/data/instance:
uuid: "8048303ef62e4a52b5323fe35f42c7f1"
format_stamp: "Formatted at 2026-09-28 01:57:00 on dist-test-slave-lrdp"
I20260928 01:57:00.279179 23207 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/wal/instance:
uuid: "8048303ef62e4a52b5323fe35f42c7f1"
format_stamp: "Formatted at 2026-09-28 01:57:00 on dist-test-slave-lrdp"
I20260928 01:57:00.287442 23207 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.000s
I20260928 01:57:00.293573 23223 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:00.294896 23207 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260928 01:57:00.295248 23207 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/wal
uuid: "8048303ef62e4a52b5323fe35f42c7f1"
format_stamp: "Formatted at 2026-09-28 01:57:00 on dist-test-slave-lrdp"
I20260928 01:57:00.295640 23207 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:57:00.356273 23207 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:57:00.357889 23207 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:57:00.358384 23207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:57:00.431370 23207 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.62:36529
I20260928 01:57:00.431486 23274 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.62:36529 every 8 connection(s)
I20260928 01:57:00.434546 23207 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/data/info.pb
I20260928 01:57:00.439870 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 23207
I20260928 01:57:00.440303 19076 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-0/wal/instance
I20260928 01:57:00.440835 23275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:00.442878 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.61:43177
--webserver_interface=127.18.161.61
--webserver_port=0
--builtin_ntp_servers=127.18.161.20:36379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--hive_metastore_uris=thrift://127.0.0.1:35181
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 01:57:00.453022 23275 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } has no permanent_uuid. Determining permanent_uuid...
I20260928 01:57:00.483575 23275 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } has no permanent_uuid. Determining permanent_uuid...
W20260928 01:57:00.486574 23227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 01:57:00.491240 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43177: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:00.540818 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } attempt: 1
W20260928 01:57:00.546319 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43177: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:00.614799 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } attempt: 2
W20260928 01:57:00.620460 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43177: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:00.711999 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } attempt: 3
W20260928 01:57:00.717466 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43177: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 01:57:00.788566 23276 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:57:00.789222 23276 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:57:00.789683 23276 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 01:57:00.824677 23276 flags.cc:432] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260928 01:57:00.825040 23276 flags.cc:432] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260928 01:57:00.825315 23276 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 01:57:00.825560 23276 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:57:00.825814 23276 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 01:57:00.826061 23276 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 01:57:00.860967 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } attempt: 4
W20260928 01:57:00.866019 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43177: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:00.866611 23276 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:36379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35181
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.61:43177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.161.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:57:00.867998 23276 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:57:00.869800 23276 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 01:57:00.882157 23285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:01.165518 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } attempt: 5
W20260928 01:57:01.172744 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43177: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:01.720350 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } attempt: 6
W20260928 01:57:01.732285 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.61:43177: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 01:57:00.883186 23286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:57:00.886996 23288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:57:02.075613 23287 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1188 milliseconds
I20260928 01:57:02.075783 23276 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 01:57:02.077149 23276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:57:02.080514 23276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:57:02.082024 23276 hybrid_clock.cc:648] HybridClock initialized: now 1790560622081960 us; error 80 us; skew 500 ppm
I20260928 01:57:02.083087 23276 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:57:02.090317 23276 webserver.cc:533] Webserver started at http://127.18.161.61:37689/ using document root <none> and password file <none>
I20260928 01:57:02.091393 23276 fs_manager.cc:362] Metadata directory not provided
I20260928 01:57:02.091692 23276 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:57:02.092229 23276 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 01:57:02.096868 23276 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/data/instance:
uuid: "da14a75a1a5a4cf99b25bd57d7e16148"
format_stamp: "Formatted at 2026-09-28 01:57:02 on dist-test-slave-lrdp"
I20260928 01:57:02.098098 23276 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/wal/instance:
uuid: "da14a75a1a5a4cf99b25bd57d7e16148"
format_stamp: "Formatted at 2026-09-28 01:57:02 on dist-test-slave-lrdp"
I20260928 01:57:02.106632 23276 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.004s
I20260928 01:57:02.113891 23297 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:02.115294 23276 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260928 01:57:02.115715 23276 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/wal
uuid: "da14a75a1a5a4cf99b25bd57d7e16148"
format_stamp: "Formatted at 2026-09-28 01:57:02 on dist-test-slave-lrdp"
I20260928 01:57:02.116074 23276 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:57:02.173022 23276 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:57:02.174751 23276 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:57:02.175264 23276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:57:02.251658 23276 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.61:43177
I20260928 01:57:02.251765 23348 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.61:43177 every 8 connection(s)
I20260928 01:57:02.254624 23276 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/data/info.pb
I20260928 01:57:02.256351 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 23276
I20260928 01:57:02.256889 19076 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-1/wal/instance
I20260928 01:57:02.260481 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.60:34625
--webserver_interface=127.18.161.60
--webserver_port=0
--builtin_ntp_servers=127.18.161.20:36379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--hive_metastore_uris=thrift://127.0.0.1:35181
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 01:57:02.262830 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:02.275228 23349 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } has no permanent_uuid. Determining permanent_uuid...
I20260928 01:57:02.299793 23349 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } has no permanent_uuid. Determining permanent_uuid...
I20260928 01:57:02.315514 23349 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } has no permanent_uuid. Determining permanent_uuid...
W20260928 01:57:02.318192 23299 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
W20260928 01:57:02.322768 23349 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:02.372396 23349 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 1
W20260928 01:57:02.377068 23349 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:02.445603 23349 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 2
W20260928 01:57:02.450904 23349 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:02.542371 23349 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 3
W20260928 01:57:02.547147 23349 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
W20260928 01:57:02.595463 23350 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:57:02.596077 23350 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:57:02.596537 23350 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 01:57:02.631384 23350 flags.cc:432] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260928 01:57:02.631660 23350 flags.cc:432] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260928 01:57:02.631943 23350 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 01:57:02.632184 23350 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:57:02.632457 23350 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 01:57:02.632694 23350 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 01:57:02.671922 23350 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:36379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35181
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.60:34625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.161.60
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:57:02.673359 23350 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:57:02.675344 23350 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 01:57:02.688027 23360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:02.690570 23349 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 4
W20260928 01:57:02.695093 23349 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:02.792871 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } attempt: 7
I20260928 01:57:02.806140 23275 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } has no permanent_uuid. Determining permanent_uuid...
W20260928 01:57:02.812901 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:02.871363 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 1
W20260928 01:57:02.876238 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:02.957661 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 2
W20260928 01:57:02.962380 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:02.994598 23349 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 5
W20260928 01:57:02.999679 23349 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:03.047847 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 3
W20260928 01:57:03.052443 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:03.193253 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 4
W20260928 01:57:03.198094 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:03.481695 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 5
W20260928 01:57:03.487463 23275 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:03.547158 23349 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 6
W20260928 01:57:03.554368 23349 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.18.161.60:34625: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
W20260928 01:57:02.690040 23361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:57:03.829322 23362 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
W20260928 01:57:03.831049 23363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:03.831063 23350 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 01:57:03.833844 23350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:57:03.836812 23350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:57:03.838246 23350 hybrid_clock.cc:648] HybridClock initialized: now 1790560623838200 us; error 60 us; skew 500 ppm
I20260928 01:57:03.839071 23350 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:57:03.845764 23350 webserver.cc:533] Webserver started at http://127.18.161.60:40927/ using document root <none> and password file <none>
I20260928 01:57:03.846755 23350 fs_manager.cc:362] Metadata directory not provided
I20260928 01:57:03.846975 23350 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:57:03.847497 23350 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 01:57:03.853839 23350 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/instance:
uuid: "8432e2c39e50435788e612e49a0045ed"
format_stamp: "Formatted at 2026-09-28 01:57:03 on dist-test-slave-lrdp"
I20260928 01:57:03.855173 23350 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal/instance:
uuid: "8432e2c39e50435788e612e49a0045ed"
format_stamp: "Formatted at 2026-09-28 01:57:03 on dist-test-slave-lrdp"
I20260928 01:57:03.863751 23350 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.003s
I20260928 01:57:03.870183 23374 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:03.871467 23350 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260928 01:57:03.871886 23350 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
uuid: "8432e2c39e50435788e612e49a0045ed"
format_stamp: "Formatted at 2026-09-28 01:57:03 on dist-test-slave-lrdp"
I20260928 01:57:03.872253 23350 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:57:03.928335 23350 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:57:03.929932 23350 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:57:03.930399 23350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:57:04.004350 23350 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.60:34625
I20260928 01:57:04.004478 23425 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.60:34625 every 8 connection(s)
I20260928 01:57:04.007586 23350 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
I20260928 01:57:04.009716 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 23350
I20260928 01:57:04.010185 19076 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal/instance
I20260928 01:57:04.014426 23426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:04.030308 23426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } has no permanent_uuid. Determining permanent_uuid...
I20260928 01:57:04.040131 23275 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 6
I20260928 01:57:04.059856 23426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } has no permanent_uuid. Determining permanent_uuid...
I20260928 01:57:04.073262 23426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } has no permanent_uuid. Determining permanent_uuid...
I20260928 01:57:04.080799 23275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: Bootstrap starting.
I20260928 01:57:04.088646 23275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:04.090988 23275 log.cc:826] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: Log is configured to *not* fsync() on all Append() calls
I20260928 01:57:04.091950 23426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Bootstrap starting.
I20260928 01:57:04.096436 23275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: No bootstrap required, opened a new log
I20260928 01:57:04.099630 23426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:04.101526 23426 log.cc:826] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Log is configured to *not* fsync() on all Append() calls
I20260928 01:57:04.106554 23426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: No bootstrap required, opened a new log
I20260928 01:57:04.118737 23275 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:04.119402 23275 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:04.119663 23275 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8048303ef62e4a52b5323fe35f42c7f1, State: Initialized, Role: FOLLOWER
I20260928 01:57:04.120651 23275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:04.123170 23436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:04.125607 23275 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 01:57:04.125640 23436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:04.128103 23426 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:04.129009 23426 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:04.129328 23426 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8432e2c39e50435788e612e49a0045ed, State: Initialized, Role: FOLLOWER
I20260928 01:57:04.130339 23426 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:04.133167 23439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:04.134215 23439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:04.135630 23426 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: configured and running, proceeding with master startup.
W20260928 01:57:04.185850 23380 tablet.cc:2433] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 01:57:04.201880 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.202399 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.217049 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.217548 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.168583 23207 master_runner.cc:187] Error getting master registration for 127.18.161.61:43177: OK, instance_id { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" instance_seqno: 1790560622230932 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 01:57:04.223342 23207 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 01:57:04.232366 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.232931 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.247805 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.248315 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.263496 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.264035 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.277205 23469 catalog_manager.cc:818] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260928 01:57:04.279300 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.279671 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.294267 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.294610 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.306823 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.307372 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.309142 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.309577 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.321796 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.322167 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.300377 23350 master_runner.cc:187] Error getting master registration for 127.18.161.61:43177: OK, instance_id { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" instance_seqno: 1790560622230932 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 01:57:04.330359 23350 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 01:57:04.329357 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.330947 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.335353 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.335666 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.346197 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.346618 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.350651 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.350916 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.359920 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.360246 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.363962 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.364339 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.368404 23229 tablet.cc:2433] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 01:57:04.377843 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.378383 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.378985 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.379233 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.393364 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.393592 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.393885 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.394006 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.409116 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.409150 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.409513 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.409585 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.424549 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.424541 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.424935 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.425026 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.440874 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.441376 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.441921 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.442245 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.455902 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.456666 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.458590 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.458976 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.472584 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.473443 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.477286 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.477634 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.486994 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.487313 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.491153 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.491503 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.505100 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.505456 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.507316 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.507593 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.519987 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.524389 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.526371 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.526645 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.538954 23436 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:04.539592 23436 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
W20260928 01:57:04.541992 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.542332 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.543077 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.543433 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.544454 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed" is_pre_election: true
I20260928 01:57:04.544737 23436 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:04.545506 23401 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8048303ef62e4a52b5323fe35f42c7f1 in term 0.
I20260928 01:57:04.547288 23225 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1, 8432e2c39e50435788e612e49a0045ed; no voters: 
I20260928 01:57:04.548333 23436 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:57:04.548748 23436 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:57:04.549082 23436 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:57:04.565479 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.565822 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.568265 23436 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:04.572088 23436 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 1 election: Requested vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:04.577585 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed"
I20260928 01:57:04.578300 23401 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:57:04.580713 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.581180 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.585367 23401 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8048303ef62e4a52b5323fe35f42c7f1 in term 1.
I20260928 01:57:04.586918 23225 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1, 8432e2c39e50435788e612e49a0045ed; no voters: 
I20260928 01:57:04.587937 23436 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 01:57:04.596644 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.596992 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.591509 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.597620 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.596360 23436 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 1 LEADER]: Becoming Leader. State: Replica: 8048303ef62e4a52b5323fe35f42c7f1, State: Running, Role: LEADER
I20260928 01:57:04.598840 23436 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:04.605870 23472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8048303ef62e4a52b5323fe35f42c7f1. Latest consensus state: current_term: 1 leader_uuid: "8048303ef62e4a52b5323fe35f42c7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:04.607208 23472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: This master's current role is: LEADER
W20260928 01:57:04.615139 23457 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260928 01:57:04.614928 23349 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } attempt: 7
W20260928 01:57:04.623071 23457 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.624969 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.626055 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.626142 23474 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 01:57:04.634125 23474 catalog_manager.cc:1533] Initializing Kudu cluster ID...
W20260928 01:57:04.641180 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.641528 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.658288 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.658627 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.659415 23349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Bootstrap starting.
I20260928 01:57:04.667800 23349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:04.670549 23349 log.cc:826] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Log is configured to *not* fsync() on all Append() calls
W20260928 01:57:04.673318 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.673689 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.679320 23401 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 1 FOLLOWER]: Refusing update from remote peer 8048303ef62e4a52b5323fe35f42c7f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 01:57:04.682035 23436 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:57:04.683905 23349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: No bootstrap required, opened a new log
W20260928 01:57:04.688987 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.689357 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.720112 23349 raft_consensus.cc:359] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:04.721087 23349 raft_consensus.cc:385] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:04.721444 23349 raft_consensus.cc:740] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da14a75a1a5a4cf99b25bd57d7e16148, State: Initialized, Role: FOLLOWER
I20260928 01:57:04.722504 23349 consensus_queue.cc:260] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:04.741567 23480 sys_catalog.cc:455] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:04.742480 23480 sys_catalog.cc:458] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:04.743530 23349 sys_catalog.cc:565] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 01:57:04.744117 23322 raft_consensus.cc:3060] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:04.752641 23323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148"
I20260928 01:57:04.756284 23324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:04.763372 23322 raft_consensus.cc:1275] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 1 FOLLOWER]: Refusing update from remote peer 8048303ef62e4a52b5323fe35f42c7f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 01:57:04.767762 23436 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:57:04.803268 23479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8048303ef62e4a52b5323fe35f42c7f1. Latest consensus state: current_term: 1 leader_uuid: "8048303ef62e4a52b5323fe35f42c7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:04.808519 23479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: FOLLOWER
W20260928 01:57:04.812922 23469 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 01:57:04.815711 23469 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.832459 23480 sys_catalog.cc:455] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8048303ef62e4a52b5323fe35f42c7f1. Latest consensus state: current_term: 1 leader_uuid: "8048303ef62e4a52b5323fe35f42c7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:04.833882 23480 sys_catalog.cc:458] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:04.838817 23436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8048303ef62e4a52b5323fe35f42c7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:04.840051 23436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: This master's current role is: LEADER
I20260928 01:57:04.840852 23436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8048303ef62e4a52b5323fe35f42c7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:04.841575 23436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: This master's current role is: LEADER
I20260928 01:57:04.841641 23479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8048303ef62e4a52b5323fe35f42c7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:04.842341 23479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:04.845614 23474 catalog_manager.cc:1396] Generated new cluster ID: 277aae6cb6dd46069169192caa8b9479
I20260928 01:57:04.845973 23474 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:57:04.855877 23469 catalog_manager.cc:1308] Loaded cluster ID: 277aae6cb6dd46069169192caa8b9479
I20260928 01:57:04.856415 23469 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: success
W20260928 01:57:04.861045 23469 catalog_manager.cc:1625] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260928 01:57:04.861548 23469 catalog_manager.cc:896] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
W20260928 01:57:04.876641 23469 catalog_manager.cc:1625] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260928 01:57:04.877120 23469 catalog_manager.cc:896] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.880553 23480 sys_catalog.cc:455] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8048303ef62e4a52b5323fe35f42c7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:04.881394 23480 sys_catalog.cc:458] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 01:57:04.899247 23469 catalog_manager.cc:1625] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260928 01:57:04.903301 23469 catalog_manager.cc:896] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.917258 23474 catalog_manager.cc:1419] Generated new certificate authority record
I20260928 01:57:04.919575 23474 catalog_manager.cc:1553] Loading token signing keys...
I20260928 01:57:04.922305 23469 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: acquiring CA information for follower catalog manager: success
W20260928 01:57:04.949344 23469 catalog_manager.cc:896] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260928 01:57:04.963994 23504 catalog_manager.cc:818] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 01:57:04.978199 23474 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: Generated new TSK 0
I20260928 01:57:04.979493 23474 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 01:57:04.985533 23474 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260928 01:57:04.991477 23474 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: -1
W20260928 01:57:04.996248 23469 catalog_manager.cc:896] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260928 01:57:05.013415 23469 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 01:57:05.015231 23504 catalog_manager.cc:1308] Loaded cluster ID: 277aae6cb6dd46069169192caa8b9479
I20260928 01:57:05.015537 23504 catalog_manager.cc:1601] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: loading cluster ID for follower catalog manager: success
I20260928 01:57:05.023650 23504 catalog_manager.cc:1623] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: acquiring CA information for follower catalog manager: success
I20260928 01:57:05.043818 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.161.1:0
--local_ip_for_outbound_sockets=127.18.161.1
--webserver_interface=127.18.161.1
--webserver_port=0
--tserver_master_addrs=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--builtin_ntp_servers=127.18.161.20:36379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 01:57:05.057228 23504 catalog_manager.cc:1651] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 01:57:05.499647 23507 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8048303ef62e4a52b5323fe35f42c7f1)
I20260928 01:57:05.500245 23507 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:05.501173 23508 raft_consensus.cc:493] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8048303ef62e4a52b5323fe35f42c7f1)
I20260928 01:57:05.504106 23250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1" is_pre_election: true
I20260928 01:57:05.507112 23507 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
I20260928 01:57:05.507733 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:05.510848 23378 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:05.511782 23507 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 01:57:05.512599 23508 raft_consensus.cc:515] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:05.522943 23250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1" is_pre_election: true
I20260928 01:57:05.529492 23400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed" is_pre_election: true
I20260928 01:57:05.530293 23400 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da14a75a1a5a4cf99b25bd57d7e16148 in term 1.
I20260928 01:57:05.532830 23299 leader_election.cc:304] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed, da14a75a1a5a4cf99b25bd57d7e16148; no voters: 8048303ef62e4a52b5323fe35f42c7f1
I20260928 01:57:05.538542 23508 leader_election.cc:290] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:05.540997 23509 raft_consensus.cc:2804] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:57:05.543185 23509 raft_consensus.cc:493] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8048303ef62e4a52b5323fe35f42c7f1)
I20260928 01:57:05.543938 23509 raft_consensus.cc:3060] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:57:05.559926 23509 raft_consensus.cc:515] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:05.563958 23509 leader_election.cc:290] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 2 election: Requested vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:05.564150 23250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1"
I20260928 01:57:05.567250 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed"
I20260928 01:57:05.570467 23300 leader_election.cc:304] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da14a75a1a5a4cf99b25bd57d7e16148; no voters: 8048303ef62e4a52b5323fe35f42c7f1, 8432e2c39e50435788e612e49a0045ed
I20260928 01:57:05.571421 23509 raft_consensus.cc:2749] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 01:57:05.919834 23322 raft_consensus.cc:1240] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 2 FOLLOWER]: Rejecting Update request from peer 8048303ef62e4a52b5323fe35f42c7f1 for earlier term 1. Current term is 2. Ops: []
I20260928 01:57:05.922766 23436 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260928 01:57:05.943037 23514 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 01:57:05.943583 23514 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8048303ef62e4a52b5323fe35f42c7f1, State: Running, Role: LEADER
I20260928 01:57:05.945557 23514 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:05.950930 23514 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 1 FOLLOWER]: Advancing to term 2
W20260928 01:57:05.959307 23506 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:57:05.961334 23506 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260928 01:57:05.973189 23457 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260928 01:57:05.974552 23506 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 01:57:06.057000 23506 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:57:06.058776 23506 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.161.1
I20260928 01:57:06.089903 23515 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8048303ef62e4a52b5323fe35f42c7f1)
I20260928 01:57:06.090692 23515 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:06.094799 23250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1" is_pre_election: true
I20260928 01:57:06.095498 23250 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8432e2c39e50435788e612e49a0045ed in term 2.
I20260928 01:57:06.098330 23377 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1, 8432e2c39e50435788e612e49a0045ed; no voters: 
I20260928 01:57:06.105229 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:06.106052 23322 raft_consensus.cc:2393] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8432e2c39e50435788e612e49a0045ed in current term 2: Already voted for candidate da14a75a1a5a4cf99b25bd57d7e16148 in this term.
I20260928 01:57:06.106771 23516 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 01:57:06.107137 23516 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8048303ef62e4a52b5323fe35f42c7f1)
I20260928 01:57:06.107465 23516 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 1 FOLLOWER]: Advancing to term 2
I20260928 01:57:06.109697 23515 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
I20260928 01:57:06.129820 23516 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:06.137552 23250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1"
I20260928 01:57:06.139029 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148"
I20260928 01:57:06.139828 23322 raft_consensus.cc:2393] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8432e2c39e50435788e612e49a0045ed in current term 2: Already voted for candidate da14a75a1a5a4cf99b25bd57d7e16148 in this term.
I20260928 01:57:06.141387 23516 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 2 election: Requested vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
I20260928 01:57:06.146237 23250 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8432e2c39e50435788e612e49a0045ed in term 2.
I20260928 01:57:06.147706 23377 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1, 8432e2c39e50435788e612e49a0045ed; no voters: da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:06.148927 23516 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 2 FOLLOWER]: Leader election won for term 2
I20260928 01:57:06.149700 23516 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 2 LEADER]: Becoming Leader. State: Replica: 8432e2c39e50435788e612e49a0045ed, State: Running, Role: LEADER
I20260928 01:57:06.150748 23516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:06.166205 23515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8432e2c39e50435788e612e49a0045ed. Latest consensus state: current_term: 2 leader_uuid: "8432e2c39e50435788e612e49a0045ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:06.166963 23515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: LEADER
I20260928 01:57:06.164500 23506 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:36379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.161.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.161.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.161.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:57:06.179157 23506 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:57:06.184544 23506 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260928 01:57:06.188563 23518 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 01:57:06.210104 23518 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 01:57:06.222517 23518 catalog_manager.cc:1308] Loaded cluster ID: 277aae6cb6dd46069169192caa8b9479
I20260928 01:57:06.223754 23518 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:57:06.240113 23518 catalog_manager.cc:1553] Loading token signing keys...
W20260928 01:57:06.243813 23520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:06.273725 23518 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Loaded TSK: 0
I20260928 01:57:06.294899 23518 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 01:57:06.306800 23525 raft_consensus.cc:493] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:06.307544 23525 raft_consensus.cc:515] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:06.310712 23250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1" is_pre_election: true
I20260928 01:57:06.311412 23250 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da14a75a1a5a4cf99b25bd57d7e16148 in term 2.
I20260928 01:57:06.313887 23300 leader_election.cc:304] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148; no voters: 
I20260928 01:57:06.327747 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed" is_pre_election: true
I20260928 01:57:06.329311 23525 leader_election.cc:290] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:06.330478 23525 raft_consensus.cc:2804] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 01:57:06.331197 23518 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260928 01:57:06.331683 23525 raft_consensus.cc:493] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:57:06.335201 23525 raft_consensus.cc:3060] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:57:06.349040 23518 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: -1
I20260928 01:57:06.360592 23525 raft_consensus.cc:515] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:06.364887 23250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1"
I20260928 01:57:06.365499 23250 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:57:06.374349 23250 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da14a75a1a5a4cf99b25bd57d7e16148 in term 3.
I20260928 01:57:06.377126 23300 leader_election.cc:304] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148; no voters: 
I20260928 01:57:06.379881 23527 raft_consensus.cc:2804] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 01:57:06.384680 23527 raft_consensus.cc:697] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 3 LEADER]: Becoming Leader. State: Replica: da14a75a1a5a4cf99b25bd57d7e16148, State: Running, Role: LEADER
I20260928 01:57:06.385967 23527 consensus_queue.cc:237] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:06.391872 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed"
I20260928 01:57:06.395752 23525 leader_election.cc:290] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 3 election: Requested vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:06.406947 23528 sys_catalog.cc:455] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da14a75a1a5a4cf99b25bd57d7e16148. Latest consensus state: current_term: 3 leader_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:06.407835 23528 sys_catalog.cc:458] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: This master's current role is: LEADER
I20260928 01:57:06.424582 23530 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 01:57:06.433969 23530 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 01:57:06.438736 23530 catalog_manager.cc:1308] Loaded cluster ID: 277aae6cb6dd46069169192caa8b9479
I20260928 01:57:06.439145 23530 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:57:06.445575 23530 catalog_manager.cc:1553] Loading token signing keys...
I20260928 01:57:06.450660 23530 catalog_manager.cc:6230] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Loaded TSK: 0
I20260928 01:57:06.452387 23530 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 01:57:06.460865 23530 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260928 01:57:06.468901 23530 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: -1
I20260928 01:57:06.737213 23322 raft_consensus.cc:1240] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 3 LEADER]: Rejecting Update request from peer 8432e2c39e50435788e612e49a0045ed for earlier term 2. Current term is 3. Ops: []
I20260928 01:57:06.740044 23531 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260928 01:57:06.752393 23531 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [LEADER]: Peer da14a75a1a5a4cf99b25bd57d7e16148 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260928 01:57:06.754856 23532 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 2 LEADER]: Stepping down as leader of term 2
I20260928 01:57:06.755393 23532 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8432e2c39e50435788e612e49a0045ed, State: Running, Role: LEADER
I20260928 01:57:06.755599 23250 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Rejecting Update request from peer 8432e2c39e50435788e612e49a0045ed for earlier term 2. Current term is 3. Ops: []
I20260928 01:57:06.756387 23532 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:06.757625 23532 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 2 FOLLOWER]: Advancing to term 3
I20260928 01:57:06.867681 23250 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Refusing update from remote peer da14a75a1a5a4cf99b25bd57d7e16148: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260928 01:57:06.869729 23528 consensus_queue.cc:1048] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260928 01:57:06.907490 23534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da14a75a1a5a4cf99b25bd57d7e16148. Latest consensus state: current_term: 3 leader_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:06.908552 23534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:06.948287 23534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:06.949884 23534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:06.958041 23401 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Refusing update from remote peer da14a75a1a5a4cf99b25bd57d7e16148: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260928 01:57:06.958470 23401 pending_rounds.cc:85] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Aborting all ops after (but not including) 4
I20260928 01:57:06.958750 23401 pending_rounds.cc:107] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260928 01:57:06.959025 23401 raft_consensus.cc:2889] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 01:57:06.965096 23528 consensus_queue.cc:1048] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260928 01:57:06.973248 23536 sys_catalog.cc:455] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:06.980187 23536 sys_catalog.cc:458] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: This master's current role is: LEADER
I20260928 01:57:07.003971 23533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader da14a75a1a5a4cf99b25bd57d7e16148. Latest consensus state: current_term: 3 leader_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:07.004834 23533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:07.005417 23533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:07.006086 23533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:07.495877 23532 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:07.496457 23532 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:07.498615 23532 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
I20260928 01:57:07.501664 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:07.505707 23250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1" is_pre_election: true
I20260928 01:57:07.509572 23377 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:07.512306 23532 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:57:07.634020 23536 sys_catalog.cc:455] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:07.635946 23536 sys_catalog.cc:458] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: This master's current role is: LEADER
W20260928 01:57:06.272987 23521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:06.295236 23506 server_base.cc:1061] running on GCE node
W20260928 01:57:06.292845 23524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:08.228091 23506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:57:08.231726 23506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:57:08.233246 23506 hybrid_clock.cc:648] HybridClock initialized: now 1790560628233159 us; error 91 us; skew 500 ppm
I20260928 01:57:08.234376 23506 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:57:08.244181 23506 webserver.cc:533] Webserver started at http://127.18.161.1:41351/ using document root <none> and password file <none>
I20260928 01:57:08.245394 23506 fs_manager.cc:362] Metadata directory not provided
I20260928 01:57:08.245754 23506 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:57:08.246364 23506 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 01:57:08.251860 23506 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/data/instance:
uuid: "9a3818d183894d038ea5871a360af375"
format_stamp: "Formatted at 2026-09-28 01:57:08 on dist-test-slave-lrdp"
I20260928 01:57:08.253304 23506 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/instance:
uuid: "9a3818d183894d038ea5871a360af375"
format_stamp: "Formatted at 2026-09-28 01:57:08 on dist-test-slave-lrdp"
I20260928 01:57:08.262485 23506 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.004s
I20260928 01:57:08.270200 23549 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:08.272044 23506 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.003s
I20260928 01:57:08.272480 23506 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal
uuid: "9a3818d183894d038ea5871a360af375"
format_stamp: "Formatted at 2026-09-28 01:57:08 on dist-test-slave-lrdp"
I20260928 01:57:08.272850 23506 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:57:08.334424 23506 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:57:08.336349 23506 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:57:08.336848 23506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:57:08.340519 23506 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260928 01:57:08.345364 23506 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 01:57:08.345871 23506 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260928 01:57:08.346228 23506 ts_tablet_manager.cc:616] Registered 0 tablets
I20260928 01:57:08.346413 23506 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:08.355779 23557 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:08.356251 23557 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:08.358682 23557 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:08.358861 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:08.359869 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed" is_pre_election: true
I20260928 01:57:08.361759 23225 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1; no voters: 8432e2c39e50435788e612e49a0045ed, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:08.362752 23557 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:57:08.508167 23506 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.1:38427
I20260928 01:57:08.508311 23662 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.1:38427 every 8 connection(s)
I20260928 01:57:08.510877 23506 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/data/info.pb
I20260928 01:57:08.513118 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 23506
I20260928 01:57:08.513710 19076 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/instance
I20260928 01:57:08.535300 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.161.2:0
--local_ip_for_outbound_sockets=127.18.161.2
--webserver_interface=127.18.161.2
--webserver_port=0
--tserver_master_addrs=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--builtin_ntp_servers=127.18.161.20:36379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 01:57:08.554245 23673 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:08.557278 23673 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:08.564985 23250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1" is_pre_election: true
I20260928 01:57:08.568763 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:08.571727 23378 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:08.578233 23673 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
I20260928 01:57:08.580823 23673 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:57:08.587671 23665 heartbeater.cc:344] Connected to a master server at 127.18.161.62:36529
I20260928 01:57:08.588475 23665 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:08.590132 23665 heartbeater.cc:507] Master 127.18.161.62:36529 requested a full tablet report, sending...
I20260928 01:57:08.587730 23664 heartbeater.cc:344] Connected to a master server at 127.18.161.61:43177
I20260928 01:57:08.592149 23664 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:08.593287 23664 heartbeater.cc:507] Master 127.18.161.61:43177 requested a full tablet report, sending...
I20260928 01:57:08.595916 23663 heartbeater.cc:344] Connected to a master server at 127.18.161.60:34625
I20260928 01:57:08.596325 23663 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:08.596279 23240 ts_manager.cc:194] Registered new tserver with Master: 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
I20260928 01:57:08.597052 23314 ts_manager.cc:194] Registered new tserver with Master: 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
I20260928 01:57:08.597262 23663 heartbeater.cc:507] Master 127.18.161.60:34625 requested a full tablet report, sending...
I20260928 01:57:08.599758 23314 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.18.161.1:51639
I20260928 01:57:08.600864 23391 ts_manager.cc:194] Registered new tserver with Master: 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:57:08.904285 23670 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:57:08.904842 23670 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:57:08.905651 23670 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 01:57:08.944809 23670 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:57:08.945986 23670 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.161.2
I20260928 01:57:08.988432 23670 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:36379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.161.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.161.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.161.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:57:08.989982 23670 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:57:08.991889 23670 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 01:57:09.024469 23683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:09.103816 23664 heartbeater.cc:499] Master 127.18.161.61:43177 was elected leader, sending a full tablet report...
I20260928 01:57:09.409332 23688 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:09.409965 23688 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:09.411831 23688 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:09.413003 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:09.413498 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed" is_pre_election: true
I20260928 01:57:09.415592 23225 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1; no voters: 8432e2c39e50435788e612e49a0045ed, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:09.416591 23688 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:57:09.519487 23689 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:09.520035 23689 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:09.522118 23689 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
I20260928 01:57:09.523547 23250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1" is_pre_election: true
I20260928 01:57:09.525278 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:09.527432 23378 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:09.529003 23689 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:57:09.973866 23690 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:09.974304 23690 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:09.976471 23690 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:09.977314 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:09.977802 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed" is_pre_election: true
I20260928 01:57:09.979234 23225 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1; no voters: 8432e2c39e50435788e612e49a0045ed, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:09.980034 23690 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260928 01:57:09.026019 23682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:57:09.026413 23685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:09.032822 23670 server_base.cc:1061] running on GCE node
I20260928 01:57:10.194265 23670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:57:10.196854 23670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:57:10.198524 23670 hybrid_clock.cc:648] HybridClock initialized: now 1790560630198461 us; error 62 us; skew 500 ppm
I20260928 01:57:10.199470 23670 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:57:10.207870 23670 webserver.cc:533] Webserver started at http://127.18.161.2:34795/ using document root <none> and password file <none>
I20260928 01:57:10.209115 23670 fs_manager.cc:362] Metadata directory not provided
I20260928 01:57:10.209358 23670 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:57:10.209890 23670 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 01:57:10.214871 23670 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/data/instance:
uuid: "491712372a4f491f9ba8539837899e55"
format_stamp: "Formatted at 2026-09-28 01:57:10 on dist-test-slave-lrdp"
I20260928 01:57:10.216308 23670 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/instance:
uuid: "491712372a4f491f9ba8539837899e55"
format_stamp: "Formatted at 2026-09-28 01:57:10 on dist-test-slave-lrdp"
I20260928 01:57:10.225273 23670 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260928 01:57:10.232702 23695 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:10.234022 23670 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260928 01:57:10.234443 23670 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal
uuid: "491712372a4f491f9ba8539837899e55"
format_stamp: "Formatted at 2026-09-28 01:57:10 on dist-test-slave-lrdp"
I20260928 01:57:10.234790 23670 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:57:10.288276 23670 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:57:10.290467 23670 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:57:10.291142 23670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:57:10.294360 23670 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260928 01:57:10.298864 23670 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 01:57:10.299115 23670 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:10.299353 23670 ts_tablet_manager.cc:616] Registered 0 tablets
I20260928 01:57:10.299490 23670 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:10.458140 23670 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.2:36985
I20260928 01:57:10.458340 23807 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.2:36985 every 8 connection(s)
I20260928 01:57:10.461695 23670 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/data/info.pb
I20260928 01:57:10.465070 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 23670
I20260928 01:57:10.465668 19076 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/instance
I20260928 01:57:10.486280 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.161.3:0
--local_ip_for_outbound_sockets=127.18.161.3
--webserver_interface=127.18.161.3
--webserver_port=0
--tserver_master_addrs=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--builtin_ntp_servers=127.18.161.20:36379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 01:57:10.521872 23808 heartbeater.cc:344] Connected to a master server at 127.18.161.60:34625
I20260928 01:57:10.522565 23808 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:10.524067 23808 heartbeater.cc:507] Master 127.18.161.60:34625 requested a full tablet report, sending...
I20260928 01:57:10.527848 23391 ts_manager.cc:194] Registered new tserver with Master: 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985)
I20260928 01:57:10.531177 23809 heartbeater.cc:344] Connected to a master server at 127.18.161.61:43177
I20260928 01:57:10.531673 23809 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:10.532877 23809 heartbeater.cc:507] Master 127.18.161.61:43177 requested a full tablet report, sending...
I20260928 01:57:10.535382 23314 ts_manager.cc:194] Registered new tserver with Master: 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985)
I20260928 01:57:10.536252 23810 heartbeater.cc:344] Connected to a master server at 127.18.161.62:36529
I20260928 01:57:10.536665 23810 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:10.537245 23314 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.18.161.2:32847
I20260928 01:57:10.537706 23810 heartbeater.cc:507] Master 127.18.161.62:36529 requested a full tablet report, sending...
I20260928 01:57:10.540771 23240 ts_manager.cc:194] Registered new tserver with Master: 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985)
W20260928 01:57:10.869086 23816 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:57:10.869604 23816 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:57:10.870332 23816 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 01:57:10.910146 23816 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:57:10.911108 23816 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.161.3
I20260928 01:57:10.955744 23816 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:36379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.161.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.161.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.161.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:57:10.957286 23816 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:57:10.959103 23816 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 01:57:10.975076 23826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:11.021097 23833 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:11.024394 23832 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:11.025384 23832 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:11.021838 23833 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:11.031023 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:11.031896 23833 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
I20260928 01:57:11.034034 23250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1" is_pre_election: true
I20260928 01:57:11.034814 23250 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8432e2c39e50435788e612e49a0045ed in term 3.
I20260928 01:57:11.038268 23377 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1, 8432e2c39e50435788e612e49a0045ed; no voters: 
I20260928 01:57:11.039414 23833 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 01:57:11.039752 23833 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Starting leader election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:11.040144 23833 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:57:11.041292 23809 heartbeater.cc:499] Master 127.18.161.61:43177 was elected leader, sending a full tablet report...
I20260928 01:57:11.043942 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:11.051147 23833 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:11.055328 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed" is_pre_election: true
I20260928 01:57:11.061164 23401 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8048303ef62e4a52b5323fe35f42c7f1 in current term 4: Already voted for candidate 8432e2c39e50435788e612e49a0045ed in this term.
I20260928 01:57:11.062902 23225 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1; no voters: 8432e2c39e50435788e612e49a0045ed, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:11.069401 23834 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:57:11.071285 23250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1"
I20260928 01:57:11.073257 23833 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 4 election: Requested vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
I20260928 01:57:11.073835 23832 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:11.074975 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148"
I20260928 01:57:11.083577 23834 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 01:57:11.094271 23250 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8432e2c39e50435788e612e49a0045ed in term 4.
I20260928 01:57:11.099263 23377 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1, 8432e2c39e50435788e612e49a0045ed; no voters: da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:11.100889 23833 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 4 FOLLOWER]: Leader election won for term 4
I20260928 01:57:11.102315 23249 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Rejecting Update request from peer da14a75a1a5a4cf99b25bd57d7e16148 for earlier term 3. Current term is 4. Ops: []
I20260928 01:57:11.105018 23833 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 4 LEADER]: Becoming Leader. State: Replica: 8432e2c39e50435788e612e49a0045ed, State: Running, Role: LEADER
I20260928 01:57:11.106204 23833 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:11.111577 23835 consensus_queue.cc:1059] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260928 01:57:11.113133 23835 raft_consensus.cc:3055] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 3 LEADER]: Stepping down as leader of term 3
I20260928 01:57:11.112986 23837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8432e2c39e50435788e612e49a0045ed. Latest consensus state: current_term: 4 leader_uuid: "8432e2c39e50435788e612e49a0045ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:11.113746 23837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: LEADER
I20260928 01:57:11.113655 23835 raft_consensus.cc:740] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da14a75a1a5a4cf99b25bd57d7e16148, State: Running, Role: LEADER
I20260928 01:57:11.114761 23835 consensus_queue.cc:260] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:11.116084 23401 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 4 LEADER]: Rejecting Update request from peer da14a75a1a5a4cf99b25bd57d7e16148 for earlier term 3. Current term is 4. Ops: []
I20260928 01:57:11.116158 23835 raft_consensus.cc:3060] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 3 FOLLOWER]: Advancing to term 4
I20260928 01:57:11.150801 23839 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 01:57:11.162496 23839 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 01:57:11.169610 23839 catalog_manager.cc:1308] Loaded cluster ID: 277aae6cb6dd46069169192caa8b9479
I20260928 01:57:11.169981 23839 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:57:11.209782 23839 catalog_manager.cc:1553] Loading token signing keys...
I20260928 01:57:11.214891 23839 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Loaded TSK: 0
I20260928 01:57:11.216109 23839 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 01:57:11.230932 23839 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260928 01:57:11.236029 23839 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: -1
I20260928 01:57:11.510151 23250 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Refusing update from remote peer 8432e2c39e50435788e612e49a0045ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260928 01:57:11.512761 23837 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260928 01:57:11.548681 23834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8432e2c39e50435788e612e49a0045ed. Latest consensus state: current_term: 4 leader_uuid: "8432e2c39e50435788e612e49a0045ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:11.549695 23834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:11.580878 23834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "8432e2c39e50435788e612e49a0045ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:11.581841 23834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:11.597208 23322 raft_consensus.cc:1275] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 4 FOLLOWER]: Refusing update from remote peer 8432e2c39e50435788e612e49a0045ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260928 01:57:11.599768 23837 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260928 01:57:11.603770 23833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "8432e2c39e50435788e612e49a0045ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:11.604565 23833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: LEADER
I20260928 01:57:11.661238 23846 sys_catalog.cc:455] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "8432e2c39e50435788e612e49a0045ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:11.662341 23846 sys_catalog.cc:458] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:11.655881 23835 sys_catalog.cc:455] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8432e2c39e50435788e612e49a0045ed. Latest consensus state: current_term: 4 leader_uuid: "8432e2c39e50435788e612e49a0045ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:11.664402 23835 sys_catalog.cc:458] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:12.041028 23808 heartbeater.cc:499] Master 127.18.161.60:34625 was elected leader, sending a full tablet report...
I20260928 01:57:12.070405 23834 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8432e2c39e50435788e612e49a0045ed)
I20260928 01:57:12.071192 23834 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:12.075776 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed" is_pre_election: true
I20260928 01:57:12.077236 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:12.078482 23834 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:12.082952 23227 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1; no voters: 8432e2c39e50435788e612e49a0045ed, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:12.085152 23834 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:57:12.115370 23835 raft_consensus.cc:493] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8432e2c39e50435788e612e49a0045ed)
I20260928 01:57:12.115973 23835 raft_consensus.cc:515] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:12.121655 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed" is_pre_election: true
I20260928 01:57:12.123292 23249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1" is_pre_election: true
I20260928 01:57:12.129176 23300 leader_election.cc:304] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da14a75a1a5a4cf99b25bd57d7e16148; no voters: 8048303ef62e4a52b5323fe35f42c7f1, 8432e2c39e50435788e612e49a0045ed
I20260928 01:57:12.129438 23663 heartbeater.cc:499] Master 127.18.161.60:34625 was elected leader, sending a full tablet report...
I20260928 01:57:12.130489 23846 raft_consensus.cc:2749] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:57:12.133692 23835 leader_election.cc:290] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:12.243469 23847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "8432e2c39e50435788e612e49a0045ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:12.251354 23847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: LEADER
I20260928 01:57:12.605935 23851 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8432e2c39e50435788e612e49a0045ed)
I20260928 01:57:12.608065 23851 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:12.615283 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:12.618860 23851 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:12.635732 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed" is_pre_election: true
I20260928 01:57:12.641180 23225 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1; no voters: 8432e2c39e50435788e612e49a0045ed, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:12.643682 23851 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260928 01:57:12.389576 23825 debug-util.cc:398] Leaking SignalData structure 0x7b0800037180 after lost signal to thread 23816
W20260928 01:57:12.647991 23816 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.673s	user 0.528s	sys 0.923s
W20260928 01:57:12.648474 23816 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.673s	user 0.528s	sys 0.923s
W20260928 01:57:10.975982 23827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:57:12.652787 23829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:57:12.656616 23828 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1674 milliseconds
I20260928 01:57:12.656688 23816 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 01:57:12.658178 23816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:57:12.660791 23816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:57:12.662258 23816 hybrid_clock.cc:648] HybridClock initialized: now 1790560632662180 us; error 81 us; skew 500 ppm
I20260928 01:57:12.663221 23816 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:57:12.671353 23816 webserver.cc:533] Webserver started at http://127.18.161.3:43067/ using document root <none> and password file <none>
I20260928 01:57:12.672647 23816 fs_manager.cc:362] Metadata directory not provided
I20260928 01:57:12.672942 23816 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:57:12.673564 23816 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 01:57:12.678406 23816 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/data/instance:
uuid: "a0a57cbfb1f2438db0c398cf2786b327"
format_stamp: "Formatted at 2026-09-28 01:57:12 on dist-test-slave-lrdp"
I20260928 01:57:12.679821 23816 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal/instance:
uuid: "a0a57cbfb1f2438db0c398cf2786b327"
format_stamp: "Formatted at 2026-09-28 01:57:12 on dist-test-slave-lrdp"
I20260928 01:57:12.689237 23816 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.000s
I20260928 01:57:12.695956 23856 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:12.697429 23816 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260928 01:57:12.697953 23816 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal
uuid: "a0a57cbfb1f2438db0c398cf2786b327"
format_stamp: "Formatted at 2026-09-28 01:57:12 on dist-test-slave-lrdp"
I20260928 01:57:12.698365 23816 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:57:12.730580 23857 raft_consensus.cc:493] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8432e2c39e50435788e612e49a0045ed)
I20260928 01:57:12.731099 23857 raft_consensus.cc:515] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:12.733090 23857 leader_election.cc:290] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:12.734184 23249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1" is_pre_election: true
I20260928 01:57:12.734347 23401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed" is_pre_election: true
I20260928 01:57:12.736054 23299 leader_election.cc:304] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da14a75a1a5a4cf99b25bd57d7e16148; no voters: 8048303ef62e4a52b5323fe35f42c7f1, 8432e2c39e50435788e612e49a0045ed
I20260928 01:57:12.737017 23857 raft_consensus.cc:2749] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:57:12.776484 23816 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:57:12.778744 23816 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:57:12.779505 23816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:57:12.783036 23816 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260928 01:57:12.789034 23816 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 01:57:12.789376 23816 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:12.789686 23816 ts_tablet_manager.cc:616] Registered 0 tablets
I20260928 01:57:12.789827 23816 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:12.945026 23816 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.3:32993
I20260928 01:57:12.945206 23969 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.3:32993 every 8 connection(s)
I20260928 01:57:12.948370 23816 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/data/info.pb
I20260928 01:57:12.957079 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 23816
I20260928 01:57:12.957650 19076 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal/instance
I20260928 01:57:13.011698 23971 heartbeater.cc:344] Connected to a master server at 127.18.161.61:43177
I20260928 01:57:13.012305 23971 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:13.013896 23971 heartbeater.cc:507] Master 127.18.161.61:43177 requested a full tablet report, sending...
I20260928 01:57:13.016933 23972 heartbeater.cc:344] Connected to a master server at 127.18.161.62:36529
I20260928 01:57:13.017344 23972 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:13.017970 23314 ts_manager.cc:194] Registered new tserver with Master: a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:13.018379 23972 heartbeater.cc:507] Master 127.18.161.62:36529 requested a full tablet report, sending...
I20260928 01:57:13.019737 23970 heartbeater.cc:344] Connected to a master server at 127.18.161.60:34625
I20260928 01:57:13.020164 23970 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:13.021165 23970 heartbeater.cc:507] Master 127.18.161.60:34625 requested a full tablet report, sending...
I20260928 01:57:13.021440 23240 ts_manager.cc:194] Registered new tserver with Master: a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:13.024101 23391 ts_manager.cc:194] Registered new tserver with Master: a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:13.027318 23391 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.18.161.3:50161
I20260928 01:57:13.047938 19076 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260928 01:57:13.106681 23391 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43982:
name: "default.Table_65cea13c8a8b405bb606a477b84c212e"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:57:13.106992 23390 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43982:
name: "default.Table_58bb4859bd884293a75a2560c92d8dda"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:57:13.112933 23389 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43982:
name: "default.Table_262ead9bd95a4b4cbbd3d3a7638fad4a"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:57:13.118465 23388 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43982:
name: "default.Table_d087778a98124fd9b1370342150d18a5"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:57:13.120570 23391 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_65cea13c8a8b405bb606a477b84c212e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:57:13.127707 23389 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_262ead9bd95a4b4cbbd3d3a7638fad4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:57:13.128533 23390 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_58bb4859bd884293a75a2560c92d8dda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:57:13.161689 19076 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu with pid 23350
W20260928 01:57:13.194676 23981 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.18.161.60:34625)
I20260928 01:57:13.223696 24004 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8432e2c39e50435788e612e49a0045ed)
I20260928 01:57:13.225545 24004 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:13.231926 23322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" is_pre_election: true
I20260928 01:57:13.239718 24004 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
W20260928 01:57:13.240724 23225 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111) [suppressed 12 similar messages]
W20260928 01:57:13.254259 23225 leader_election.cc:336] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625): Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:13.255026 23225 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1; no voters: 8432e2c39e50435788e612e49a0045ed, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:13.255970 24004 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 01:57:13.297101 24008 raft_consensus.cc:493] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8432e2c39e50435788e612e49a0045ed)
I20260928 01:57:13.297693 24008 raft_consensus.cc:515] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:13.300045 24008 leader_election.cc:290] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:13.301095 23249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1" is_pre_election: true
I20260928 01:57:13.301750 23249 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da14a75a1a5a4cf99b25bd57d7e16148 in term 4.
I20260928 01:57:13.303383 23300 leader_election.cc:304] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148; no voters: 
I20260928 01:57:13.304567 24008 raft_consensus.cc:2804] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260928 01:57:13.304983 24008 raft_consensus.cc:493] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8432e2c39e50435788e612e49a0045ed)
I20260928 01:57:13.306143 24008 raft_consensus.cc:3060] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 4 FOLLOWER]: Advancing to term 5
W20260928 01:57:13.318428 23299 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111) [suppressed 6 similar messages]
I20260928 01:57:13.324783 24008 raft_consensus.cc:515] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:13.328871 23249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1"
I20260928 01:57:13.329542 23249 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 4 FOLLOWER]: Advancing to term 5
W20260928 01:57:13.338794 23299 leader_election.cc:336] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625): Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:13.340591 23249 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da14a75a1a5a4cf99b25bd57d7e16148 in term 5.
I20260928 01:57:13.342639 24008 leader_election.cc:290] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 5 election: Requested vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:13.343176 23300 leader_election.cc:304] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148; no voters: 
I20260928 01:57:13.344120 24008 raft_consensus.cc:2804] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 5 FOLLOWER]: Leader election won for term 5
W20260928 01:57:13.346946 23299 leader_election.cc:336] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625): Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:13.350468 24008 raft_consensus.cc:697] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [term 5 LEADER]: Becoming Leader. State: Replica: da14a75a1a5a4cf99b25bd57d7e16148, State: Running, Role: LEADER
I20260928 01:57:13.352789 24008 consensus_queue.cc:237] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:13.384603 24011 sys_catalog.cc:455] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da14a75a1a5a4cf99b25bd57d7e16148. Latest consensus state: current_term: 5 leader_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:13.385440 24011 sys_catalog.cc:458] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: This master's current role is: LEADER
I20260928 01:57:13.392622 24013 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 01:57:13.402134 24013 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 01:57:13.406586 24013 catalog_manager.cc:1308] Loaded cluster ID: 277aae6cb6dd46069169192caa8b9479
I20260928 01:57:13.407015 24013 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:57:13.414009 24013 catalog_manager.cc:1553] Loading token signing keys...
I20260928 01:57:13.418681 24013 catalog_manager.cc:6230] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Loaded TSK: 0
I20260928 01:57:13.420754 24013 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 01:57:13.425103 24013 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260928 01:57:13.430596 24013 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: -1
I20260928 01:57:13.468799 23314 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60578:
name: "default.Table_d087778a98124fd9b1370342150d18a5"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:57:13.470610 23311 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60578:
name: "default.Table_65cea13c8a8b405bb606a477b84c212e"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:57:13.471762 23312 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60578:
name: "default.Table_58bb4859bd884293a75a2560c92d8dda"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:57:13.533540 23970 heartbeater.cc:499] Master 127.18.161.60:34625 was elected leader, sending a full tablet report...
W20260928 01:57:13.535331 23314 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d087778a98124fd9b1370342150d18a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:57:13.540501 23311 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_65cea13c8a8b405bb606a477b84c212e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:57:13.466990 23313 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60578:
name: "default.Table_262ead9bd95a4b4cbbd3d3a7638fad4a"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:57:13.543016 23312 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_58bb4859bd884293a75a2560c92d8dda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 01:57:13.556982 23970 heartbeater.cc:646] Failed to heartbeat to 127.18.161.60:34625 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
W20260928 01:57:13.578786 23808 heartbeater.cc:646] Failed to heartbeat to 127.18.161.60:34625 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
W20260928 01:57:13.667286 23663 heartbeater.cc:646] Failed to heartbeat to 127.18.161.60:34625 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
I20260928 01:57:13.887725 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.60:34625
--webserver_interface=127.18.161.60
--webserver_port=40927
--builtin_ntp_servers=127.18.161.20:36379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--hive_metastore_uris=thrift://127.0.0.1:35181
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 01:57:13.897236 23249 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Refusing update from remote peer da14a75a1a5a4cf99b25bd57d7e16148: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260928 01:57:13.904772 24017 consensus_queue.cc:1048] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260928 01:57:13.918026 24020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da14a75a1a5a4cf99b25bd57d7e16148. Latest consensus state: current_term: 5 leader_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:13.918767 24020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:13.927866 23314 catalog_manager.cc:2213] created HMS catalog entry for table  [id=78e56f2b2bf04dc1bccffafe7dedacf4]
I20260928 01:57:13.928181 24017 sys_catalog.cc:455] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:13.929950 24017 sys_catalog.cc:458] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 [sys.catalog]: This master's current role is: LEADER
W20260928 01:57:13.953872 23299 consensus_peers.cc:597] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148 -> Peer 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625): Couldn't send request to peer 8432e2c39e50435788e612e49a0045ed. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 01:57:13.954412 24020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:13.955008 24020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:14.000706 23314 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60578:
table { table_name: "default.Table_d087778a98124fd9b1370342150d18a5" } new_table_name: "default.Table_97908585a82d4a63a22cf8bcb884724e" modify_external_catalogs: true
I20260928 01:57:14.012269 23312 catalog_manager.cc:2213] created HMS catalog entry for table  [id=743b81f3482b4ad5bc001e9e5d87edac]
I20260928 01:57:14.031193 23971 heartbeater.cc:499] Master 127.18.161.61:43177 was elected leader, sending a full tablet report...
I20260928 01:57:14.076526 23312 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60578:
table { table_name: "default.Table_58bb4859bd884293a75a2560c92d8dda" } new_table_name: "default.Table_0e18caa3dbdd41b38d8484c2a81273b2" modify_external_catalogs: true
I20260928 01:57:14.112820 23809 heartbeater.cc:499] Master 127.18.161.61:43177 was elected leader, sending a full tablet report...
I20260928 01:57:14.116128 23905 tablet_service.cc:1511] Processing CreateTablet for tablet f38a8ee8788c43b6846b3b302760e211 (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.116922 23743 tablet_service.cc:1511] Processing CreateTablet for tablet f38a8ee8788c43b6846b3b302760e211 (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.118911 23743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38a8ee8788c43b6846b3b302760e211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.118894 23905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38a8ee8788c43b6846b3b302760e211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.126052 23742 tablet_service.cc:1511] Processing CreateTablet for tablet 2279818f3e62489297a96b2b905b7e1e (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.127372 23742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2279818f3e62489297a96b2b905b7e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.127485 23904 tablet_service.cc:1511] Processing CreateTablet for tablet 2279818f3e62489297a96b2b905b7e1e (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.128728 23904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2279818f3e62489297a96b2b905b7e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.141285 23597 tablet_service.cc:1511] Processing CreateTablet for tablet 2279818f3e62489297a96b2b905b7e1e (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.143311 23597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2279818f3e62489297a96b2b905b7e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.139397 23598 tablet_service.cc:1511] Processing CreateTablet for tablet f38a8ee8788c43b6846b3b302760e211 (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.149235 23598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38a8ee8788c43b6846b3b302760e211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.182868 23664 heartbeater.cc:499] Master 127.18.161.61:43177 was elected leader, sending a full tablet report...
I20260928 01:57:14.199494 24038 tablet_bootstrap.cc:492] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327: Bootstrap starting.
I20260928 01:57:14.201546 23310 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60578:
name: "default.Table_70d24315c2244ddbb12a5e14b6db18e7"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:57:14.214656 24038 tablet_bootstrap.cc:654] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.217371 24038 log.cc:826] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327: Log is configured to *not* fsync() on all Append() calls
I20260928 01:57:14.233757 24038 tablet_bootstrap.cc:492] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327: No bootstrap required, opened a new log
I20260928 01:57:14.235692 24038 ts_tablet_manager.cc:1403] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.000s
I20260928 01:57:14.235831 23309 master_service.cc:960] ReplaceTablet: received request to replace tablet 2279818f3e62489297a96b2b905b7e1e from {username='slave'} at 127.0.0.1:60578
I20260928 01:57:14.241621 24041 tablet_bootstrap.cc:492] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55: Bootstrap starting.
I20260928 01:57:14.242187 23308 master_service.cc:960] ReplaceTablet: received request to replace tablet 2279818f3e62489297a96b2b905b7e1e from {username='slave'} at 127.0.0.1:60578
I20260928 01:57:14.248474 24040 tablet_bootstrap.cc:492] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
I20260928 01:57:14.264508 23309 catalog_manager.cc:6133] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Sending DeleteTablet for 3 replicas of tablet 2279818f3e62489297a96b2b905b7e1e
I20260928 01:57:14.266505 23309 catalog_manager.cc:6934] ReplaceTablet: tablet 2279818f3e62489297a96b2b905b7e1e deleted and replaced by tablet 2bebc112f560444383696f2137072c1f
I20260928 01:57:14.269441 23904 tablet_service.cc:1558] Processing DeleteTablet for tablet 2279818f3e62489297a96b2b905b7e1e with delete_type TABLET_DATA_DELETED (replaced by tablet 2bebc112f560444383696f2137072c1f) from {username='slave'} at 127.0.0.1:44074
I20260928 01:57:14.274206 23598 tablet_service.cc:1558] Processing DeleteTablet for tablet 2279818f3e62489297a96b2b905b7e1e with delete_type TABLET_DATA_DELETED (replaced by tablet 2bebc112f560444383696f2137072c1f) from {username='slave'} at 127.0.0.1:44404
I20260928 01:57:14.276499 23743 tablet_service.cc:1558] Processing DeleteTablet for tablet 2279818f3e62489297a96b2b905b7e1e with delete_type TABLET_DATA_DELETED (replaced by tablet 2bebc112f560444383696f2137072c1f) from {username='slave'} at 127.0.0.1:34098
I20260928 01:57:14.277582 23309 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60578:
name: "default.Table_d62a30d9cd9a4fe79add980f59e96a10"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 01:57:14.286291 23301 catalog_manager.cc:5043] TS 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): delete failed for tablet 2279818f3e62489297a96b2b905b7e1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2279818f3e62489297a96b2b905b7e1e already in progress: creating tablet
I20260928 01:57:14.289641 24041 tablet_bootstrap.cc:654] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.303180 23905 tablet_service.cc:1511] Processing CreateTablet for tablet 2bebc112f560444383696f2137072c1f (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.303692 23596 tablet_service.cc:1511] Processing CreateTablet for tablet 2bebc112f560444383696f2137072c1f (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.304898 23905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bebc112f560444383696f2137072c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.305105 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bebc112f560444383696f2137072c1f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:57:14.308609 23300 catalog_manager.cc:5043] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): delete failed for tablet 2279818f3e62489297a96b2b905b7e1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2279818f3e62489297a96b2b905b7e1e already in progress: creating tablet
I20260928 01:57:14.312170 24038 raft_consensus.cc:359] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.315574 24038 raft_consensus.cc:385] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.315912 24038 raft_consensus.cc:740] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.317147 24038 consensus_queue.cc:260] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
W20260928 01:57:14.319140 23301 catalog_manager.cc:5043] TS 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): delete failed for tablet 2279818f3e62489297a96b2b905b7e1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2279818f3e62489297a96b2b905b7e1e already in progress: creating tablet
I20260928 01:57:14.327320 24040 tablet_bootstrap.cc:654] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.299464 23743 tablet_service.cc:1511] Processing CreateTablet for tablet 2bebc112f560444383696f2137072c1f (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.328457 23743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bebc112f560444383696f2137072c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.330178 24041 log.cc:826] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55: Log is configured to *not* fsync() on all Append() calls
I20260928 01:57:14.338683 24040 log.cc:826] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375: Log is configured to *not* fsync() on all Append() calls
I20260928 01:57:14.357275 24038 ts_tablet_manager.cc:1434] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327: Time spent starting tablet: real 0.121s	user 0.032s	sys 0.031s
I20260928 01:57:14.361351 24038 tablet_bootstrap.cc:492] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327: Bootstrap starting.
I20260928 01:57:14.367667 24038 tablet_bootstrap.cc:654] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.369098 24041 tablet_bootstrap.cc:492] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55: No bootstrap required, opened a new log
I20260928 01:57:14.369813 24041 ts_tablet_manager.cc:1403] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.003s
I20260928 01:57:14.373734 24040 tablet_bootstrap.cc:492] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:14.380816 24040 ts_tablet_manager.cc:1403] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.008s
I20260928 01:57:14.382792 23905 tablet_service.cc:1558] Processing DeleteTablet for tablet 2279818f3e62489297a96b2b905b7e1e with delete_type TABLET_DATA_DELETED (replaced by tablet 2bebc112f560444383696f2137072c1f) from {username='slave'} at 127.0.0.1:44074
I20260928 01:57:14.383916 24042 tablet_replica.cc:333] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327: stopping tablet replica
I20260928 01:57:14.385002 24042 raft_consensus.cc:2243] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:14.385694 24042 raft_consensus.cc:2272] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:14.391364 24042 ts_tablet_manager.cc:1916] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:14.409193 24038 tablet_bootstrap.cc:492] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327: No bootstrap required, opened a new log
I20260928 01:57:14.409723 24038 ts_tablet_manager.cc:1403] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.002s
I20260928 01:57:14.411389 24042 ts_tablet_manager.cc:1929] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:14.411871 24042 log.cc:1199] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/2279818f3e62489297a96b2b905b7e1e
I20260928 01:57:14.413158 24038 raft_consensus.cc:359] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.413900 24038 raft_consensus.cc:385] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.414202 24038 raft_consensus.cc:740] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.414971 24038 consensus_queue.cc:260] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.417102 24038 ts_tablet_manager.cc:1434] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260928 01:57:14.420426 24038 tablet_bootstrap.cc:492] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327: Bootstrap starting.
I20260928 01:57:14.433292 24042 ts_tablet_manager.cc:1950] T 2279818f3e62489297a96b2b905b7e1e P a0a57cbfb1f2438db0c398cf2786b327: Deleting consensus metadata
I20260928 01:57:14.435011 24038 tablet_bootstrap.cc:654] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.445957 24041 raft_consensus.cc:359] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.447000 24041 raft_consensus.cc:385] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.447382 24041 raft_consensus.cc:740] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491712372a4f491f9ba8539837899e55, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.448395 23300 catalog_manager.cc:5063] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): tablet 2279818f3e62489297a96b2b905b7e1e (table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]) successfully deleted
I20260928 01:57:14.452756 24038 tablet_bootstrap.cc:492] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327: No bootstrap required, opened a new log
I20260928 01:57:14.453342 24038 ts_tablet_manager.cc:1403] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.004s
I20260928 01:57:14.458299 24038 raft_consensus.cc:359] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.459161 24038 raft_consensus.cc:385] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.459481 24038 raft_consensus.cc:740] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.460417 24038 consensus_queue.cc:260] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.466638 24038 ts_tablet_manager.cc:1434] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260928 01:57:14.474399 23308 master_service.cc:960] ReplaceTablet: received request to replace tablet f38a8ee8788c43b6846b3b302760e211 from {username='slave'} at 127.0.0.1:60578
I20260928 01:57:14.479594 23307 master_service.cc:960] ReplaceTablet: received request to replace tablet f38a8ee8788c43b6846b3b302760e211 from {username='slave'} at 127.0.0.1:60578
W20260928 01:57:14.481312 23977 tablet.cc:2433] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 01:57:14.484511 24041 consensus_queue.cc:260] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.490927 24040 raft_consensus.cc:359] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.491806 24040 raft_consensus.cc:385] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.492146 24040 raft_consensus.cc:740] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.493099 24040 consensus_queue.cc:260] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.504163 24041 ts_tablet_manager.cc:1434] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55: Time spent starting tablet: real 0.134s	user 0.022s	sys 0.012s
W20260928 01:57:14.504581 23815 tablet.cc:2433] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 01:57:14.507038 24040 ts_tablet_manager.cc:1434] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.124s	user 0.034s	sys 0.000s
I20260928 01:57:14.525247 24040 tablet_bootstrap.cc:492] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
I20260928 01:57:14.527503 23743 tablet_service.cc:1558] Processing DeleteTablet for tablet f38a8ee8788c43b6846b3b302760e211 with delete_type TABLET_DATA_DELETED (replaced by tablet e39740b241794e1fb1f31c840b7f5fbe) from {username='slave'} at 127.0.0.1:34098
I20260928 01:57:14.528632 24044 tablet_replica.cc:333] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55: stopping tablet replica
I20260928 01:57:14.529520 24044 raft_consensus.cc:2243] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:14.529668 24041 tablet_bootstrap.cc:492] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55: Bootstrap starting.
I20260928 01:57:14.530107 24044 raft_consensus.cc:2272] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:14.533207 24044 ts_tablet_manager.cc:1916] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:14.534886 24040 tablet_bootstrap.cc:654] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.537516 24041 tablet_bootstrap.cc:654] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.543915 23596 tablet_service.cc:1558] Processing DeleteTablet for tablet 2279818f3e62489297a96b2b905b7e1e with delete_type TABLET_DATA_DELETED (replaced by tablet 2bebc112f560444383696f2137072c1f) from {username='slave'} at 127.0.0.1:44404
I20260928 01:57:14.547564 24043 tablet_replica.cc:333] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375: stopping tablet replica
I20260928 01:57:14.547948 23308 catalog_manager.cc:6133] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Sending DeleteTablet for 3 replicas of tablet f38a8ee8788c43b6846b3b302760e211
I20260928 01:57:14.548925 24043 raft_consensus.cc:2243] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:14.549721 24043 raft_consensus.cc:2272] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:14.550655 23743 tablet_service.cc:1558] Processing DeleteTablet for tablet f38a8ee8788c43b6846b3b302760e211 with delete_type TABLET_DATA_DELETED (replaced by tablet e39740b241794e1fb1f31c840b7f5fbe) from {username='slave'} at 127.0.0.1:34098
I20260928 01:57:14.552772 23308 catalog_manager.cc:6934] ReplaceTablet: tablet f38a8ee8788c43b6846b3b302760e211 deleted and replaced by tablet e39740b241794e1fb1f31c840b7f5fbe
I20260928 01:57:14.553339 23596 tablet_service.cc:1558] Processing DeleteTablet for tablet f38a8ee8788c43b6846b3b302760e211 with delete_type TABLET_DATA_DELETED (replaced by tablet e39740b241794e1fb1f31c840b7f5fbe) from {username='slave'} at 127.0.0.1:44404
I20260928 01:57:14.553993 23905 tablet_service.cc:1558] Processing DeleteTablet for tablet f38a8ee8788c43b6846b3b302760e211 with delete_type TABLET_DATA_DELETED (replaced by tablet e39740b241794e1fb1f31c840b7f5fbe) from {username='slave'} at 127.0.0.1:44074
I20260928 01:57:14.555013 24042 tablet_replica.cc:333] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327: stopping tablet replica
I20260928 01:57:14.555894 24042 raft_consensus.cc:2243] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:14.556465 24042 raft_consensus.cc:2272] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:14.556928 24043 ts_tablet_manager.cc:1916] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:14.559906 24042 ts_tablet_manager.cc:1916] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:14.579891 23596 tablet_service.cc:1511] Processing CreateTablet for tablet e39740b241794e1fb1f31c840b7f5fbe (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.581151 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39740b241794e1fb1f31c840b7f5fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.586563 23743 tablet_service.cc:1511] Processing CreateTablet for tablet e39740b241794e1fb1f31c840b7f5fbe (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.587771 23743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39740b241794e1fb1f31c840b7f5fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.588580 23905 tablet_service.cc:1511] Processing CreateTablet for tablet e39740b241794e1fb1f31c840b7f5fbe (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.589920 23905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39740b241794e1fb1f31c840b7f5fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.635460 24040 tablet_bootstrap.cc:492] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:14.636025 24040 ts_tablet_manager.cc:1403] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.111s	user 0.025s	sys 0.002s
I20260928 01:57:14.631640 24041 tablet_bootstrap.cc:492] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55: No bootstrap required, opened a new log
I20260928 01:57:14.639045 24040 raft_consensus.cc:359] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.637192 24041 ts_tablet_manager.cc:1403] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55: Time spent bootstrapping tablet: real 0.108s	user 0.025s	sys 0.026s
I20260928 01:57:14.642186 24040 raft_consensus.cc:385] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.642596 24040 raft_consensus.cc:740] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.643402 24044 ts_tablet_manager.cc:1929] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:14.643864 24044 log.cc:1199] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/f38a8ee8788c43b6846b3b302760e211
I20260928 01:57:14.644771 24044 ts_tablet_manager.cc:1950] T f38a8ee8788c43b6846b3b302760e211 P 491712372a4f491f9ba8539837899e55: Deleting consensus metadata
I20260928 01:57:14.645512 24043 ts_tablet_manager.cc:1929] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:14.643421 24040 consensus_queue.cc:260] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.646427 24043 log.cc:1199] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/2279818f3e62489297a96b2b905b7e1e
I20260928 01:57:14.649242 24043 ts_tablet_manager.cc:1950] T 2279818f3e62489297a96b2b905b7e1e P 9a3818d183894d038ea5871a360af375: Deleting consensus metadata
I20260928 01:57:14.648180 24040 ts_tablet_manager.cc:1434] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260928 01:57:14.653162 24040 tablet_bootstrap.cc:492] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
I20260928 01:57:14.655230 24038 tablet_bootstrap.cc:492] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327: Bootstrap starting.
I20260928 01:57:14.656169 24043 tablet_replica.cc:333] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375: stopping tablet replica
I20260928 01:57:14.657544 23301 catalog_manager.cc:5063] TS 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): tablet 2279818f3e62489297a96b2b905b7e1e (table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]) successfully deleted
I20260928 01:57:14.658475 24043 raft_consensus.cc:2243] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:14.659066 24043 raft_consensus.cc:2272] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:14.662283 24038 tablet_bootstrap.cc:654] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.667208 24042 ts_tablet_manager.cc:1929] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:14.667627 24042 log.cc:1199] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/f38a8ee8788c43b6846b3b302760e211
I20260928 01:57:14.668313 24042 ts_tablet_manager.cc:1950] T f38a8ee8788c43b6846b3b302760e211 P a0a57cbfb1f2438db0c398cf2786b327: Deleting consensus metadata
I20260928 01:57:14.671114 23300 catalog_manager.cc:5063] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): tablet f38a8ee8788c43b6846b3b302760e211 (table default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]) successfully deleted
I20260928 01:57:14.672369 24043 ts_tablet_manager.cc:1916] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:14.680682 24038 tablet_bootstrap.cc:492] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327: No bootstrap required, opened a new log
I20260928 01:57:14.680733 24040 tablet_bootstrap.cc:654] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.681185 24038 ts_tablet_manager.cc:1403] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260928 01:57:14.684885 24038 raft_consensus.cc:359] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.685614 24038 raft_consensus.cc:385] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.685928 24038 raft_consensus.cc:740] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.686741 24041 raft_consensus.cc:359] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.687528 24041 raft_consensus.cc:385] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.687846 24041 raft_consensus.cc:740] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491712372a4f491f9ba8539837899e55, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.688619 24041 consensus_queue.cc:260] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.697588 24038 consensus_queue.cc:260] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.702979 23301 catalog_manager.cc:5063] TS 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): tablet f38a8ee8788c43b6846b3b302760e211 (table default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]) successfully deleted
W20260928 01:57:14.704363 23301 catalog_manager.cc:5030] TS 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): delete failed for tablet f38a8ee8788c43b6846b3b302760e211 because the tablet was not found. No further retry: Not found: Tablet not found: f38a8ee8788c43b6846b3b302760e211
I20260928 01:57:14.708976 24038 ts_tablet_manager.cc:1434] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260928 01:57:14.714381 24040 tablet_bootstrap.cc:492] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:14.715124 24040 ts_tablet_manager.cc:1403] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.062s	user 0.005s	sys 0.015s
I20260928 01:57:14.718034 24040 raft_consensus.cc:359] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.718880 24040 raft_consensus.cc:385] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.721901 24041 ts_tablet_manager.cc:1434] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.001s
I20260928 01:57:14.723323 24041 tablet_bootstrap.cc:492] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55: Bootstrap starting.
I20260928 01:57:14.729127 23743 tablet_service.cc:1558] Processing DeleteTablet for tablet 2279818f3e62489297a96b2b905b7e1e with delete_type TABLET_DATA_DELETED (replaced by tablet 2bebc112f560444383696f2137072c1f) from {username='slave'} at 127.0.0.1:34098
I20260928 01:57:14.730605 24044 tablet_replica.cc:333] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55: stopping tablet replica
I20260928 01:57:14.731266 24044 raft_consensus.cc:2243] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:14.731766 24044 raft_consensus.cc:2272] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:14.732277 23308 master_service.cc:960] ReplaceTablet: received request to replace tablet 2bebc112f560444383696f2137072c1f from {username='slave'} at 127.0.0.1:60578
I20260928 01:57:14.732266 24040 raft_consensus.cc:740] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.735718 24040 consensus_queue.cc:260] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.748131 24044 ts_tablet_manager.cc:1916] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:14.750084 24043 ts_tablet_manager.cc:1929] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:14.750481 24043 log.cc:1199] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/f38a8ee8788c43b6846b3b302760e211
I20260928 01:57:14.751192 24043 ts_tablet_manager.cc:1950] T f38a8ee8788c43b6846b3b302760e211 P 9a3818d183894d038ea5871a360af375: Deleting consensus metadata
I20260928 01:57:14.745288 24040 ts_tablet_manager.cc:1434] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260928 01:57:14.756183 24040 tablet_bootstrap.cc:492] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
I20260928 01:57:14.755518 24041 tablet_bootstrap.cc:654] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.766731 23307 master_service.cc:960] ReplaceTablet: received request to replace tablet e39740b241794e1fb1f31c840b7f5fbe from {username='slave'} at 127.0.0.1:60578
I20260928 01:57:14.778053 23596 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bebc112f560444383696f2137072c1f with delete_type TABLET_DATA_DELETED (replaced by tablet 46a2ef753ec14012af179f74982c2904) from {username='slave'} at 127.0.0.1:44404
I20260928 01:57:14.782899 23308 catalog_manager.cc:6133] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Sending DeleteTablet for 3 replicas of tablet 2bebc112f560444383696f2137072c1f
I20260928 01:57:14.785091 23596 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bebc112f560444383696f2137072c1f with delete_type TABLET_DATA_DELETED (replaced by tablet 46a2ef753ec14012af179f74982c2904) from {username='slave'} at 127.0.0.1:44404
I20260928 01:57:14.787304 23743 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bebc112f560444383696f2137072c1f with delete_type TABLET_DATA_DELETED (replaced by tablet 46a2ef753ec14012af179f74982c2904) from {username='slave'} at 127.0.0.1:34098
I20260928 01:57:14.788461 23308 catalog_manager.cc:6934] ReplaceTablet: tablet 2bebc112f560444383696f2137072c1f deleted and replaced by tablet 46a2ef753ec14012af179f74982c2904
I20260928 01:57:14.789248 23307 catalog_manager.cc:6133] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Sending DeleteTablet for 3 replicas of tablet e39740b241794e1fb1f31c840b7f5fbe
I20260928 01:57:14.790791 23307 catalog_manager.cc:6934] ReplaceTablet: tablet e39740b241794e1fb1f31c840b7f5fbe deleted and replaced by tablet 18d0876f50ea4ce597b581cf101c0d78
I20260928 01:57:14.795302 23905 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bebc112f560444383696f2137072c1f with delete_type TABLET_DATA_DELETED (replaced by tablet 46a2ef753ec14012af179f74982c2904) from {username='slave'} at 127.0.0.1:44074
I20260928 01:57:14.796154 24042 tablet_replica.cc:333] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327: stopping tablet replica
I20260928 01:57:14.796927 24042 raft_consensus.cc:2243] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:14.797008 23743 tablet_service.cc:1558] Processing DeleteTablet for tablet e39740b241794e1fb1f31c840b7f5fbe with delete_type TABLET_DATA_DELETED (replaced by tablet 18d0876f50ea4ce597b581cf101c0d78) from {username='slave'} at 127.0.0.1:34098
I20260928 01:57:14.797489 24042 raft_consensus.cc:2272] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:14.797753 23596 tablet_service.cc:1558] Processing DeleteTablet for tablet e39740b241794e1fb1f31c840b7f5fbe with delete_type TABLET_DATA_DELETED (replaced by tablet 18d0876f50ea4ce597b581cf101c0d78) from {username='slave'} at 127.0.0.1:44404
I20260928 01:57:14.798755 23905 tablet_service.cc:1558] Processing DeleteTablet for tablet e39740b241794e1fb1f31c840b7f5fbe with delete_type TABLET_DATA_DELETED (replaced by tablet 18d0876f50ea4ce597b581cf101c0d78) from {username='slave'} at 127.0.0.1:44074
I20260928 01:57:14.801707 24042 ts_tablet_manager.cc:1916] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:14.803535 24040 tablet_bootstrap.cc:654] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.805954 23301 catalog_manager.cc:5063] TS 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): tablet f38a8ee8788c43b6846b3b302760e211 (table default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]) successfully deleted
I20260928 01:57:14.808703 24043 tablet_replica.cc:333] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375: stopping tablet replica
I20260928 01:57:14.809633 24043 raft_consensus.cc:2243] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:14.810225 24043 raft_consensus.cc:2272] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:14.814096 24043 ts_tablet_manager.cc:1916] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:14.820931 24041 tablet_bootstrap.cc:492] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55: No bootstrap required, opened a new log
I20260928 01:57:14.821419 24041 ts_tablet_manager.cc:1403] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55: Time spent bootstrapping tablet: real 0.098s	user 0.007s	sys 0.006s
I20260928 01:57:14.824321 24041 raft_consensus.cc:359] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.825047 24041 raft_consensus.cc:385] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.825330 24041 raft_consensus.cc:740] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491712372a4f491f9ba8539837899e55, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.831421 24044 ts_tablet_manager.cc:1929] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:14.835029 23596 tablet_service.cc:1511] Processing CreateTablet for tablet 46a2ef753ec14012af179f74982c2904 (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.836182 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a2ef753ec14012af179f74982c2904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.844882 23743 tablet_service.cc:1511] Processing CreateTablet for tablet 46a2ef753ec14012af179f74982c2904 (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.846212 23743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a2ef753ec14012af179f74982c2904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.855343 24042 ts_tablet_manager.cc:1929] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:14.855777 24042 log.cc:1199] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/2bebc112f560444383696f2137072c1f
I20260928 01:57:14.857240 23905 tablet_service.cc:1511] Processing CreateTablet for tablet 46a2ef753ec14012af179f74982c2904 (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.858587 23905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a2ef753ec14012af179f74982c2904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.862154 23598 tablet_service.cc:1511] Processing CreateTablet for tablet 18d0876f50ea4ce597b581cf101c0d78 (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.863426 23598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18d0876f50ea4ce597b581cf101c0d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.869145 23742 tablet_service.cc:1511] Processing CreateTablet for tablet 18d0876f50ea4ce597b581cf101c0d78 (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.870370 23742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18d0876f50ea4ce597b581cf101c0d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.871253 23904 tablet_service.cc:1511] Processing CreateTablet for tablet 18d0876f50ea4ce597b581cf101c0d78 (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:14.872457 23904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18d0876f50ea4ce597b581cf101c0d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:14.888823 24042 ts_tablet_manager.cc:1950] T 2bebc112f560444383696f2137072c1f P a0a57cbfb1f2438db0c398cf2786b327: Deleting consensus metadata
I20260928 01:57:14.888525 24041 consensus_queue.cc:260] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.891053 24041 ts_tablet_manager.cc:1434] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55: Time spent starting tablet: real 0.069s	user 0.003s	sys 0.004s
I20260928 01:57:14.894330 24040 tablet_bootstrap.cc:492] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:14.894831 24040 ts_tablet_manager.cc:1403] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.139s	user 0.014s	sys 0.008s
I20260928 01:57:14.899626 24043 ts_tablet_manager.cc:1929] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:14.903335 24043 log.cc:1199] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/2bebc112f560444383696f2137072c1f
I20260928 01:57:14.831843 24044 log.cc:1199] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/2279818f3e62489297a96b2b905b7e1e
I20260928 01:57:14.907250 23300 catalog_manager.cc:5063] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): tablet 2bebc112f560444383696f2137072c1f (table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]) successfully deleted
I20260928 01:57:14.907958 24044 ts_tablet_manager.cc:1950] T 2279818f3e62489297a96b2b905b7e1e P 491712372a4f491f9ba8539837899e55: Deleting consensus metadata
I20260928 01:57:14.908123 24043 ts_tablet_manager.cc:1950] T 2bebc112f560444383696f2137072c1f P 9a3818d183894d038ea5871a360af375: Deleting consensus metadata
I20260928 01:57:14.911427 23301 catalog_manager.cc:5063] TS 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): tablet 2bebc112f560444383696f2137072c1f (table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]) successfully deleted
W20260928 01:57:14.912819 23301 catalog_manager.cc:5030] TS 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): delete failed for tablet 2bebc112f560444383696f2137072c1f because the tablet was not found. No further retry: Not found: Tablet not found: 2bebc112f560444383696f2137072c1f
I20260928 01:57:14.899988 24040 raft_consensus.cc:359] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.913666 24040 raft_consensus.cc:385] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.914951 24040 raft_consensus.cc:740] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.913954 24041 tablet_bootstrap.cc:492] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55: Bootstrap starting.
I20260928 01:57:14.916404 24040 consensus_queue.cc:260] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.917474 24038 tablet_bootstrap.cc:492] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327: Bootstrap starting.
W20260928 01:57:14.917979 23301 catalog_manager.cc:5043] TS 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): delete failed for tablet e39740b241794e1fb1f31c840b7f5fbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e39740b241794e1fb1f31c840b7f5fbe already in progress: creating tablet
I20260928 01:57:14.919270 24040 ts_tablet_manager.cc:1434] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260928 01:57:14.920300 24040 tablet_bootstrap.cc:492] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
I20260928 01:57:14.920740 24042 tablet_replica.cc:333] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327: stopping tablet replica
I20260928 01:57:14.921522 24042 raft_consensus.cc:2243] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:14.922184 24042 raft_consensus.cc:2272] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:14.927192 24040 tablet_bootstrap.cc:654] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.928027 24038 tablet_bootstrap.cc:654] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327: Neither blocks nor log segments found. Creating new log.
01:57:14.928 [HMS - ERROR - pool-6-thread-3] (RetryingHMSHandler.java:201) AlreadyExistsException(message:Table hive.default.table_65cea13c8a8b405bb606a477b84c212e already exists)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1839)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1786)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:2035)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
	at jdk.proxy2/jdk.proxy2.$Proxy27.create_table_with_environment_context(Unknown Source)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14800)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14784)
	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
	at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:104)
	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)

I20260928 01:57:14.939780 24038 tablet_bootstrap.cc:492] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327: No bootstrap required, opened a new log
I20260928 01:57:14.940295 24038 ts_tablet_manager.cc:1403] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260928 01:57:14.940892 23598 tablet_service.cc:1558] Processing DeleteTablet for tablet e39740b241794e1fb1f31c840b7f5fbe with delete_type TABLET_DATA_DELETED (replaced by tablet 18d0876f50ea4ce597b581cf101c0d78) from {username='slave'} at 127.0.0.1:44404
I20260928 01:57:14.943287 24038 raft_consensus.cc:359] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
W20260928 01:57:14.945359 23311 catalog_manager.cc:2209] Already present: failed to create HMS catalog entry for table  [id=04d119715d8e43ecb808b58a223b7086]: failed to create Hive MetaStore table: TException - service has thrown: AlreadyExistsException(message=Table hive.default.table_65cea13c8a8b405bb606a477b84c212e already exists)
I20260928 01:57:14.945484 24043 tablet_replica.cc:333] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375: stopping tablet replica
I20260928 01:57:14.946303 24043 raft_consensus.cc:2243] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:14.946549 23311 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60578 (request call id 16) took 1480 ms. Trace:
I20260928 01:57:14.946846 24043 raft_consensus.cc:2272] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:14.946905 23311 rpcz_store.cc:276] 0928 01:57:13.466588 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:57:13.469931 (+  3343us) service_pool.cc:224] Handling call
0928 01:57:13.541069 (+ 71138us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:57:13.547472 (+  6403us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:57:14.946467 (+1398995us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":463691,"Hive Metastore.run_cpu_time_us":1811,"Hive Metastore.run_wall_time_us":933154}
I20260928 01:57:14.952068 24043 ts_tablet_manager.cc:1916] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:14.940333 24042 ts_tablet_manager.cc:1916] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:14.953848 23311 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60578:
name: "default.Table_e8b07c013ec14343bdd6906db9b0a226"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:57:14.944113 24038 raft_consensus.cc:385] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.960603 24038 raft_consensus.cc:740] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.961642 24038 consensus_queue.cc:260] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.969139 24038 ts_tablet_manager.cc:1434] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260928 01:57:14.970793 23301 catalog_manager.cc:5063] TS 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): tablet 2279818f3e62489297a96b2b905b7e1e (table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]) successfully deleted
I20260928 01:57:14.972024 24044 tablet_replica.cc:333] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55: stopping tablet replica
I20260928 01:57:14.972937 24044 raft_consensus.cc:2243] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:14.975462 24040 tablet_bootstrap.cc:492] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:14.976080 24044 raft_consensus.cc:2272] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:14.976465 24040 ts_tablet_manager.cc:1403] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.010s
I20260928 01:57:14.976468 24038 tablet_bootstrap.cc:492] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327: Bootstrap starting.
I20260928 01:57:14.979754 24040 raft_consensus.cc:359] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.980506 24040 raft_consensus.cc:385] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:14.980810 24040 raft_consensus.cc:740] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:14.981581 24040 consensus_queue.cc:260] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:14.983515 24038 tablet_bootstrap.cc:654] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.987211 24041 tablet_bootstrap.cc:654] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:14.988874 24044 ts_tablet_manager.cc:1916] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:57:14.994217 23313 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_262ead9bd95a4b4cbbd3d3a7638fad4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 01:57:15.003410 23306 master_service.cc:960] ReplaceTablet: received request to replace tablet 18d0876f50ea4ce597b581cf101c0d78 from {username='slave'} at 127.0.0.1:60578
I20260928 01:57:15.005029 24042 ts_tablet_manager.cc:1929] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:15.005472 24042 log.cc:1199] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/e39740b241794e1fb1f31c840b7f5fbe
I20260928 01:57:15.006187 24042 ts_tablet_manager.cc:1950] T e39740b241794e1fb1f31c840b7f5fbe P a0a57cbfb1f2438db0c398cf2786b327: Deleting consensus metadata
I20260928 01:57:15.005234 24040 ts_tablet_manager.cc:1434] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.006s
I20260928 01:57:15.007520 24040 tablet_bootstrap.cc:492] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
I20260928 01:57:15.008510 24043 ts_tablet_manager.cc:1929] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:15.010353 24043 log.cc:1199] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/e39740b241794e1fb1f31c840b7f5fbe
I20260928 01:57:15.011209 24043 ts_tablet_manager.cc:1950] T e39740b241794e1fb1f31c840b7f5fbe P 9a3818d183894d038ea5871a360af375: Deleting consensus metadata
I20260928 01:57:15.014779 23301 catalog_manager.cc:5063] TS 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): tablet e39740b241794e1fb1f31c840b7f5fbe (table default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]) successfully deleted
I20260928 01:57:15.021425 24040 tablet_bootstrap.cc:654] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:15.024106 23300 catalog_manager.cc:5063] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): tablet e39740b241794e1fb1f31c840b7f5fbe (table default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]) successfully deleted
F20260928 01:57:15.026062 23503 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 3 received events: NotificationEvent(eventId=1, eventTime=1790560633, eventType=CREATE_TABLE, dbName=default, tableName=table_65cea13c8a8b405bb606a477b84c212e, message={"server":"","servicePrincipal":"","db":"default","table":"table_65cea13c8a8b405bb606a477b84c212e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_65cea13c8a8b405bb606a477b84c212e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790560633},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/warehouse/table_65cea13c8a8b405bb606a477b84c212e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_65cea13c8a8b405bb606a477b84c212e\",\"kudu.table_id\":\"200ff1976677485ca98559a5415f77d8\",\"transient_lastDdlTime\":\"1790560633\",\"comment\":\"\",\"kudu.master_addresses\":\"127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"277aae6cb6dd46069169192caa8b9479\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790560633,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1790560633, eventType=CREATE_TABLE, dbName=default, tableName=table_d087778a98124fd9b1370342150d18a5, message={"server":"","servicePrincipal":"","db":"default","table":"table_d087778a98124fd9b1370342150d18a5","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_d087778a98124fd9b1370342150d18a5\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790560633},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/warehouse/table_d087778a98124fd9b1370342150d18a5\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_d087778a98124fd9b1370342150d18a5\",\"kudu.table_id\":\"78e56f2b2bf04dc1bccffafe7dedacf4\",\"transient_lastDdlTime\":\"1790560633\",\"comment\":\"\",\"kudu.master_addresses\":\"127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"277aae6cb6dd46069169192caa8b9479\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790560633,"files":[]}, messageFormat=json-0.2, catName=hive);
I20260928 01:57:15.030323 24038 tablet_bootstrap.cc:492] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327: No bootstrap required, opened a new log
I20260928 01:57:15.030813 24038 ts_tablet_manager.cc:1403] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.003s
I20260928 01:57:15.033732 24038 raft_consensus.cc:359] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.034482 24038 raft_consensus.cc:385] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.034785 24038 raft_consensus.cc:740] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Initialized, Role: FOLLOWER
I20260928 01:57:15.040555 24038 consensus_queue.cc:260] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.030699 23307 master_service.cc:960] ReplaceTablet: received request to replace tablet 18d0876f50ea4ce597b581cf101c0d78 from {username='slave'} at 127.0.0.1:60578
I20260928 01:57:15.045976 24040 tablet_bootstrap.cc:492] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:15.046446 24040 ts_tablet_manager.cc:1403] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.004s
*** Check failure stack trace: ***
I20260928 01:57:15.049803 24040 raft_consensus.cc:359] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.051128 24038 ts_tablet_manager.cc:1434] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260928 01:57:15.044160 23306 catalog_manager.cc:6133] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Sending DeleteTablet for 3 replicas of tablet 18d0876f50ea4ce597b581cf101c0d78
I20260928 01:57:15.053887 24040 raft_consensus.cc:385] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.054230 24040 raft_consensus.cc:740] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:15.054267 23904 tablet_service.cc:1558] Processing DeleteTablet for tablet 18d0876f50ea4ce597b581cf101c0d78 with delete_type TABLET_DATA_DELETED (replaced by tablet 3983c3b0cfd64819828873c7f49a75b8) from {username='slave'} at 127.0.0.1:44074
I20260928 01:57:15.054942 24040 consensus_queue.cc:260] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.057516 24040 ts_tablet_manager.cc:1434] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260928 01:57:15.058497 24042 tablet_replica.cc:333] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327: stopping tablet replica
I20260928 01:57:15.059266 24042 raft_consensus.cc:2243] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:15.059767 24042 raft_consensus.cc:2272] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:15.061611 24042 ts_tablet_manager.cc:1916] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:57:15.068691 23671 tablet.cc:2433] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 01:57:15.072162 24052 raft_consensus.cc:493] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:15.072413 23596 tablet_service.cc:1558] Processing DeleteTablet for tablet 18d0876f50ea4ce597b581cf101c0d78 with delete_type TABLET_DATA_DELETED (replaced by tablet 3983c3b0cfd64819828873c7f49a75b8) from {username='slave'} at 127.0.0.1:44404
I20260928 01:57:15.072810 24052 raft_consensus.cc:515] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.076097 24052 leader_election.cc:290] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:15.076932 24043 tablet_replica.cc:333] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375: stopping tablet replica
I20260928 01:57:15.077661 24043 raft_consensus.cc:2243] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:15.078241 24043 raft_consensus.cc:2272] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:15.080713 24043 ts_tablet_manager.cc:1916] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:15.092459 23743 tablet_service.cc:1558] Processing DeleteTablet for tablet 18d0876f50ea4ce597b581cf101c0d78 with delete_type TABLET_DATA_DELETED (replaced by tablet 3983c3b0cfd64819828873c7f49a75b8) from {username='slave'} at 127.0.0.1:34098
I20260928 01:57:15.094331 23306 catalog_manager.cc:6934] ReplaceTablet: tablet 18d0876f50ea4ce597b581cf101c0d78 deleted and replaced by tablet 3983c3b0cfd64819828873c7f49a75b8
I20260928 01:57:15.096889 23904 tablet_service.cc:1558] Processing DeleteTablet for tablet 18d0876f50ea4ce597b581cf101c0d78 with delete_type TABLET_DATA_DELETED (replaced by tablet 3983c3b0cfd64819828873c7f49a75b8) from {username='slave'} at 127.0.0.1:44074
I20260928 01:57:15.101501 24043 ts_tablet_manager.cc:1929] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:15.112349 24043 log.cc:1199] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/18d0876f50ea4ce597b581cf101c0d78
I20260928 01:57:15.113107 24043 ts_tablet_manager.cc:1950] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375: Deleting consensus metadata
I20260928 01:57:15.115095 23301 catalog_manager.cc:5063] TS 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): tablet 18d0876f50ea4ce597b581cf101c0d78 (table default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]) successfully deleted
I20260928 01:57:15.122711 24042 ts_tablet_manager.cc:1929] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:15.123137 24042 log.cc:1199] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/18d0876f50ea4ce597b581cf101c0d78
I20260928 01:57:15.123852 24042 ts_tablet_manager.cc:1950] T 18d0876f50ea4ce597b581cf101c0d78 P a0a57cbfb1f2438db0c398cf2786b327: Deleting consensus metadata
I20260928 01:57:15.134202 24041 tablet_bootstrap.cc:492] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55: No bootstrap required, opened a new log
W20260928 01:57:15.135321 23552 leader_election.cc:343] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): Not found: Tablet not found: 18d0876f50ea4ce597b581cf101c0d78
I20260928 01:57:15.138118 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d0876f50ea4ce597b581cf101c0d78" candidate_uuid: "9a3818d183894d038ea5871a360af375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491712372a4f491f9ba8539837899e55" is_pre_election: true
W20260928 01:57:15.141144 23553 leader_election.cc:343] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:57:15.141594 23553 leader_election.cc:304] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a3818d183894d038ea5871a360af375; no voters: 491712372a4f491f9ba8539837899e55, a0a57cbfb1f2438db0c398cf2786b327
W20260928 01:57:15.142757 23553 raft_consensus.cc:2686] T 18d0876f50ea4ce597b581cf101c0d78 P 9a3818d183894d038ea5871a360af375: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:57:15.144865 24041 ts_tablet_manager.cc:1403] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55: Time spent bootstrapping tablet: real 0.231s	user 0.009s	sys 0.004s
I20260928 01:57:15.126816 23300 catalog_manager.cc:5063] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): tablet 18d0876f50ea4ce597b581cf101c0d78 (table default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]) successfully deleted
W20260928 01:57:15.147471 23300 catalog_manager.cc:5030] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): delete failed for tablet 18d0876f50ea4ce597b581cf101c0d78 because the tablet was not found. No further retry: Not found: Tablet not found: 18d0876f50ea4ce597b581cf101c0d78
I20260928 01:57:15.162490 24041 raft_consensus.cc:359] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.163224 24041 raft_consensus.cc:385] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.163520 24041 raft_consensus.cc:740] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491712372a4f491f9ba8539837899e55, State: Initialized, Role: FOLLOWER
I20260928 01:57:15.164933 24041 consensus_queue.cc:260] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.167054 24041 ts_tablet_manager.cc:1434] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.004s
I20260928 01:57:15.167716 24044 ts_tablet_manager.cc:1929] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:15.168097 24044 log.cc:1199] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/2bebc112f560444383696f2137072c1f
I20260928 01:57:15.169483 24041 tablet_bootstrap.cc:492] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55: Bootstrap starting.
I20260928 01:57:15.168817 24044 ts_tablet_manager.cc:1950] T 2bebc112f560444383696f2137072c1f P 491712372a4f491f9ba8539837899e55: Deleting consensus metadata
I20260928 01:57:15.176740 24044 tablet_replica.cc:333] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55: stopping tablet replica
I20260928 01:57:15.177268 23301 catalog_manager.cc:5063] TS 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): tablet 2bebc112f560444383696f2137072c1f (table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]) successfully deleted
I20260928 01:57:15.177417 24044 raft_consensus.cc:2243] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:15.177870 24044 raft_consensus.cc:2272] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:15.180426 24041 tablet_bootstrap.cc:654] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:15.190781 24045 raft_consensus.cc:493] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:15.191481 24045 raft_consensus.cc:515] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.205696 24052 raft_consensus.cc:493] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:15.206218 24052 raft_consensus.cc:515] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.208007 24045 leader_election.cc:290] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427), 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985)
I20260928 01:57:15.210214 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a2ef753ec14012af179f74982c2904" candidate_uuid: "9a3818d183894d038ea5871a360af375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0a57cbfb1f2438db0c398cf2786b327" is_pre_election: true
I20260928 01:57:15.211114 23925 raft_consensus.cc:2468] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a3818d183894d038ea5871a360af375 in term 0.
I20260928 01:57:15.212692 23552 leader_election.cc:304] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a3818d183894d038ea5871a360af375, a0a57cbfb1f2438db0c398cf2786b327; no voters: 
I20260928 01:57:15.214553 24052 leader_election.cc:290] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:15.215365 24052 raft_consensus.cc:2804] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:57:15.217074 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a2ef753ec14012af179f74982c2904" candidate_uuid: "9a3818d183894d038ea5871a360af375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491712372a4f491f9ba8539837899e55" is_pre_election: true
I20260928 01:57:15.218544 24052 raft_consensus.cc:493] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:57:15.219154 23743 tablet_service.cc:1511] Processing CreateTablet for tablet 3983c3b0cfd64819828873c7f49a75b8 (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:15.219827 24052 raft_consensus.cc:3060] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:15.220346 23743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3983c3b0cfd64819828873c7f49a75b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 01:57:15.220667 23553 leader_election.cc:343] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:57:15.232235 23904 tablet_service.cc:1511] Processing CreateTablet for tablet 3983c3b0cfd64819828873c7f49a75b8 (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:15.233705 23904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3983c3b0cfd64819828873c7f49a75b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:15.234402 24041 tablet_bootstrap.cc:492] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55: No bootstrap required, opened a new log
I20260928 01:57:15.234860 24041 ts_tablet_manager.cc:1403] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.012s
I20260928 01:57:15.237690 23596 tablet_service.cc:1558] Processing DeleteTablet for tablet 18d0876f50ea4ce597b581cf101c0d78 with delete_type TABLET_DATA_DELETED (replaced by tablet 3983c3b0cfd64819828873c7f49a75b8) from {username='slave'} at 127.0.0.1:44404
I20260928 01:57:15.231812 24052 raft_consensus.cc:515] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.239403 23596 tablet_service.cc:1511] Processing CreateTablet for tablet 3983c3b0cfd64819828873c7f49a75b8 (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:15.240558 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3983c3b0cfd64819828873c7f49a75b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:15.241812 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a2ef753ec14012af179f74982c2904" candidate_uuid: "9a3818d183894d038ea5871a360af375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491712372a4f491f9ba8539837899e55"
W20260928 01:57:15.243355 23553 leader_election.cc:343] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:57:15.244683 24044 ts_tablet_manager.cc:1916] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:15.246968 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a2ef753ec14012af179f74982c2904" candidate_uuid: "9a3818d183894d038ea5871a360af375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0a57cbfb1f2438db0c398cf2786b327"
I20260928 01:57:15.247547 23925 raft_consensus.cc:3060] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:15.252833 23307 master_service.cc:960] ReplaceTablet: received request to replace tablet 46a2ef753ec14012af179f74982c2904 from {username='slave'} at 127.0.0.1:60578
I20260928 01:57:15.255000 23925 raft_consensus.cc:2468] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a3818d183894d038ea5871a360af375 in term 1.
I20260928 01:57:15.244539 24041 raft_consensus.cc:359] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.266201 24041 raft_consensus.cc:385] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.266554 24041 raft_consensus.cc:740] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491712372a4f491f9ba8539837899e55, State: Initialized, Role: FOLLOWER
I20260928 01:57:15.267347 24041 consensus_queue.cc:260] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.256593 23552 leader_election.cc:304] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a3818d183894d038ea5871a360af375, a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55
I20260928 01:57:15.273252 24074 raft_consensus.cc:2804] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 01:57:15.276391 23301 catalog_manager.cc:5030] TS 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): delete failed for tablet 18d0876f50ea4ce597b581cf101c0d78 because the tablet was not found. No further retry: Not found: Tablet not found: 18d0876f50ea4ce597b581cf101c0d78
I20260928 01:57:15.272935 24052 leader_election.cc:290] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 election: Requested vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:15.281116 24041 ts_tablet_manager.cc:1434] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.003s
I20260928 01:57:15.282192 24041 tablet_bootstrap.cc:492] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55: Bootstrap starting.
I20260928 01:57:15.283317 24040 tablet_bootstrap.cc:492] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
I20260928 01:57:15.290381 24040 tablet_bootstrap.cc:654] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
    @     0x7f5da4d5b920  google::LogMessage::Flush() at ??:0
I20260928 01:57:15.306177 24038 tablet_bootstrap.cc:492] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327: Bootstrap starting.
I20260928 01:57:15.313582 24041 tablet_bootstrap.cc:654] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:15.313797 24038 tablet_bootstrap.cc:654] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:15.324874 23618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a2ef753ec14012af179f74982c2904" candidate_uuid: "a0a57cbfb1f2438db0c398cf2786b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a3818d183894d038ea5871a360af375" is_pre_election: true
I20260928 01:57:15.326143 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a2ef753ec14012af179f74982c2904" candidate_uuid: "a0a57cbfb1f2438db0c398cf2786b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491712372a4f491f9ba8539837899e55" is_pre_election: true
W20260928 01:57:15.328158 23861 leader_election.cc:343] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:57:15.334220 23313 catalog_manager.cc:2213] created HMS catalog entry for table  [id=1c99922d8a164ecb8ba673c96f1dc202]
I20260928 01:57:15.338366 24038 tablet_bootstrap.cc:492] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327: No bootstrap required, opened a new log
I20260928 01:57:15.339068 24038 ts_tablet_manager.cc:1403] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.003s
I20260928 01:57:15.341552 24038 raft_consensus.cc:359] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.342322 24038 raft_consensus.cc:385] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.342568 24038 raft_consensus.cc:740] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Initialized, Role: FOLLOWER
I20260928 01:57:15.343393 24038 consensus_queue.cc:260] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.345327 24038 ts_tablet_manager.cc:1434] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260928 01:57:15.350178 23307 catalog_manager.cc:6133] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Sending DeleteTablet for 3 replicas of tablet 46a2ef753ec14012af179f74982c2904
I20260928 01:57:15.357247 23743 tablet_service.cc:1558] Processing DeleteTablet for tablet 46a2ef753ec14012af179f74982c2904 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f9539f778114077b285d0fdc89d03e2) from {username='slave'} at 127.0.0.1:34098
I20260928 01:57:15.358875 24044 ts_tablet_manager.cc:1929] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:15.359268 24044 log.cc:1199] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/e39740b241794e1fb1f31c840b7f5fbe
I20260928 01:57:15.359946 24044 ts_tablet_manager.cc:1950] T e39740b241794e1fb1f31c840b7f5fbe P 491712372a4f491f9ba8539837899e55: Deleting consensus metadata
I20260928 01:57:15.360672 23596 tablet_service.cc:1558] Processing DeleteTablet for tablet 46a2ef753ec14012af179f74982c2904 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f9539f778114077b285d0fdc89d03e2) from {username='slave'} at 127.0.0.1:44404
I20260928 01:57:15.361622 24043 tablet_replica.cc:333] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375: stopping tablet replica
I20260928 01:57:15.364670 24041 tablet_bootstrap.cc:492] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55: No bootstrap required, opened a new log
I20260928 01:57:15.365182 24041 ts_tablet_manager.cc:1403] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.000s
I20260928 01:57:15.373977 24044 tablet_replica.cc:333] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55: stopping tablet replica
I20260928 01:57:15.374675 24044 raft_consensus.cc:2243] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:15.375183 24044 raft_consensus.cc:2272] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:15.375464 23301 catalog_manager.cc:5063] TS 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): tablet e39740b241794e1fb1f31c840b7f5fbe (table default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]) successfully deleted
    @     0x7f5da4d5b68f  google::LogMessage::~LogMessage() at ??:0
I20260928 01:57:15.378548 24041 raft_consensus.cc:359] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.379282 24041 raft_consensus.cc:385] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.379711 24041 raft_consensus.cc:740] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491712372a4f491f9ba8539837899e55, State: Initialized, Role: FOLLOWER
I20260928 01:57:15.382563 24041 consensus_queue.cc:260] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.383035 23313 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60578 (request call id 14) took 1917 ms. Trace:
I20260928 01:57:15.386610 24044 ts_tablet_manager.cc:1916] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:15.383525 23313 rpcz_store.cc:276] 0928 01:57:13.465823 (+     0us) service_pool.cc:167] Inserting onto call queue
0928 01:57:13.466044 (+   221us) service_pool.cc:224] Handling call
0928 01:57:14.994763 (+1528719us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 01:57:14.999957 (+  5194us) catalog_manager.cc:2186] Created new table and tablet info
0928 01:57:15.334166 (+334209us) catalog_manager.cc:2212] Created new table in HMS catalog
0928 01:57:15.382224 (+ 48058us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 01:57:15.382598 (+   374us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 01:57:15.382958 (+   360us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 01:57:15.337098 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 01:57:15.337579 (+   481us) write_op.cc:432] Acquiring schema lock in shared mode
0928 01:57:15.337605 (+    26us) write_op.cc:435] Acquired schema lock
0928 01:57:15.337616 (+    11us) tablet.cc:662] Decoding operations
0928 01:57:15.337968 (+   352us) write_op.cc:620] Acquiring the partition lock for write op
0928 01:57:15.338010 (+    42us) write_op.cc:641] Partition lock acquired for write op
0928 01:57:15.338036 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0928 01:57:15.338257 (+   221us) tablet.cc:701] Row locks acquired
0928 01:57:15.338274 (+    17us) write_op.cc:260] PREPARE: finished
0928 01:57:15.338428 (+   154us) write_op.cc:270] Start()
0928 01:57:15.338529 (+   101us) write_op.cc:276] Timestamp: P: 1790560635337803 usec, L: 0
0928 01:57:15.338549 (+    20us) op_driver.cc:348] REPLICATION: starting
0928 01:57:15.339124 (+   575us) log.cc:844] Serialized 432 byte log entry
0928 01:57:15.373525 (+ 34401us) op_driver.cc:464] REPLICATION: finished
0928 01:57:15.380418 (+  6893us) write_op.cc:301] APPLY: starting
0928 01:57:15.380488 (+    70us) tablet.cc:1394] starting BulkCheckPresence
0928 01:57:15.380604 (+   116us) tablet.cc:1397] finished BulkCheckPresence
0928 01:57:15.380709 (+   105us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 01:57:15.381227 (+   518us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 01:57:15.381372 (+   145us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 01:57:15.381418 (+    46us) write_op.cc:312] APPLY: finished
0928 01:57:15.381648 (+   230us) log.cc:844] Serialized 28 byte log entry
0928 01:57:15.381850 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0928 01:57:15.381932 (+    82us) write_op.cc:454] Released schema lock
0928 01:57:15.381970 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":23264,"Hive Metastore.run_cpu_time_us":707,"Hive Metastore.run_wall_time_us":310106,"child_traces":[["op",{"apply.queue_time_us":6689,"num_ops":2,"prepare.queue_time_us":944,"prepare.run_cpu_time_us":2517,"prepare.run_wall_time_us":8993,"raft.queue_time_us":614,"raft.run_cpu_time_us":780,"raft.run_wall_time_us":805,"replication_time_us":34847}]]}
I20260928 01:57:15.389161 24074 raft_consensus.cc:697] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 1 LEADER]: Becoming Leader. State: Replica: 9a3818d183894d038ea5871a360af375, State: Running, Role: LEADER
I20260928 01:57:15.390591 24074 consensus_queue.cc:237] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.392645 24040 tablet_bootstrap.cc:492] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:15.393070 24040 ts_tablet_manager.cc:1403] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.014s
I20260928 01:57:15.396343 24040 raft_consensus.cc:359] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.396999 24040 raft_consensus.cc:385] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.397259 24040 raft_consensus.cc:740] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:15.407655 24041 ts_tablet_manager.cc:1434] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.003s
I20260928 01:57:15.411580 24041 tablet_bootstrap.cc:492] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55: Bootstrap starting.
I20260928 01:57:15.412554 24040 consensus_queue.cc:260] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.428082 23307 catalog_manager.cc:6934] ReplaceTablet: tablet 46a2ef753ec14012af179f74982c2904 deleted and replaced by tablet 1f9539f778114077b285d0fdc89d03e2
I20260928 01:57:15.430125 23904 tablet_service.cc:1558] Processing DeleteTablet for tablet 46a2ef753ec14012af179f74982c2904 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f9539f778114077b285d0fdc89d03e2) from {username='slave'} at 127.0.0.1:44074
I20260928 01:57:15.430964 24042 tablet_replica.cc:333] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327: stopping tablet replica
I20260928 01:57:15.431800 24042 raft_consensus.cc:2243] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:15.432386 24042 raft_consensus.cc:2272] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:15.433694 24040 ts_tablet_manager.cc:1434] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260928 01:57:15.440550 24043 raft_consensus.cc:2243] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:57:15.442591 23596 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9539f778114077b285d0fdc89d03e2 (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:15.443753 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9539f778114077b285d0fdc89d03e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:15.446199 24042 ts_tablet_manager.cc:1916] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 01:57:15.447013 23861 leader_election.cc:343] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:57:15.447485 23861 leader_election.cc:304] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
W20260928 01:57:15.448292 23861 raft_consensus.cc:2686] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 01:57:15.453555 23307 master_service.cc:960] ReplaceTablet: received request to replace tablet 46a2ef753ec14012af179f74982c2904 from {username='slave'} at 127.0.0.1:60578
I20260928 01:57:15.454509 24043 pending_rounds.cc:70] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375: Trying to abort 1 pending ops.
I20260928 01:57:15.454838 24043 pending_rounds.cc:77] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334136362575126528 op_type: NO_OP noop_request { }
I20260928 01:57:15.455279 24043 raft_consensus.cc:2889] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:57:15.455663 24043 raft_consensus.cc:2272] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:15.457787 23313 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60578:
table { table_name: "default.Table_262ead9bd95a4b4cbbd3d3a7638fad4a" } modify_external_catalogs: true
I20260928 01:57:15.463560 23904 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9539f778114077b285d0fdc89d03e2 (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:15.464893 23904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9539f778114077b285d0fdc89d03e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:15.468535 23313 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60578:
table { table_name: "default.Table_262ead9bd95a4b4cbbd3d3a7638fad4a" } modify_external_catalogs: true
I20260928 01:57:15.444221 24041 tablet_bootstrap.cc:654] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:15.470594 24051 raft_consensus.cc:493] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:15.471891 24051 raft_consensus.cc:515] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.459228 23743 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9539f778114077b285d0fdc89d03e2 (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:15.480614 23743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9539f778114077b285d0fdc89d03e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:15.484561 24045 raft_consensus.cc:493] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 01:57:15.485306 24080 consensus_queue.cc:1175] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9a3818d183894d038ea5871a360af375" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260928 01:57:15.485011 24045 raft_consensus.cc:515] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.487454 24045 leader_election.cc:290] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427), 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985)
I20260928 01:57:15.490890 23618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c3b0cfd64819828873c7f49a75b8" candidate_uuid: "a0a57cbfb1f2438db0c398cf2786b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a3818d183894d038ea5871a360af375" is_pre_election: true
I20260928 01:57:15.491678 24044 ts_tablet_manager.cc:1929] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:15.491675 23618 raft_consensus.cc:2468] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0a57cbfb1f2438db0c398cf2786b327 in term 0.
I20260928 01:57:15.488296 24051 leader_election.cc:290] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427), a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:15.494747 23861 leader_election.cc:304] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a3818d183894d038ea5871a360af375, a0a57cbfb1f2438db0c398cf2786b327; no voters: 
I20260928 01:57:15.496431 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a2ef753ec14012af179f74982c2904" candidate_uuid: "491712372a4f491f9ba8539837899e55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0a57cbfb1f2438db0c398cf2786b327" is_pre_election: true
I20260928 01:57:15.492069 24044 log.cc:1199] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/18d0876f50ea4ce597b581cf101c0d78
W20260928 01:57:15.498346 23698 leader_election.cc:343] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): Illegal state: Tablet not RUNNING: STOPPED
I20260928 01:57:15.499116 24044 ts_tablet_manager.cc:1950] T 18d0876f50ea4ce597b581cf101c0d78 P 491712372a4f491f9ba8539837899e55: Deleting consensus metadata
I20260928 01:57:15.499128 24045 raft_consensus.cc:2804] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:57:15.499487 24045 raft_consensus.cc:493] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:57:15.499797 24045 raft_consensus.cc:3060] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Advancing to term 1
W20260928 01:57:15.503445 24018 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:57:15.504371 24018 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:57:15.505214 24018 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260928 01:57:15.506325 23301 catalog_manager.cc:5063] TS 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): tablet 18d0876f50ea4ce597b581cf101c0d78 (table default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]) successfully deleted
I20260928 01:57:15.507874 24040 tablet_bootstrap.cc:492] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
    @     0x7f5dafeee35c  kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260928 01:57:15.508944 24044 tablet_replica.cc:333] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55: stopping tablet replica
I20260928 01:57:15.515614 24044 raft_consensus.cc:2243] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:15.516151 24044 raft_consensus.cc:2272] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:15.518755 24044 ts_tablet_manager.cc:1916] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:15.522526 24043 ts_tablet_manager.cc:1916] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:15.527127 24042 ts_tablet_manager.cc:1929] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:15.527746 24042 log.cc:1199] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/46a2ef753ec14012af179f74982c2904
I20260928 01:57:15.534340 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c3b0cfd64819828873c7f49a75b8" candidate_uuid: "a0a57cbfb1f2438db0c398cf2786b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491712372a4f491f9ba8539837899e55" is_pre_election: true
I20260928 01:57:15.535034 23618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a2ef753ec14012af179f74982c2904" candidate_uuid: "491712372a4f491f9ba8539837899e55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a3818d183894d038ea5871a360af375" is_pre_election: true
W20260928 01:57:15.537720 23699 leader_election.cc:343] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Illegal state: Tablet not RUNNING: STOPPED
I20260928 01:57:15.538195 23699 leader_election.cc:304] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491712372a4f491f9ba8539837899e55; no voters: 9a3818d183894d038ea5871a360af375, a0a57cbfb1f2438db0c398cf2786b327
W20260928 01:57:15.539002 23699 raft_consensus.cc:2686] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 01:57:15.540088 23861 leader_election.cc:343] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Illegal state: must be running to vote when last-logged opid is not known
I20260928 01:57:15.540750 24044 ts_tablet_manager.cc:1929] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:15.541148 24044 log.cc:1199] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/46a2ef753ec14012af179f74982c2904
I20260928 01:57:15.541878 24044 ts_tablet_manager.cc:1950] T 46a2ef753ec14012af179f74982c2904 P 491712372a4f491f9ba8539837899e55: Deleting consensus metadata
I20260928 01:57:15.545424 23301 catalog_manager.cc:5063] TS 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): tablet 46a2ef753ec14012af179f74982c2904 (table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]) successfully deleted
I20260928 01:57:15.553176 24042 ts_tablet_manager.cc:1950] T 46a2ef753ec14012af179f74982c2904 P a0a57cbfb1f2438db0c398cf2786b327: Deleting consensus metadata
I20260928 01:57:15.553936 24040 tablet_bootstrap.cc:654] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:15.563831 23300 catalog_manager.cc:5063] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): tablet 46a2ef753ec14012af179f74982c2904 (table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]) successfully deleted
W20260928 01:57:15.570313 24018 flags.cc:432] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260928 01:57:15.570827 24018 flags.cc:432] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260928 01:57:15.571410 24018 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 01:57:15.571786 24018 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
I20260928 01:57:15.560575 24045 raft_consensus.cc:515] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
W20260928 01:57:15.572120 24018 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 01:57:15.572672 24018 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 01:57:15.574966 23618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c3b0cfd64819828873c7f49a75b8" candidate_uuid: "a0a57cbfb1f2438db0c398cf2786b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a3818d183894d038ea5871a360af375"
I20260928 01:57:15.575562 23618 raft_consensus.cc:3060] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:15.579581 23596 tablet_service.cc:1511] Processing CreateTablet for tablet 99e0056fd01445ce8f3df7864cbb0597 (DEFAULT_TABLE table=default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:15.580739 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e0056fd01445ce8f3df7864cbb0597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:15.581696 23742 tablet_service.cc:1511] Processing CreateTablet for tablet 99e0056fd01445ce8f3df7864cbb0597 (DEFAULT_TABLE table=default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:15.582991 23742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e0056fd01445ce8f3df7864cbb0597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:15.584116 23905 tablet_service.cc:1511] Processing CreateTablet for tablet 99e0056fd01445ce8f3df7864cbb0597 (DEFAULT_TABLE table=default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:15.585345 23905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e0056fd01445ce8f3df7864cbb0597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:15.588522 23618 raft_consensus.cc:2468] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0a57cbfb1f2438db0c398cf2786b327 in term 1.
I20260928 01:57:15.589794 23861 leader_election.cc:304] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a3818d183894d038ea5871a360af375, a0a57cbfb1f2438db0c398cf2786b327; no voters: 
I20260928 01:57:15.594045 23306 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60578:
name: "default.Table_75b96dab97844b3687d7b3ae02b47294"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:57:15.605098 24041 tablet_bootstrap.cc:492] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55: No bootstrap required, opened a new log
I20260928 01:57:15.605557 24041 ts_tablet_manager.cc:1403] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55: Time spent bootstrapping tablet: real 0.194s	user 0.012s	sys 0.006s
I20260928 01:57:15.607455 24045 leader_election.cc:290] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 election: Requested vote from peers 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427), 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985)
I20260928 01:57:15.608064 24045 raft_consensus.cc:2804] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:57:15.608137 24041 raft_consensus.cc:359] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.608999 24041 raft_consensus.cc:385] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.609261 24041 raft_consensus.cc:740] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491712372a4f491f9ba8539837899e55, State: Initialized, Role: FOLLOWER
I20260928 01:57:15.610158 24041 consensus_queue.cc:260] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.608574 24045 raft_consensus.cc:697] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 1 LEADER]: Becoming Leader. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Running, Role: LEADER
I20260928 01:57:15.622130 24040 tablet_bootstrap.cc:492] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:15.622728 24040 ts_tablet_manager.cc:1403] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.000s
I20260928 01:57:15.624727 24041 ts_tablet_manager.cc:1434] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260928 01:57:15.628089 24040 raft_consensus.cc:359] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.630157 24045 consensus_queue.cc:237] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.631321 24040 raft_consensus.cc:385] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.635588 24038 tablet_bootstrap.cc:492] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327: Bootstrap starting.
I20260928 01:57:15.636648 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c3b0cfd64819828873c7f49a75b8" candidate_uuid: "a0a57cbfb1f2438db0c398cf2786b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491712372a4f491f9ba8539837899e55"
I20260928 01:57:15.637297 23763 raft_consensus.cc:3060] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:15.643432 24038 tablet_bootstrap.cc:654] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:15.644548 24040 raft_consensus.cc:740] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:15.645368 24040 consensus_queue.cc:260] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.650303 23763 raft_consensus.cc:2468] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0a57cbfb1f2438db0c398cf2786b327 in term 1.
I20260928 01:57:15.661926 23308 master_service.cc:960] ReplaceTablet: received request to replace tablet 46a2ef753ec14012af179f74982c2904 from {username='slave'} at 127.0.0.1:60578
I20260928 01:57:15.664549 24041 tablet_bootstrap.cc:492] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55: Bootstrap starting.
I20260928 01:57:15.665681 23308 master_service.cc:960] ReplaceTablet: received request to replace tablet 46a2ef753ec14012af179f74982c2904 from {username='slave'} at 127.0.0.1:60578
I20260928 01:57:15.673262 24040 ts_tablet_manager.cc:1434] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260928 01:57:15.641640 24043 ts_tablet_manager.cc:1929] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:57:15.678458 24043 log.cc:1199] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/46a2ef753ec14012af179f74982c2904
I20260928 01:57:15.679287 24043 ts_tablet_manager.cc:1950] T 46a2ef753ec14012af179f74982c2904 P 9a3818d183894d038ea5871a360af375: Deleting consensus metadata
I20260928 01:57:15.679754 24038 tablet_bootstrap.cc:492] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327: No bootstrap required, opened a new log
I20260928 01:57:15.680171 24038 ts_tablet_manager.cc:1403] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.001s
I20260928 01:57:15.681342 24040 tablet_bootstrap.cc:492] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
I20260928 01:57:15.682689 23301 catalog_manager.cc:5063] TS 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): tablet 46a2ef753ec14012af179f74982c2904 (table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]) successfully deleted
I20260928 01:57:15.683063 24038 raft_consensus.cc:359] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.683780 24038 raft_consensus.cc:385] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.686832 24040 tablet_bootstrap.cc:654] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:15.689563 24041 tablet_bootstrap.cc:654] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:15.684057 24038 raft_consensus.cc:740] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Initialized, Role: FOLLOWER
    @     0x7f5dafeedb1c  kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260928 01:57:15.695434 24038 consensus_queue.cc:260] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.706034 23308 catalog_manager.cc:5838] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3). New cstate: current_term: 1 leader_uuid: "a0a57cbfb1f2438db0c398cf2786b327" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } health_report { overall_health: HEALTHY } } }
I20260928 01:57:15.711478 24038 ts_tablet_manager.cc:1434] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260928 01:57:15.712455 24038 tablet_bootstrap.cc:492] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327: Bootstrap starting.
I20260928 01:57:15.718044 24038 tablet_bootstrap.cc:654] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:15.724009 24018 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:36379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35181
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.60:34625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.161.60
--webserver_port=40927
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:57:15.726461 24018 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:57:15.729187 24018 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260928 01:57:15.746369 24038 tablet_bootstrap.cc:492] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327: No bootstrap required, opened a new log
I20260928 01:57:15.747025 24038 ts_tablet_manager.cc:1403] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.004s
I20260928 01:57:15.749722 24040 tablet_bootstrap.cc:492] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:15.750214 24040 ts_tablet_manager.cc:1403] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.069s	user 0.004s	sys 0.005s
I20260928 01:57:15.752408 24038 raft_consensus.cc:359] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.752902 24041 tablet_bootstrap.cc:492] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55: No bootstrap required, opened a new log
I20260928 01:57:15.753353 24041 ts_tablet_manager.cc:1403] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.005s
I20260928 01:57:15.752880 24040 raft_consensus.cc:359] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.753827 24040 raft_consensus.cc:385] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.754102 24040 raft_consensus.cc:740] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:15.756659 24038 raft_consensus.cc:385] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.757074 24038 raft_consensus.cc:740] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Initialized, Role: FOLLOWER
    @     0x7f5dafef1b92  kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260928 01:57:15.757822 24038 consensus_queue.cc:260] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.758083 24040 consensus_queue.cc:260] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.760335 24041 raft_consensus.cc:359] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.761101 24041 raft_consensus.cc:385] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.761380 24041 raft_consensus.cc:740] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491712372a4f491f9ba8539837899e55, State: Initialized, Role: FOLLOWER
I20260928 01:57:15.762800 24041 consensus_queue.cc:260] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.767122 24038 ts_tablet_manager.cc:1434] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260928 01:57:15.771268 24041 ts_tablet_manager.cc:1434] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260928 01:57:15.779767 24040 ts_tablet_manager.cc:1434] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260928 01:57:15.784997 24041 tablet_bootstrap.cc:492] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55: Bootstrap starting.
I20260928 01:57:15.807662 24041 tablet_bootstrap.cc:654] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55: Neither blocks nor log segments found. Creating new log.
    @     0x7f5dafef1b4a  _ZNSt3__18__invokeIRZN4kudu6master30HmsNotificationLogListenerTask4InitEvE3$_0JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOS6_DpOS7_ at ??:0
W20260928 01:57:15.825361 24094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:15.828720 24041 tablet_bootstrap.cc:492] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55: No bootstrap required, opened a new log
I20260928 01:57:15.829180 24041 ts_tablet_manager.cc:1403] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.007s
I20260928 01:57:15.831883 24041 raft_consensus.cc:359] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.832576 24041 raft_consensus.cc:385] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:15.832823 24041 raft_consensus.cc:740] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491712372a4f491f9ba8539837899e55, State: Initialized, Role: FOLLOWER
I20260928 01:57:15.833457 24041 consensus_queue.cc:260] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:15.839913 24041 ts_tablet_manager.cc:1434] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
    @     0x7f5dafef1ada  std::__1::__invoke_void_return_wrapper<>::__call<>() at ??:0
I20260928 01:57:15.881795 23308 master_service.cc:960] ReplaceTablet: received request to replace tablet 99e0056fd01445ce8f3df7864cbb0597 from {username='slave'} at 127.0.0.1:60578
    @     0x7f5dafef1aa2  std::__1::__function::__alloc_func<>::operator()() at ??:0
I20260928 01:57:15.906530 23305 master_service.cc:960] ReplaceTablet: received request to replace tablet 3983c3b0cfd64819828873c7f49a75b8 from {username='slave'} at 127.0.0.1:60578
I20260928 01:57:15.912252 23308 catalog_manager.cc:6133] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Sending DeleteTablet for 3 replicas of tablet 99e0056fd01445ce8f3df7864cbb0597
I20260928 01:57:15.916628 23308 catalog_manager.cc:6934] ReplaceTablet: tablet 99e0056fd01445ce8f3df7864cbb0597 deleted and replaced by tablet 3789f2ef08f44092be61a6e9dca2fc5b
I20260928 01:57:15.917618 23742 tablet_service.cc:1558] Processing DeleteTablet for tablet 99e0056fd01445ce8f3df7864cbb0597 with delete_type TABLET_DATA_DELETED (replaced by tablet 3789f2ef08f44092be61a6e9dca2fc5b) from {username='slave'} at 127.0.0.1:34098
I20260928 01:57:15.917625 23596 tablet_service.cc:1558] Processing DeleteTablet for tablet 99e0056fd01445ce8f3df7864cbb0597 with delete_type TABLET_DATA_DELETED (replaced by tablet 3789f2ef08f44092be61a6e9dca2fc5b) from {username='slave'} at 127.0.0.1:44404
I20260928 01:57:15.918573 24043 tablet_replica.cc:333] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375: stopping tablet replica
I20260928 01:57:15.919391 24043 raft_consensus.cc:2243] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:15.919633 23904 tablet_service.cc:1558] Processing DeleteTablet for tablet 99e0056fd01445ce8f3df7864cbb0597 with delete_type TABLET_DATA_DELETED (replaced by tablet 3789f2ef08f44092be61a6e9dca2fc5b) from {username='slave'} at 127.0.0.1:44074
I20260928 01:57:15.919914 24043 raft_consensus.cc:2272] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:15.920444 24042 tablet_replica.cc:333] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327: stopping tablet replica
I20260928 01:57:15.920794 24044 tablet_replica.cc:333] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55: stopping tablet replica
I20260928 01:57:15.921196 24042 raft_consensus.cc:2243] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:15.921557 24044 raft_consensus.cc:2243] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:15.921702 24042 raft_consensus.cc:2272] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:15.922035 24044 raft_consensus.cc:2272] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:15.924103 24042 ts_tablet_manager.cc:1916] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:15.927153 24043 ts_tablet_manager.cc:1916] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:15.930959 24044 ts_tablet_manager.cc:1916] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:15.940493 23305 catalog_manager.cc:6133] T 00000000000000000000000000000000 P da14a75a1a5a4cf99b25bd57d7e16148: Sending DeleteTablet for 3 replicas of tablet 3983c3b0cfd64819828873c7f49a75b8
I20260928 01:57:15.943773 23596 tablet_service.cc:1558] Processing DeleteTablet for tablet 3983c3b0cfd64819828873c7f49a75b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 8848edd1b0804f7ea69a80839d0b761e) from {username='slave'} at 127.0.0.1:44404
I20260928 01:57:15.944794 23742 tablet_service.cc:1558] Processing DeleteTablet for tablet 3983c3b0cfd64819828873c7f49a75b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 8848edd1b0804f7ea69a80839d0b761e) from {username='slave'} at 127.0.0.1:34098
I20260928 01:57:15.948549 23904 tablet_service.cc:1558] Processing DeleteTablet for tablet 3983c3b0cfd64819828873c7f49a75b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 8848edd1b0804f7ea69a80839d0b761e) from {username='slave'} at 127.0.0.1:44074
I20260928 01:57:15.949606 23305 catalog_manager.cc:6934] ReplaceTablet: tablet 3983c3b0cfd64819828873c7f49a75b8 deleted and replaced by tablet 8848edd1b0804f7ea69a80839d0b761e
I20260928 01:57:15.964170 23596 tablet_service.cc:1511] Processing CreateTablet for tablet 3789f2ef08f44092be61a6e9dca2fc5b (DEFAULT_TABLE table=default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:15.965529 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3789f2ef08f44092be61a6e9dca2fc5b. 1 dirs total, 0 dirs full, 0 dirs failed
    @     0x7f5dafef0d9e  std::__1::__function::__func<>::operator()() at ??:0
    @           0x5bd4e5  std::__1::__function::__value_func<>::operator()() at ??:?
I20260928 01:57:15.974428 24042 ts_tablet_manager.cc:1929] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:15.974844 24042 log.cc:1199] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/99e0056fd01445ce8f3df7864cbb0597
    @           0x5bd31a  std::__1::function<>::operator()() at ??:?
I20260928 01:57:15.975497 24042 ts_tablet_manager.cc:1950] T 99e0056fd01445ce8f3df7864cbb0597 P a0a57cbfb1f2438db0c398cf2786b327: Deleting consensus metadata
I20260928 01:57:15.978349 24042 tablet_replica.cc:333] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327: stopping tablet replica
I20260928 01:57:15.978698 23300 catalog_manager.cc:5063] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): tablet 99e0056fd01445ce8f3df7864cbb0597 (table default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]) successfully deleted
I20260928 01:57:15.979005 24042 raft_consensus.cc:2243] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:57:15.979784 24042 pending_rounds.cc:70] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327: Trying to abort 1 pending ops.
I20260928 01:57:15.980067 24042 pending_rounds.cc:77] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334136363559571456 op_type: NO_OP noop_request { }
I20260928 01:57:15.981406 23742 tablet_service.cc:1511] Processing CreateTablet for tablet 3789f2ef08f44092be61a6e9dca2fc5b (DEFAULT_TABLE table=default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:15.982120 24042 raft_consensus.cc:2889] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 01:57:15.982549 24042 raft_consensus.cc:2272] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:15.982739 23742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3789f2ef08f44092be61a6e9dca2fc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:15.984357 23904 tablet_service.cc:1511] Processing CreateTablet for tablet 3789f2ef08f44092be61a6e9dca2fc5b (DEFAULT_TABLE table=default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:15.984705 24042 ts_tablet_manager.cc:1916] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:15.985534 23904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3789f2ef08f44092be61a6e9dca2fc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:16.001650 24042 ts_tablet_manager.cc:1929] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:57:16.001820 24038 tablet_bootstrap.cc:492] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327: Bootstrap starting.
I20260928 01:57:16.002048 24042 log.cc:1199] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/3983c3b0cfd64819828873c7f49a75b8
I20260928 01:57:16.003103 24042 ts_tablet_manager.cc:1950] T 3983c3b0cfd64819828873c7f49a75b8 P a0a57cbfb1f2438db0c398cf2786b327: Deleting consensus metadata
I20260928 01:57:16.005860 23300 catalog_manager.cc:5063] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): tablet 3983c3b0cfd64819828873c7f49a75b8 (table default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]) successfully deleted
I20260928 01:57:16.007287 24038 tablet_bootstrap.cc:654] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:16.011843 24043 ts_tablet_manager.cc:1929] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:16.013556 24044 ts_tablet_manager.cc:1929] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:16.013988 24044 log.cc:1199] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/99e0056fd01445ce8f3df7864cbb0597
I20260928 01:57:16.014731 24044 ts_tablet_manager.cc:1950] T 99e0056fd01445ce8f3df7864cbb0597 P 491712372a4f491f9ba8539837899e55: Deleting consensus metadata
I20260928 01:57:16.017215 24044 tablet_replica.cc:333] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55: stopping tablet replica
I20260928 01:57:16.017498 23301 catalog_manager.cc:5063] TS 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): tablet 99e0056fd01445ce8f3df7864cbb0597 (table default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]) successfully deleted
I20260928 01:57:16.017848 24044 raft_consensus.cc:2243] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:16.018311 24044 raft_consensus.cc:2272] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:16.012508 24043 log.cc:1199] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/99e0056fd01445ce8f3df7864cbb0597
I20260928 01:57:16.019438 24043 ts_tablet_manager.cc:1950] T 99e0056fd01445ce8f3df7864cbb0597 P 9a3818d183894d038ea5871a360af375: Deleting consensus metadata
I20260928 01:57:16.025792 24038 tablet_bootstrap.cc:492] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327: No bootstrap required, opened a new log
I20260928 01:57:16.025974 24041 tablet_bootstrap.cc:492] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55: Bootstrap starting.
I20260928 01:57:16.026198 24038 ts_tablet_manager.cc:1403] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.004s
I20260928 01:57:16.033296 24041 tablet_bootstrap.cc:654] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:16.032938 24038 raft_consensus.cc:359] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.033597 24038 raft_consensus.cc:385] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:16.033864 24038 raft_consensus.cc:740] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Initialized, Role: FOLLOWER
I20260928 01:57:16.040725 24038 consensus_queue.cc:260] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.050619 24038 ts_tablet_manager.cc:1434] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260928 01:57:16.053508 24044 ts_tablet_manager.cc:1916] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55: Deleting tablet data with delete state TABLET_DATA_DELETED
    @     0x7f5da6f5181b  kudu::Thread::SuperviseThread() at ??:0
    @           0x4569a0  __tsan_thread_start_func at ??:?
I20260928 01:57:16.059684 24041 tablet_bootstrap.cc:492] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55: No bootstrap required, opened a new log
I20260928 01:57:16.060145 24041 ts_tablet_manager.cc:1403] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.000s
I20260928 01:57:16.062985 24041 raft_consensus.cc:359] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.063709 24041 raft_consensus.cc:385] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
    @     0x7f5da86b26db  start_thread at ??:0
I20260928 01:57:16.091238 24040 tablet_bootstrap.cc:492] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
I20260928 01:57:16.098373 24040 tablet_bootstrap.cc:654] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:16.113229 23596 tablet_service.cc:1511] Processing CreateTablet for tablet 8848edd1b0804f7ea69a80839d0b761e (DEFAULT_TABLE table=default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]), partition=RANGE (key) PARTITION UNBOUNDED
    @     0x7f5da39fd61f  clone at ??:0
I20260928 01:57:16.118474 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8848edd1b0804f7ea69a80839d0b761e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:16.123994 24044 ts_tablet_manager.cc:1929] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:16.127952 24044 log.cc:1199] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/3983c3b0cfd64819828873c7f49a75b8
I20260928 01:57:16.129329 24043 tablet_replica.cc:333] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375: stopping tablet replica
I20260928 01:57:16.129439 24044 ts_tablet_manager.cc:1950] T 3983c3b0cfd64819828873c7f49a75b8 P 491712372a4f491f9ba8539837899e55: Deleting consensus metadata
I20260928 01:57:16.130048 24043 raft_consensus.cc:2243] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:16.130647 24043 raft_consensus.cc:2272] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:16.133225 24043 ts_tablet_manager.cc:1916] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:16.063987 24041 raft_consensus.cc:740] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491712372a4f491f9ba8539837899e55, State: Initialized, Role: FOLLOWER
I20260928 01:57:16.145478 24041 consensus_queue.cc:260] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.147377 24041 ts_tablet_manager.cc:1434] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.000s
I20260928 01:57:16.149961 24043 ts_tablet_manager.cc:1929] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:16.150354 24043 log.cc:1199] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/3983c3b0cfd64819828873c7f49a75b8
I20260928 01:57:16.151113 24043 ts_tablet_manager.cc:1950] T 3983c3b0cfd64819828873c7f49a75b8 P 9a3818d183894d038ea5871a360af375: Deleting consensus metadata
I20260928 01:57:16.155292 24040 tablet_bootstrap.cc:492] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:16.155728 24040 ts_tablet_manager.cc:1403] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.003s
I20260928 01:57:16.181476 24040 raft_consensus.cc:359] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.182309 24040 raft_consensus.cc:385] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:16.182621 24040 raft_consensus.cc:740] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:16.183388 24040 consensus_queue.cc:260] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.203555 24040 ts_tablet_manager.cc:1434] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.004s
I20260928 01:57:16.222934 24040 tablet_bootstrap.cc:492] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
I20260928 01:57:16.229004 24040 tablet_bootstrap.cc:654] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:16.243633 24040 tablet_bootstrap.cc:492] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:16.244112 24040 ts_tablet_manager.cc:1403] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.001s
I20260928 01:57:16.247175 24040 raft_consensus.cc:359] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.247838 24040 raft_consensus.cc:385] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:16.248121 24040 raft_consensus.cc:740] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:16.254788 24040 consensus_queue.cc:260] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.259313 24040 ts_tablet_manager.cc:1434] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260928 01:57:16.385522 24074 raft_consensus.cc:493] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:16.386077 24074 raft_consensus.cc:515] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.388409 24074 leader_election.cc:290] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:16.390056 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9539f778114077b285d0fdc89d03e2" candidate_uuid: "9a3818d183894d038ea5871a360af375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0a57cbfb1f2438db0c398cf2786b327" is_pre_election: true
I20260928 01:57:16.390435 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9539f778114077b285d0fdc89d03e2" candidate_uuid: "9a3818d183894d038ea5871a360af375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491712372a4f491f9ba8539837899e55" is_pre_election: true
I20260928 01:57:16.390723 23925 raft_consensus.cc:2468] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a3818d183894d038ea5871a360af375 in term 0.
I20260928 01:57:16.391095 23763 raft_consensus.cc:2468] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a3818d183894d038ea5871a360af375 in term 0.
I20260928 01:57:16.392295 23552 leader_election.cc:304] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a3818d183894d038ea5871a360af375, a0a57cbfb1f2438db0c398cf2786b327; no voters: 
I20260928 01:57:16.397926 24074 raft_consensus.cc:2804] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:57:16.398350 24074 raft_consensus.cc:493] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:57:16.398677 24074 raft_consensus.cc:3060] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:16.411314 24074 raft_consensus.cc:515] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.416942 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9539f778114077b285d0fdc89d03e2" candidate_uuid: "9a3818d183894d038ea5871a360af375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491712372a4f491f9ba8539837899e55"
I20260928 01:57:16.417686 23763 raft_consensus.cc:3060] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:16.427939 23763 raft_consensus.cc:2468] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a3818d183894d038ea5871a360af375 in term 1.
I20260928 01:57:16.431360 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9539f778114077b285d0fdc89d03e2" candidate_uuid: "9a3818d183894d038ea5871a360af375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0a57cbfb1f2438db0c398cf2786b327"
I20260928 01:57:16.432062 23925 raft_consensus.cc:3060] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:16.441874 23925 raft_consensus.cc:2468] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a3818d183894d038ea5871a360af375 in term 1.
I20260928 01:57:16.442586 24074 leader_election.cc:290] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 election: Requested vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:16.444625 23553 leader_election.cc:304] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375; no voters: 
I20260928 01:57:16.445981 24074 raft_consensus.cc:2804] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:57:16.454586 24074 raft_consensus.cc:697] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 1 LEADER]: Becoming Leader. State: Replica: 9a3818d183894d038ea5871a360af375, State: Running, Role: LEADER
I20260928 01:57:16.456066 24074 consensus_queue.cc:237] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.472715 24051 raft_consensus.cc:493] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:16.473341 24051 raft_consensus.cc:515] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.475741 24051 leader_election.cc:290] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427), a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:16.477571 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789f2ef08f44092be61a6e9dca2fc5b" candidate_uuid: "491712372a4f491f9ba8539837899e55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0a57cbfb1f2438db0c398cf2786b327" is_pre_election: true
I20260928 01:57:16.478232 23925 raft_consensus.cc:2468] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491712372a4f491f9ba8539837899e55 in term 0.
I20260928 01:57:16.478636 23618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789f2ef08f44092be61a6e9dca2fc5b" candidate_uuid: "491712372a4f491f9ba8539837899e55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a3818d183894d038ea5871a360af375" is_pre_election: true
I20260928 01:57:16.479328 23618 raft_consensus.cc:2468] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491712372a4f491f9ba8539837899e55 in term 0.
I20260928 01:57:16.480679 23698 leader_election.cc:304] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491712372a4f491f9ba8539837899e55, a0a57cbfb1f2438db0c398cf2786b327; no voters: 
I20260928 01:57:16.485128 24051 raft_consensus.cc:2804] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:57:16.485852 24051 raft_consensus.cc:493] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:57:16.486352 24051 raft_consensus.cc:3060] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:16.495903 24051 raft_consensus.cc:515] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.499740 23618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789f2ef08f44092be61a6e9dca2fc5b" candidate_uuid: "491712372a4f491f9ba8539837899e55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a3818d183894d038ea5871a360af375"
I20260928 01:57:16.500464 23618 raft_consensus.cc:3060] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:16.509112 23618 raft_consensus.cc:2468] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491712372a4f491f9ba8539837899e55 in term 1.
I20260928 01:57:16.512128 23925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3789f2ef08f44092be61a6e9dca2fc5b" candidate_uuid: "491712372a4f491f9ba8539837899e55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0a57cbfb1f2438db0c398cf2786b327"
I20260928 01:57:16.512863 23925 raft_consensus.cc:3060] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:16.520733 23925 raft_consensus.cc:2468] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491712372a4f491f9ba8539837899e55 in term 1.
I20260928 01:57:16.522511 23699 leader_election.cc:304] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375; no voters: 
I20260928 01:57:16.530225 24051 leader_election.cc:290] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [CANDIDATE]: Term 1 election: Requested vote from peers 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427), a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:16.531756 24051 raft_consensus.cc:2804] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:57:16.533090 24051 raft_consensus.cc:697] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 1 LEADER]: Becoming Leader. State: Replica: 491712372a4f491f9ba8539837899e55, State: Running, Role: LEADER
I20260928 01:57:16.534806 24051 consensus_queue.cc:237] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
I20260928 01:57:16.537185 24074 raft_consensus.cc:493] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:16.537746 24074 raft_consensus.cc:515] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } }
W20260928 01:57:16.542927 23553 leader_election.cc:343] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 8848edd1b0804f7ea69a80839d0b761e
I20260928 01:57:16.540012 24074 leader_election.cc:290] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
W20260928 01:57:16.546211 23552 leader_election.cc:343] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): Not found: Tablet not found: 8848edd1b0804f7ea69a80839d0b761e
I20260928 01:57:16.546728 23552 leader_election.cc:304] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a3818d183894d038ea5871a360af375; no voters: 491712372a4f491f9ba8539837899e55, a0a57cbfb1f2438db0c398cf2786b327
I20260928 01:57:16.548157 24074 raft_consensus.cc:2749] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:57:16.620966 24122 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:16.621634 24122 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:16.624661 24122 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
W20260928 01:57:16.659889 23225 leader_election.cc:336] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625): Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
W20260928 01:57:16.693434 23551 connection.cc:573] server connection from 127.0.0.1:44404 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:57:16.694761 23983 connection.cc:573] client connection to 127.18.161.61:43177 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:57:16.697392 23983 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.18.161.61:43177)
W20260928 01:57:16.698329 23983 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.18.161.61:43177)
W20260928 01:57:16.699062 23983 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.18.161.61:43177)
W20260928 01:57:16.708897 23983 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.18.161.61:43177)
W20260928 01:57:16.715492 23699 connection.cc:573] client connection to 127.18.161.61:43177 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:57:16.716235 23697 connection.cc:573] server connection from 127.0.0.1:34098 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:57:16.717068 23553 connection.cc:573] client connection to 127.18.161.61:43177 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:57:16.718396 23227 connection.cc:573] client connection to 127.18.161.61:43177 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:57:16.724170 24065 negotiation.cc:336] Failed RPC negotiation. Trace:
0928 01:57:16.718999 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.18.161.61:43177 (local address 127.18.161.1:40299)
0928 01:57:16.719933 (+   934us) negotiation.cc:107] Waiting for socket to connect
0928 01:57:16.719989 (+    56us) client_negotiation.cc:175] Beginning negotiation
0928 01:57:16.720426 (+   437us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0928 01:57:16.722988 (+  2562us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":353}
W20260928 01:57:16.727144 24123 negotiation.cc:336] Failed RPC negotiation. Trace:
0928 01:57:16.720507 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.18.161.61:43177 (local address 127.0.0.1:36914)
0928 01:57:16.721499 (+   992us) negotiation.cc:107] Waiting for socket to connect
0928 01:57:16.721547 (+    48us) client_negotiation.cc:175] Beginning negotiation
0928 01:57:16.721894 (+   347us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0928 01:57:16.726112 (+  4218us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":392}
W20260928 01:57:16.727651 24126 negotiation.cc:336] Failed RPC negotiation. Trace:
0928 01:57:16.717590 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.18.161.61:43177 (local address 127.0.0.1:36910)
0928 01:57:16.725829 (+  8239us) negotiation.cc:107] Waiting for socket to connect
0928 01:57:16.726050 (+   221us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":7647,"threads_started":1}
W20260928 01:57:16.728102 23227 leader_election.cc:336] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 01:57:16.728703 23227 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1; no voters: 8432e2c39e50435788e612e49a0045ed, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:16.729631 24122 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260928 01:57:16.731634 24081 negotiation.cc:336] Failed RPC negotiation. Trace:
0928 01:57:16.721200 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.18.161.61:43177 (local address 127.18.161.2:36521)
0928 01:57:16.722196 (+   996us) negotiation.cc:107] Waiting for socket to connect
0928 01:57:16.722240 (+    44us) client_negotiation.cc:175] Beginning negotiation
0928 01:57:16.722493 (+   253us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0928 01:57:16.730621 (+  8128us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":379}
I20260928 01:57:17.327396 24128 consensus_queue.cc:1048] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:57:17.404677 24132 consensus_queue.cc:1048] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 01:57:17.443500 24138 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:17.444458 24138 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:17.468434 24129 consensus_queue.cc:1048] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:57:17.558243 24138 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:17.636469 24129 consensus_queue.cc:1048] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 01:57:17.652774 23225 leader_election.cc:336] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625): Network error: Client connection negotiation failed: client connection to 127.18.161.60:34625: connect: Connection refused (error 111)
W20260928 01:57:17.659912 23227 leader_election.cc:336] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:17.661494 23227 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1; no voters: 8432e2c39e50435788e612e49a0045ed, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:17.684500 24138 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260928 01:57:17.160563 24093 debug-util.cc:398] Leaking SignalData structure 0x7b08000283c0 after lost signal to thread 24018
W20260928 01:57:17.856598 24093 kernel_stack_watchdog.cc:198] Thread 24018 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 304ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260928 01:57:15.854259 24096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:57:17.857968 24018 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.004s	user 0.597s	sys 0.840s
W20260928 01:57:17.858306 24018 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.004s	user 0.597s	sys 0.840s
W20260928 01:57:17.859225 24099 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2005 milliseconds
W20260928 01:57:17.859777 24101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:17.859799 24018 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 01:57:17.864352 24018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:57:17.868829 24018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:57:17.870290 24018 hybrid_clock.cc:648] HybridClock initialized: now 1790560637870204 us; error 100 us; skew 500 ppm
I20260928 01:57:17.871306 24018 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:57:17.880020 24018 webserver.cc:533] Webserver started at http://127.18.161.60:40927/ using document root <none> and password file <none>
I20260928 01:57:17.880995 24018 fs_manager.cc:362] Metadata directory not provided
I20260928 01:57:17.881233 24018 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:57:17.889511 24018 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260928 01:57:17.894469 24153 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:17.895622 24018 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260928 01:57:17.895995 24018 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
uuid: "8432e2c39e50435788e612e49a0045ed"
format_stamp: "Formatted at 2026-09-28 01:57:03 on dist-test-slave-lrdp"
I20260928 01:57:17.898010 24018 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:57:17.966341 24018 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:57:17.967871 24018 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:57:17.968354 24018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:57:18.047442 24018 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.60:34625
I20260928 01:57:18.047515 24204 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.60:34625 every 8 connection(s)
I20260928 01:57:18.050477 24018 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
I20260928 01:57:18.052592 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 24018
I20260928 01:57:18.063884 24205 sys_catalog.cc:263] Verifying existing consensus state
I20260928 01:57:18.070959 24205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Bootstrap starting.
I20260928 01:57:18.086292 24205 log.cc:826] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Log is configured to *not* fsync() on all Append() calls
I20260928 01:57:18.104954 23663 heartbeater.cc:344] Connected to a master server at 127.18.161.60:34625
I20260928 01:57:18.110899 24205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 01:57:18.111696 24205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Bootstrap complete.
I20260928 01:57:18.138505 24205 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:18.141882 24205 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8432e2c39e50435788e612e49a0045ed, State: Initialized, Role: FOLLOWER
I20260928 01:57:18.142830 24205 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:18.145519 24211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:18.146198 24211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:18.147146 24205 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: configured and running, proceeding with master startup.
I20260928 01:57:18.194056 23970 heartbeater.cc:344] Connected to a master server at 127.18.161.60:34625
I20260928 01:57:18.194720 23970 heartbeater.cc:499] Master 127.18.161.60:34625 was elected leader, sending a full tablet report...
I20260928 01:57:18.215535 24170 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" instance_seqno: 1790560632908893) as {username='slave'} at 127.18.161.3:38069; Asking this server to re-register.
I20260928 01:57:18.218698 23970 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:18.224329 24170 ts_manager.cc:194] Registered new tserver with Master: a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:18.242427 23808 heartbeater.cc:344] Connected to a master server at 127.18.161.60:34625
I20260928 01:57:18.248914 24169 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "491712372a4f491f9ba8539837899e55" instance_seqno: 1790560630417927) as {username='slave'} at 127.18.161.2:54683; Asking this server to re-register.
I20260928 01:57:18.251497 23808 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:18.255541 24170 ts_manager.cc:194] Registered new tserver with Master: 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985)
I20260928 01:57:18.262878 24226 catalog_manager.cc:1308] Loaded cluster ID: 277aae6cb6dd46069169192caa8b9479
I20260928 01:57:18.263175 24226 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: success
I20260928 01:57:18.271231 24226 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: acquiring CA information for follower catalog manager: success
I20260928 01:57:18.277859 23663 heartbeater.cc:344] Connected to a master server at 127.18.161.60:34625
I20260928 01:57:18.284513 24170 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9a3818d183894d038ea5871a360af375" instance_seqno: 1790560628472462) as {username='slave'} at 127.18.161.1:39615; Asking this server to re-register.
I20260928 01:57:18.286480 23663 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:18.288594 24226 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 01:57:18.293769 24170 ts_manager.cc:194] Registered new tserver with Master: 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
I20260928 01:57:18.272076 24018 master_runner.cc:187] Error getting master registration for 127.18.161.61:43177: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111), 
I20260928 01:57:18.299080 24018 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:57:18.537015 24211 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:18.537596 24211 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:18.542197 23249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8432e2c39e50435788e612e49a0045ed" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8048303ef62e4a52b5323fe35f42c7f1" is_pre_election: true
I20260928 01:57:18.543036 23249 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8432e2c39e50435788e612e49a0045ed in current term 5: Already voted for candidate da14a75a1a5a4cf99b25bd57d7e16148 in this term.
I20260928 01:57:18.543756 24211 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:57:18.545409 24157 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:18.556107 24241 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:18.558363 24241 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
W20260928 01:57:18.561533 24157 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:18.562041 24157 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:18.563643 24211 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 4 FOLLOWER]: Advancing to term 5
I20260928 01:57:18.574538 24211 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260928 01:57:18.577854 23227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111) [suppressed 4 similar messages]
I20260928 01:57:18.585350 24241 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:18.593542 24180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 31 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed" is_pre_election: true
I20260928 01:57:18.594547 24180 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8048303ef62e4a52b5323fe35f42c7f1 in term 5.
W20260928 01:57:18.594938 23227 leader_election.cc:336] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:18.595922 23225 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1, 8432e2c39e50435788e612e49a0045ed; no voters: da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:18.596624 24241 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260928 01:57:18.596947 24241 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader da14a75a1a5a4cf99b25bd57d7e16148)
I20260928 01:57:18.597241 24241 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 5 FOLLOWER]: Advancing to term 6
I20260928 01:57:18.602761 24241 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:18.605563 24241 leader_election.cc:290] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 election: Requested vote from peers da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177), 8432e2c39e50435788e612e49a0045ed (127.18.161.60:34625)
I20260928 01:57:18.607290 24180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8048303ef62e4a52b5323fe35f42c7f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 31 } } ignore_live_leader: false dest_uuid: "8432e2c39e50435788e612e49a0045ed"
I20260928 01:57:18.607879 24180 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 5 FOLLOWER]: Advancing to term 6
W20260928 01:57:18.608419 23227 leader_election.cc:336] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:18.615006 24180 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8048303ef62e4a52b5323fe35f42c7f1 in term 6.
I20260928 01:57:18.616429 23225 leader_election.cc:304] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8048303ef62e4a52b5323fe35f42c7f1, 8432e2c39e50435788e612e49a0045ed; no voters: da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:18.617290 24241 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260928 01:57:18.618453 24241 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [term 6 LEADER]: Becoming Leader. State: Replica: 8048303ef62e4a52b5323fe35f42c7f1, State: Running, Role: LEADER
I20260928 01:57:18.619225 24241 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 5.31, Last appended by leader: 31, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:18.623163 24246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8048303ef62e4a52b5323fe35f42c7f1. Latest consensus state: current_term: 6 leader_uuid: "8048303ef62e4a52b5323fe35f42c7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:18.624068 24246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: This master's current role is: LEADER
I20260928 01:57:18.625756 24248 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 01:57:18.636050 24248 catalog_manager.cc:692] Loaded metadata for table default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]
I20260928 01:57:18.637739 24248 catalog_manager.cc:692] Loaded metadata for table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]
I20260928 01:57:18.639119 24248 catalog_manager.cc:692] Loaded metadata for table default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4]
I20260928 01:57:18.645046 24248 tablet_loader.cc:96] loaded metadata for tablet 1f9539f778114077b285d0fdc89d03e2 (table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac])
I20260928 01:57:18.646427 24248 tablet_loader.cc:96] loaded metadata for tablet 3789f2ef08f44092be61a6e9dca2fc5b (table default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202])
I20260928 01:57:18.647650 24248 tablet_loader.cc:96] loaded metadata for tablet 8848edd1b0804f7ea69a80839d0b761e (table default.table_d087778a98124fd9b1370342150d18a5 [id=78e56f2b2bf04dc1bccffafe7dedacf4])
I20260928 01:57:18.648862 24248 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 01:57:18.652467 24248 catalog_manager.cc:1308] Loaded cluster ID: 277aae6cb6dd46069169192caa8b9479
I20260928 01:57:18.652691 24248 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 01:57:18.656591 24248 catalog_manager.cc:1553] Loading token signing keys...
I20260928 01:57:18.660149 24248 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: Loaded TSK: 0
I20260928 01:57:18.661249 24248 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 01:57:18.665010 24248 catalog_manager.cc:1576] Loading latest processed Hive Metastore notification log event ID...
I20260928 01:57:18.668303 24248 catalog_manager.cc:6068] Last processed Hive Metastore notification event ID: -1
I20260928 01:57:18.711687 23240 master_service.cc:960] ReplaceTablet: received request to replace tablet 3789f2ef08f44092be61a6e9dca2fc5b from {username='slave'} at 127.0.0.1:49492
I20260928 01:57:18.711676 23239 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49492:
table { table_name: "default.Table_262ead9bd95a4b4cbbd3d3a7638fad4a" } modify_external_catalogs: true
I20260928 01:57:18.712947 23239 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49492:
table { table_name: "default.Table_262ead9bd95a4b4cbbd3d3a7638fad4a" } modify_external_catalogs: true
I20260928 01:57:18.712803 23238 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49492:
name: "default.Table_e8b07c013ec14343bdd6906db9b0a226"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:57:18.713054 23237 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49492:
name: "default.Table_75b96dab97844b3687d7b3ae02b47294"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:57:18.716711 23236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49492:
name: "default.Table_d62a30d9cd9a4fe79add980f59e96a10"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260928 01:57:18.717545 23235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49492:
table { table_name: "default.Table_58bb4859bd884293a75a2560c92d8dda" } new_table_name: "default.Table_0e18caa3dbdd41b38d8484c2a81273b2" modify_external_catalogs: true
I20260928 01:57:18.719906 23234 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f9539f778114077b285d0fdc89d03e2 from {username='slave'} at 127.0.0.1:49492
I20260928 01:57:18.721975 23233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49492:
table { table_name: "default.Table_d087778a98124fd9b1370342150d18a5" } new_table_name: "default.Table_97908585a82d4a63a22cf8bcb884724e" modify_external_catalogs: true
I20260928 01:57:18.722934 23232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49492:
name: "default.Table_70d24315c2244ddbb12a5e14b6db18e7"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
F20260928 01:57:18.729156 23455 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 4 received events: NotificationEvent(eventId=1, eventTime=1790560633, eventType=CREATE_TABLE, dbName=default, tableName=table_65cea13c8a8b405bb606a477b84c212e, message={"server":"","servicePrincipal":"","db":"default","table":"table_65cea13c8a8b405bb606a477b84c212e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_65cea13c8a8b405bb606a477b84c212e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790560633},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/warehouse/table_65cea13c8a8b405bb606a477b84c212e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_65cea13c8a8b405bb606a477b84c212e\",\"kudu.table_id\":\"200ff1976677485ca98559a5415f77d8\",\"transient_lastDdlTime\":\"1790560633\",\"comment\":\"\",\"kudu.master_addresses\":\"127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"277aae6cb6dd46069169192caa8b9479\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790560633,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1790560633, eventType=CREATE_TABLE, dbName=default, tableName=table_d087778a98124fd9b1370342150d18a5, message={"server":"","servicePrincipal":"","db":"default","table":"table_d087778a98124fd9b1370342150d18a5","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_d087778a98124fd9b1370342150d18a5\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1790560633},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/warehouse/table_d087778a98124fd9b1370342150d18a5\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_d087778a98124fd9b1370342150d18a5\",\"kudu.table_id\":\"78e56f2b2bf04dc1bccffafe7dedacf4\",\"transient_lastDdlTime\":\"1790560633\",\"comment\":\"\",\"kudu.master_addresses\":\"127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"277aae6cb6dd46069169192caa8b9479\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1790560633,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260928 01:57:18.731845 24180 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Refusing update from remote peer 8048303ef62e4a52b5323fe35f42c7f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 33. (index mismatch)
I20260928 01:57:18.734824 24246 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 6, Time since last communication: 0.000s
W20260928 01:57:18.740399 23227 consensus_peers.cc:597] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 -> Peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Couldn't send request to peer da14a75a1a5a4cf99b25bd57d7e16148. Status: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
    @     0x7f47fc0e6920  google::LogMessage::Flush() at ??:0
    @     0x7f47fc0e668f  google::LogMessage::~LogMessage() at ??:0
    @     0x7f480727935c  kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260928 01:57:18.798066 24254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "8048303ef62e4a52b5323fe35f42c7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:18.798820 24254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:18.799491 24211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8048303ef62e4a52b5323fe35f42c7f1. Latest consensus state: current_term: 6 leader_uuid: "8048303ef62e4a52b5323fe35f42c7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:18.800179 24211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:18.807808 24249 mvcc.cc:204] Tried to move back new op lower bound from 7334136376229814272 to 7334136375792091136. Current Snapshot: MvccSnapshot[applied={T|T < 7334136376229814272}]
I20260928 01:57:18.811417 24211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "8048303ef62e4a52b5323fe35f42c7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:18.812176 24211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:18.817643 24246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "8048303ef62e4a52b5323fe35f42c7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:18.818339 24246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1 [sys.catalog]: This master's current role is: LEADER
I20260928 01:57:18.821967 23240 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: Sending DeleteTablet for 3 replicas of tablet 3789f2ef08f44092be61a6e9dca2fc5b
I20260928 01:57:18.848161 23234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: Sending DeleteTablet for 3 replicas of tablet 1f9539f778114077b285d0fdc89d03e2
I20260928 01:57:18.850061 23234 catalog_manager.cc:6934] ReplaceTablet: tablet 1f9539f778114077b285d0fdc89d03e2 deleted and replaced by tablet baa15f4cdf074b7797360c0981dfff4d
I20260928 01:57:18.855016 23240 catalog_manager.cc:6934] ReplaceTablet: tablet 3789f2ef08f44092be61a6e9dca2fc5b deleted and replaced by tablet 746096ed34b9482184bd12363587f36f
    @     0x7f4807278b1c  kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260928 01:57:18.876909 23665 heartbeater.cc:499] Master 127.18.161.62:36529 was elected leader, sending a full tablet report...
I20260928 01:57:18.903729 23904 tablet_service.cc:1558] Processing DeleteTablet for tablet 3789f2ef08f44092be61a6e9dca2fc5b with delete_type TABLET_DATA_DELETED (replaced by tablet 746096ed34b9482184bd12363587f36f) from {username='slave'} at 127.0.0.1:36274
I20260928 01:57:18.904314 23903 tablet_service.cc:1511] Processing CreateTablet for tablet 746096ed34b9482184bd12363587f36f (DEFAULT_TABLE table=default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:18.904762 23905 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f9539f778114077b285d0fdc89d03e2 with delete_type TABLET_DATA_DELETED (replaced by tablet baa15f4cdf074b7797360c0981dfff4d) from {username='slave'} at 127.0.0.1:36274
I20260928 01:57:18.905635 23903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746096ed34b9482184bd12363587f36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:18.909890 23905 tablet_service.cc:1511] Processing CreateTablet for tablet baa15f4cdf074b7797360c0981dfff4d (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:18.911109 23905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa15f4cdf074b7797360c0981dfff4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:18.933077 24265 tablet_replica.cc:333] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327: stopping tablet replica
I20260928 01:57:18.940820 23596 tablet_service.cc:1558] Processing DeleteTablet for tablet 3789f2ef08f44092be61a6e9dca2fc5b with delete_type TABLET_DATA_DELETED (replaced by tablet 746096ed34b9482184bd12363587f36f) from {username='slave'} at 127.0.0.1:37758
I20260928 01:57:18.940917 24265 raft_consensus.cc:2243] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:18.941304 23598 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f9539f778114077b285d0fdc89d03e2 with delete_type TABLET_DATA_DELETED (replaced by tablet baa15f4cdf074b7797360c0981dfff4d) from {username='slave'} at 127.0.0.1:37758
I20260928 01:57:18.941471 24265 raft_consensus.cc:2272] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:18.943152 23598 tablet_service.cc:1511] Processing CreateTablet for tablet 746096ed34b9482184bd12363587f36f (DEFAULT_TABLE table=default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:18.945595 23598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746096ed34b9482184bd12363587f36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:18.948405 24267 tablet_replica.cc:333] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375: stopping tablet replica
I20260928 01:57:18.949820 24267 raft_consensus.cc:2243] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:18.949594 23596 tablet_service.cc:1511] Processing CreateTablet for tablet baa15f4cdf074b7797360c0981dfff4d (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:18.951745 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa15f4cdf074b7797360c0981dfff4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:18.964349 24265 ts_tablet_manager.cc:1916] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:18.964572 24267 raft_consensus.cc:2272] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:18.967216 24267 ts_tablet_manager.cc:1916] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:18.968343 24250 mvcc.cc:204] Tried to move back new op lower bound from 7334136376229814272 to 7334136354225537024. Current Snapshot: MvccSnapshot[applied={T|T < 7334136376229814272 or (T in {7334136376229814272})}]
I20260928 01:57:18.978503 24266 tablet_bootstrap.cc:492] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327: Bootstrap starting.
I20260928 01:57:18.986392 24268 tablet_bootstrap.cc:492] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
I20260928 01:57:18.988878 23742 tablet_service.cc:1558] Processing DeleteTablet for tablet 3789f2ef08f44092be61a6e9dca2fc5b with delete_type TABLET_DATA_DELETED (replaced by tablet 746096ed34b9482184bd12363587f36f) from {username='slave'} at 127.0.0.1:50652
I20260928 01:57:18.995334 24268 tablet_bootstrap.cc:654] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:18.996546 23743 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f9539f778114077b285d0fdc89d03e2 with delete_type TABLET_DATA_DELETED (replaced by tablet baa15f4cdf074b7797360c0981dfff4d) from {username='slave'} at 127.0.0.1:50652
I20260928 01:57:18.997380 23741 tablet_service.cc:1511] Processing CreateTablet for tablet 746096ed34b9482184bd12363587f36f (DEFAULT_TABLE table=default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:18.999823 23741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746096ed34b9482184bd12363587f36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:19.002075 24267 ts_tablet_manager.cc:1929] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:57:19.009560 23743 tablet_service.cc:1511] Processing CreateTablet for tablet baa15f4cdf074b7797360c0981dfff4d (DEFAULT_TABLE table=default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 01:57:19.009992 24267 log.cc:1199] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/3789f2ef08f44092be61a6e9dca2fc5b
I20260928 01:57:19.011086 23743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa15f4cdf074b7797360c0981dfff4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 01:57:19.011066 24267 ts_tablet_manager.cc:1950] T 3789f2ef08f44092be61a6e9dca2fc5b P 9a3818d183894d038ea5871a360af375: Deleting consensus metadata
I20260928 01:57:19.011833 24269 tablet_replica.cc:333] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55: stopping tablet replica
I20260928 01:57:19.012957 24269 raft_consensus.cc:2243] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:57:19.014287 23227 catalog_manager.cc:5063] TS 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): tablet 3789f2ef08f44092be61a6e9dca2fc5b (table default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]) successfully deleted
I20260928 01:57:19.014706 24269 raft_consensus.cc:2272] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55 [term 1 FOLLOWER]: Raft consensus is shut down!
    @     0x7f480727cb92  kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260928 01:57:19.018534 24267 tablet_replica.cc:333] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375: stopping tablet replica
I20260928 01:57:19.019227 24267 raft_consensus.cc:2243] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 1 LEADER]: Raft consensus shutting down.
I20260928 01:57:19.020270 24267 raft_consensus.cc:2272] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:19.022317 24267 ts_tablet_manager.cc:1916] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:19.036398 24266 tablet_bootstrap.cc:654] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:19.046283 24268 tablet_bootstrap.cc:492] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:19.046872 24268 ts_tablet_manager.cc:1403] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.015s
I20260928 01:57:19.049503 24266 tablet_bootstrap.cc:492] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327: No bootstrap required, opened a new log
I20260928 01:57:19.050102 24266 ts_tablet_manager.cc:1403] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.002s
    @     0x7f480727cb4a  _ZNSt3__18__invokeIRZN4kudu6master30HmsNotificationLogListenerTask4InitEvE3$_0JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOS6_DpOS7_ at ??:0
I20260928 01:57:19.050573 24268 raft_consensus.cc:359] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:57:19.067103 24268 raft_consensus.cc:385] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:19.067425 24268 raft_consensus.cc:740] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:19.044121 24265 ts_tablet_manager.cc:1929] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:57:19.068761 24265 log.cc:1199] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/3789f2ef08f44092be61a6e9dca2fc5b
I20260928 01:57:19.063526 24266 raft_consensus.cc:359] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:57:19.069718 24265 ts_tablet_manager.cc:1950] T 3789f2ef08f44092be61a6e9dca2fc5b P a0a57cbfb1f2438db0c398cf2786b327: Deleting consensus metadata
I20260928 01:57:19.069902 24266 raft_consensus.cc:385] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:19.070209 24266 raft_consensus.cc:740] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Initialized, Role: FOLLOWER
I20260928 01:57:19.071600 24269 ts_tablet_manager.cc:1916] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:19.072062 24266 consensus_queue.cc:260] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:57:19.084492 24268 consensus_queue.cc:260] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:57:19.087540 24265 tablet_replica.cc:333] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327: stopping tablet replica
I20260928 01:57:19.090212 24265 raft_consensus.cc:2243] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:19.090858 24265 raft_consensus.cc:2272] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:19.093106 24265 ts_tablet_manager.cc:1916] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:19.106012 24277 tablet_bootstrap.cc:492] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55: Bootstrap starting.
I20260928 01:57:19.112876 23226 catalog_manager.cc:5063] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): tablet 3789f2ef08f44092be61a6e9dca2fc5b (table default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]) successfully deleted
I20260928 01:57:19.115876 24268 ts_tablet_manager.cc:1434] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.069s	user 0.011s	sys 0.002s
I20260928 01:57:19.116966 24268 tablet_bootstrap.cc:492] T baa15f4cdf074b7797360c0981dfff4d P 9a3818d183894d038ea5871a360af375: Bootstrap starting.
I20260928 01:57:19.120820 23972 heartbeater.cc:499] Master 127.18.161.62:36529 was elected leader, sending a full tablet report...
W20260928 01:57:19.129014 23231 catalog_manager.cc:5671] Ignoring report from unknown tablet 1f9539f778114077b285d0fdc89d03e2
I20260928 01:57:19.134588 24269 ts_tablet_manager.cc:1929] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:57:19.137027 24267 ts_tablet_manager.cc:1929] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:57:19.138942 23234 master_service.cc:960] ReplaceTablet: received request to replace tablet 8848edd1b0804f7ea69a80839d0b761e from {username='slave'} at 127.0.0.1:49492
I20260928 01:57:19.139128 23240 master_service.cc:960] ReplaceTablet: received request to replace tablet 746096ed34b9482184bd12363587f36f from {username='slave'} at 127.0.0.1:49492
I20260928 01:57:19.140530 24267 log.cc:1199] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/1f9539f778114077b285d0fdc89d03e2
I20260928 01:57:19.141160 24268 tablet_bootstrap.cc:654] T baa15f4cdf074b7797360c0981dfff4d P 9a3818d183894d038ea5871a360af375: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:19.141486 24267 ts_tablet_manager.cc:1950] T 1f9539f778114077b285d0fdc89d03e2 P 9a3818d183894d038ea5871a360af375: Deleting consensus metadata
    @     0x7f480727cada  std::__1::__invoke_void_return_wrapper<>::__call<>() at ??:0
I20260928 01:57:19.153457 24269 log.cc:1199] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/3789f2ef08f44092be61a6e9dca2fc5b
I20260928 01:57:19.153646 23227 catalog_manager.cc:5063] TS 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): tablet 1f9539f778114077b285d0fdc89d03e2 (table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]) successfully deleted
I20260928 01:57:19.154479 24269 ts_tablet_manager.cc:1950] T 3789f2ef08f44092be61a6e9dca2fc5b P 491712372a4f491f9ba8539837899e55: Deleting consensus metadata
I20260928 01:57:19.154757 24265 ts_tablet_manager.cc:1929] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:57:19.155148 24265 log.cc:1199] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-2/wal/wals/1f9539f778114077b285d0fdc89d03e2
I20260928 01:57:19.155892 24265 ts_tablet_manager.cc:1950] T 1f9539f778114077b285d0fdc89d03e2 P a0a57cbfb1f2438db0c398cf2786b327: Deleting consensus metadata
I20260928 01:57:19.143085 24277 tablet_bootstrap.cc:654] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:19.160552 23227 catalog_manager.cc:5063] TS 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): tablet 3789f2ef08f44092be61a6e9dca2fc5b (table default.table_262ead9bd95a4b4cbbd3d3a7638fad4a [id=1c99922d8a164ecb8ba673c96f1dc202]) successfully deleted
I20260928 01:57:19.160993 24269 tablet_replica.cc:333] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55: stopping tablet replica
I20260928 01:57:19.161667 24269 raft_consensus.cc:2243] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:19.162250 24269 raft_consensus.cc:2272] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:19.170013 24268 tablet_bootstrap.cc:492] T baa15f4cdf074b7797360c0981dfff4d P 9a3818d183894d038ea5871a360af375: No bootstrap required, opened a new log
I20260928 01:57:19.170480 24268 ts_tablet_manager.cc:1403] T baa15f4cdf074b7797360c0981dfff4d P 9a3818d183894d038ea5871a360af375: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.000s
I20260928 01:57:19.171083 24269 ts_tablet_manager.cc:1916] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:19.173487 24268 raft_consensus.cc:359] T baa15f4cdf074b7797360c0981dfff4d P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } }
I20260928 01:57:19.176383 24277 tablet_bootstrap.cc:492] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55: No bootstrap required, opened a new log
I20260928 01:57:19.176879 24277 ts_tablet_manager.cc:1403] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.004s
I20260928 01:57:19.178378 23226 catalog_manager.cc:5063] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): tablet 1f9539f778114077b285d0fdc89d03e2 (table default.table_58bb4859bd884293a75a2560c92d8dda [id=743b81f3482b4ad5bc001e9e5d87edac]) successfully deleted
    @     0x7f480727caa2  std::__1::__function::__alloc_func<>::operator()() at ??:0
I20260928 01:57:19.174224 24268 raft_consensus.cc:385] T baa15f4cdf074b7797360c0981dfff4d P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:19.190513 24268 raft_consensus.cc:740] T baa15f4cdf074b7797360c0981dfff4d P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a3818d183894d038ea5871a360af375, State: Initialized, Role: FOLLOWER
I20260928 01:57:19.191419 24268 consensus_queue.cc:260] T baa15f4cdf074b7797360c0981dfff4d P 9a3818d183894d038ea5871a360af375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } }
I20260928 01:57:19.180065 24277 raft_consensus.cc:359] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:57:19.193569 23234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: Sending DeleteTablet for 3 replicas of tablet 8848edd1b0804f7ea69a80839d0b761e
I20260928 01:57:19.194084 24268 ts_tablet_manager.cc:1434] T baa15f4cdf074b7797360c0981dfff4d P 9a3818d183894d038ea5871a360af375: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260928 01:57:19.193092 24277 raft_consensus.cc:385] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:19.197384 23903 tablet_service.cc:1558] Processing DeleteTablet for tablet 8848edd1b0804f7ea69a80839d0b761e with delete_type TABLET_DATA_DELETED (replaced by tablet a3bcb3a4d4e04be5a785660dd1acce25) from {username='slave'} at 127.0.0.1:36274
I20260928 01:57:19.196841 23234 catalog_manager.cc:6934] ReplaceTablet: tablet 8848edd1b0804f7ea69a80839d0b761e deleted and replaced by tablet a3bcb3a4d4e04be5a785660dd1acce25
W20260928 01:57:19.199224 23226 catalog_manager.cc:5030] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): delete failed for tablet 8848edd1b0804f7ea69a80839d0b761e because the tablet was not found. No further retry: Not found: Tablet not found: 8848edd1b0804f7ea69a80839d0b761e
I20260928 01:57:19.196152 24277 raft_consensus.cc:740] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491712372a4f491f9ba8539837899e55, State: Initialized, Role: FOLLOWER
I20260928 01:57:19.201026 24277 consensus_queue.cc:260] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:57:19.204805 23598 tablet_service.cc:1558] Processing DeleteTablet for tablet 8848edd1b0804f7ea69a80839d0b761e with delete_type TABLET_DATA_DELETED (replaced by tablet a3bcb3a4d4e04be5a785660dd1acce25) from {username='slave'} at 127.0.0.1:37758
I20260928 01:57:19.205027 23810 heartbeater.cc:499] Master 127.18.161.62:36529 was elected leader, sending a full tablet report...
I20260928 01:57:19.206866 24267 tablet_replica.cc:333] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375: stopping tablet replica
I20260928 01:57:19.207638 24267 raft_consensus.cc:2243] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:19.208122 24267 raft_consensus.cc:2272] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:19.210305 24267 ts_tablet_manager.cc:1916] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:19.212694 24277 ts_tablet_manager.cc:1434] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
    @     0x7f480727bd9e  std::__1::__function::__func<>::operator()() at ??:0
    @           0x5bd4e5  std::__1::__function::__value_func<>::operator()() at ??:?
I20260928 01:57:19.216536 24277 tablet_bootstrap.cc:492] T baa15f4cdf074b7797360c0981dfff4d P 491712372a4f491f9ba8539837899e55: Bootstrap starting.
    @           0x5bd31a  std::__1::function<>::operator()() at ??:?
I20260928 01:57:19.222957 24277 tablet_bootstrap.cc:654] T baa15f4cdf074b7797360c0981dfff4d P 491712372a4f491f9ba8539837899e55: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:19.222299 23240 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 8048303ef62e4a52b5323fe35f42c7f1: Sending DeleteTablet for 3 replicas of tablet 746096ed34b9482184bd12363587f36f
I20260928 01:57:19.231067 23240 catalog_manager.cc:6934] ReplaceTablet: tablet 746096ed34b9482184bd12363587f36f deleted and replaced by tablet 5850698750d94a7a8c334368d248721f
I20260928 01:57:19.233064 23903 tablet_service.cc:1558] Processing DeleteTablet for tablet 746096ed34b9482184bd12363587f36f with delete_type TABLET_DATA_DELETED (replaced by tablet 5850698750d94a7a8c334368d248721f) from {username='slave'} at 127.0.0.1:36274
W20260928 01:57:19.235072 23226 catalog_manager.cc:5043] TS a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993): delete failed for tablet 746096ed34b9482184bd12363587f36f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 746096ed34b9482184bd12363587f36f already in progress: creating tablet
    @     0x7f47fe2dc81b  kudu::Thread::SuperviseThread() at ??:0
W20260928 01:57:19.237366 23240 catalog_manager.cc:5671] Ignoring report from unknown tablet 1f9539f778114077b285d0fdc89d03e2
    @           0x4569a0  __tsan_thread_start_func at ??:?
I20260928 01:57:19.243409 23741 tablet_service.cc:1558] Processing DeleteTablet for tablet 8848edd1b0804f7ea69a80839d0b761e with delete_type TABLET_DATA_DELETED (replaced by tablet a3bcb3a4d4e04be5a785660dd1acce25) from {username='slave'} at 127.0.0.1:50652
I20260928 01:57:19.244465 23741 tablet_service.cc:1558] Processing DeleteTablet for tablet 746096ed34b9482184bd12363587f36f with delete_type TABLET_DATA_DELETED (replaced by tablet 5850698750d94a7a8c334368d248721f) from {username='slave'} at 127.0.0.1:50652
I20260928 01:57:19.246315 23598 tablet_service.cc:1558] Processing DeleteTablet for tablet 746096ed34b9482184bd12363587f36f with delete_type TABLET_DATA_DELETED (replaced by tablet 5850698750d94a7a8c334368d248721f) from {username='slave'} at 127.0.0.1:37758
I20260928 01:57:19.249971 24266 ts_tablet_manager.cc:1434] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327: Time spent starting tablet: real 0.199s	user 0.012s	sys 0.004s
    @     0x7f47ffa3d6db  start_thread at ??:0
I20260928 01:57:19.256806 24266 tablet_bootstrap.cc:492] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327: Bootstrap starting.
    @     0x7f47fad8861f  clone at ??:0
I20260928 01:57:19.276422 24269 ts_tablet_manager.cc:1929] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 01:57:19.276842 24269 log.cc:1199] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/1f9539f778114077b285d0fdc89d03e2
I20260928 01:57:19.277638 24269 ts_tablet_manager.cc:1950] T 1f9539f778114077b285d0fdc89d03e2 P 491712372a4f491f9ba8539837899e55: Deleting consensus metadata
I20260928 01:57:19.277675 24266 tablet_bootstrap.cc:654] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327: Neither blocks nor log segments found. Creating new log.
I20260928 01:57:19.281723 24269 tablet_replica.cc:333] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55: stopping tablet replica
I20260928 01:57:19.283432 24269 raft_consensus.cc:2243] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:19.283955 24269 raft_consensus.cc:2272] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:19.284364 24267 ts_tablet_manager.cc:1929] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:19.284742 24267 log.cc:1199] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/8848edd1b0804f7ea69a80839d0b761e
I20260928 01:57:19.285048 24277 tablet_bootstrap.cc:492] T baa15f4cdf074b7797360c0981dfff4d P 491712372a4f491f9ba8539837899e55: No bootstrap required, opened a new log
I20260928 01:57:19.285380 24267 ts_tablet_manager.cc:1950] T 8848edd1b0804f7ea69a80839d0b761e P 9a3818d183894d038ea5871a360af375: Deleting consensus metadata
I20260928 01:57:19.285483 24277 ts_tablet_manager.cc:1403] T baa15f4cdf074b7797360c0981dfff4d P 491712372a4f491f9ba8539837899e55: Time spent bootstrapping tablet: real 0.072s	user 0.033s	sys 0.029s
I20260928 01:57:19.287927 24267 tablet_replica.cc:333] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375: stopping tablet replica
I20260928 01:57:19.288633 24267 raft_consensus.cc:2243] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 01:57:19.288652 24277 raft_consensus.cc:359] T baa15f4cdf074b7797360c0981dfff4d P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } }
I20260928 01:57:19.289182 24267 raft_consensus.cc:2272] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 01:57:19.289341 24277 raft_consensus.cc:385] T baa15f4cdf074b7797360c0981dfff4d P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:19.289594 24277 raft_consensus.cc:740] T baa15f4cdf074b7797360c0981dfff4d P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491712372a4f491f9ba8539837899e55, State: Initialized, Role: FOLLOWER
I20260928 01:57:19.290773 24277 consensus_queue.cc:260] T baa15f4cdf074b7797360c0981dfff4d P 491712372a4f491f9ba8539837899e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } }
I20260928 01:57:19.292915 24269 ts_tablet_manager.cc:1916] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:19.303408 24277 ts_tablet_manager.cc:1434] T baa15f4cdf074b7797360c0981dfff4d P 491712372a4f491f9ba8539837899e55: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260928 01:57:19.304592 24267 ts_tablet_manager.cc:1916] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 01:57:19.315174 24266 tablet_bootstrap.cc:492] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327: No bootstrap required, opened a new log
I20260928 01:57:19.315613 24266 ts_tablet_manager.cc:1403] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.000s
I20260928 01:57:19.318420 24266 raft_consensus.cc:359] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } }
I20260928 01:57:19.319146 24266 raft_consensus.cc:385] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 01:57:19.319428 24266 raft_consensus.cc:740] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Initialized, Role: FOLLOWER
I20260928 01:57:19.320120 24266 consensus_queue.cc:260] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } }
I20260928 01:57:19.330057 24269 ts_tablet_manager.cc:1929] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:19.330472 24269 log.cc:1199] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-1/wal/wals/746096ed34b9482184bd12363587f36f
I20260928 01:57:19.331146 24269 ts_tablet_manager.cc:1950] T 746096ed34b9482184bd12363587f36f P 491712372a4f491f9ba8539837899e55: Deleting consensus metadata
I20260928 01:57:19.334342 24267 ts_tablet_manager.cc:1929] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 01:57:19.334813 24267 log.cc:1199] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375: Deleting WAL directory at /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/ts-0/wal/wals/746096ed34b9482184bd12363587f36f
I20260928 01:57:19.335544 24267 ts_tablet_manager.cc:1950] T 746096ed34b9482184bd12363587f36f P 9a3818d183894d038ea5871a360af375: Deleting consensus metadata
I20260928 01:57:19.335584 24266 ts_tablet_manager.cc:1434] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260928 01:57:19.419258 24276 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:19.419848 24276 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:57:19.422219 24276 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:57:19.424906 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:57:19.425933 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:57:19.426399 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:57:19.427204 24276 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:57:19.517915 23699 connection.cc:573] server connection from 127.0.0.1:50652 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:57:19.518798 23550 connection.cc:573] server connection from 127.0.0.1:37758 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:57:19.519976 23982 connection.cc:573] client connection to 127.18.161.62:36529 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 01:57:19.521842 23982 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.18.161.62:36529)
W20260928 01:57:19.522559 23982 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.18.161.62:36529)
W20260928 01:57:19.523226 23982 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.18.161.62:36529)
W20260928 01:57:19.531584 23982 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.18.161.62:36529)
W20260928 01:57:19.539503 24289 negotiation.cc:336] Failed RPC negotiation. Trace:
0928 01:57:19.534586 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.18.161.62:36529 (local address 127.0.0.1:49332)
0928 01:57:19.535550 (+   964us) negotiation.cc:107] Waiting for socket to connect
0928 01:57:19.535593 (+    43us) client_negotiation.cc:175] Beginning negotiation
0928 01:57:19.536028 (+   435us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0928 01:57:19.538599 (+  2571us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":341}
I20260928 01:57:19.652936 24276 raft_consensus.cc:493] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:19.653481 24276 raft_consensus.cc:515] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } }
I20260928 01:57:19.655542 24276 leader_election.cc:290] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427), 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985)
I20260928 01:57:19.656538 23618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa15f4cdf074b7797360c0981dfff4d" candidate_uuid: "a0a57cbfb1f2438db0c398cf2786b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a3818d183894d038ea5871a360af375" is_pre_election: true
I20260928 01:57:19.656921 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa15f4cdf074b7797360c0981dfff4d" candidate_uuid: "a0a57cbfb1f2438db0c398cf2786b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491712372a4f491f9ba8539837899e55" is_pre_election: true
I20260928 01:57:19.657186 23618 raft_consensus.cc:2468] T baa15f4cdf074b7797360c0981dfff4d P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0a57cbfb1f2438db0c398cf2786b327 in term 0.
I20260928 01:57:19.657470 23763 raft_consensus.cc:2468] T baa15f4cdf074b7797360c0981dfff4d P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0a57cbfb1f2438db0c398cf2786b327 in term 0.
I20260928 01:57:19.658625 23861 leader_election.cc:304] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a3818d183894d038ea5871a360af375, a0a57cbfb1f2438db0c398cf2786b327; no voters: 
I20260928 01:57:19.659471 24276 raft_consensus.cc:2804] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 01:57:19.659825 24276 raft_consensus.cc:493] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 01:57:19.660158 24276 raft_consensus.cc:3060] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:19.670037 24276 raft_consensus.cc:515] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } }
I20260928 01:57:19.671990 24276 leader_election.cc:290] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 election: Requested vote from peers 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427), 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985)
I20260928 01:57:19.673403 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa15f4cdf074b7797360c0981dfff4d" candidate_uuid: "a0a57cbfb1f2438db0c398cf2786b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491712372a4f491f9ba8539837899e55"
I20260928 01:57:19.673426 23618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa15f4cdf074b7797360c0981dfff4d" candidate_uuid: "a0a57cbfb1f2438db0c398cf2786b327" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a3818d183894d038ea5871a360af375"
I20260928 01:57:19.674000 23618 raft_consensus.cc:3060] T baa15f4cdf074b7797360c0981dfff4d P 9a3818d183894d038ea5871a360af375 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:19.674002 23763 raft_consensus.cc:3060] T baa15f4cdf074b7797360c0981dfff4d P 491712372a4f491f9ba8539837899e55 [term 0 FOLLOWER]: Advancing to term 1
I20260928 01:57:19.681306 23618 raft_consensus.cc:2468] T baa15f4cdf074b7797360c0981dfff4d P 9a3818d183894d038ea5871a360af375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0a57cbfb1f2438db0c398cf2786b327 in term 1.
I20260928 01:57:19.681306 23763 raft_consensus.cc:2468] T baa15f4cdf074b7797360c0981dfff4d P 491712372a4f491f9ba8539837899e55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0a57cbfb1f2438db0c398cf2786b327 in term 1.
I20260928 01:57:19.683018 23861 leader_election.cc:304] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491712372a4f491f9ba8539837899e55, a0a57cbfb1f2438db0c398cf2786b327; no voters: 
I20260928 01:57:19.684243 24276 raft_consensus.cc:2804] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 01:57:19.686117 24276 raft_consensus.cc:697] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [term 1 LEADER]: Becoming Leader. State: Replica: a0a57cbfb1f2438db0c398cf2786b327, State: Running, Role: LEADER
I20260928 01:57:19.687660 24276 consensus_queue.cc:237] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } } peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } }
I20260928 01:57:19.727015 24293 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8048303ef62e4a52b5323fe35f42c7f1)
I20260928 01:57:19.727504 24293 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:19.729532 24293 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:57:19.735939 24156 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:57:19.737967 24157 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:19.738425 24157 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:19.739276 24293 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:57:20.350374 24297 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8048303ef62e4a52b5323fe35f42c7f1)
I20260928 01:57:20.350778 24297 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:20.352409 24297 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:57:20.357705 24156 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:57:20.358256 24157 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:20.358604 24157 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:20.359184 24297 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:57:20.408823 19076 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu with pid 24018
I20260928 01:57:20.502213 24302 consensus_queue.cc:1048] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:57:20.539479 24306 consensus_queue.cc:1048] T baa15f4cdf074b7797360c0981dfff4d P a0a57cbfb1f2438db0c398cf2786b327 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 01:57:21.022367 19076 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
/tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.60:34625
--webserver_interface=127.18.161.60
--webserver_port=40927
--builtin_ntp_servers=127.18.161.20:36379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--hive_metastore_uris=thrift://127.0.0.1:35181
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260928 01:57:21.361717 24317 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 01:57:21.362335 24317 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 01:57:21.362833 24317 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 01:57:21.399232 24317 flags.cc:432] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260928 01:57:21.399535 24317 flags.cc:432] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260928 01:57:21.399806 24317 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 01:57:21.400059 24317 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 01:57:21.400342 24317 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 01:57:21.400585 24317 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 01:57:21.445799 24317 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.161.20:36379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35181
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.161.60:34625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.161.60
--webserver_port=40927
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3b18f0139b1d21a072b7353269301fba16dca54e
build type FASTDEBUG
built by None at 28 Sep 2026 01:43:22 UTC on e7f111948823
build id 14034
TSAN enabled
I20260928 01:57:21.447221 24317 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 01:57:21.449038 24317 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 01:57:21.462792 24323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:57:21.465706 24324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 01:57:21.467850 24326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 01:57:21.467947 24317 server_base.cc:1061] running on GCE node
I20260928 01:57:22.653380 24317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 01:57:22.656313 24317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 01:57:22.657809 24317 hybrid_clock.cc:648] HybridClock initialized: now 1790560642657766 us; error 49 us; skew 500 ppm
I20260928 01:57:22.658800 24317 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 01:57:22.665870 24317 webserver.cc:533] Webserver started at http://127.18.161.60:40927/ using document root <none> and password file <none>
I20260928 01:57:22.666992 24317 fs_manager.cc:362] Metadata directory not provided
I20260928 01:57:22.667268 24317 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 01:57:22.677515 24317 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.002s	sys 0.005s
I20260928 01:57:22.682610 24342 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 01:57:22.683895 24317 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260928 01:57:22.684278 24317 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data,/tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
uuid: "8432e2c39e50435788e612e49a0045ed"
format_stamp: "Formatted at 2026-09-28 01:57:03 on dist-test-slave-lrdp"
I20260928 01:57:22.686643 24317 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 01:57:22.734748 24317 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260928 01:57:22.736452 24317 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 01:57:22.737010 24317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 01:57:22.810772 24317 rpc_server.cc:307] RPC server started. Bound to: 127.18.161.60:34625
I20260928 01:57:22.810904 24393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.161.60:34625 every 8 connection(s)
I20260928 01:57:22.813845 24317 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfkv_xo/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1790560503171620-19076-0/minicluster-data/master-2/data/info.pb
I20260928 01:57:22.822372 19076 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfkv_xo/build/tsan/bin/kudu as pid 24317
I20260928 01:57:22.830075 24394 sys_catalog.cc:263] Verifying existing consensus state
I20260928 01:57:22.838719 24394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Bootstrap starting.
I20260928 01:57:22.866704 24394 log.cc:826] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Log is configured to *not* fsync() on all Append() calls
I20260928 01:57:22.969596 24394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Bootstrap replayed 1/1 log segments. Stats: ops{read=40 overwritten=1 applied=39 ignored=0} inserts{seen=21 ignored=0} mutations{seen=36 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 01:57:22.970489 24394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: Bootstrap complete.
I20260928 01:57:22.988595 24394 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:22.990859 24394 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8432e2c39e50435788e612e49a0045ed, State: Initialized, Role: FOLLOWER
I20260928 01:57:22.991671 24394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 39, Last appended: 6.39, Last appended by leader: 39, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:22.994108 24399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } } }
I20260928 01:57:22.994820 24399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: This master's current role is: FOLLOWER
I20260928 01:57:22.995251 24394 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [sys.catalog]: configured and running, proceeding with master startup.
I20260928 01:57:23.055312 24413 catalog_manager.cc:1308] Loaded cluster ID: 277aae6cb6dd46069169192caa8b9479
I20260928 01:57:23.056322 24413 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: loading cluster ID for follower catalog manager: success
I20260928 01:57:23.075209 23808 heartbeater.cc:344] Connected to a master server at 127.18.161.60:34625
I20260928 01:57:23.104848 23663 heartbeater.cc:344] Connected to a master server at 127.18.161.60:34625
I20260928 01:57:23.029704 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:57:23.114199 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:57:23.114904 24420 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:23.115480 24420 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:57:23.117077 24359 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "491712372a4f491f9ba8539837899e55" instance_seqno: 1790560630417927) as {username='slave'} at 127.18.161.2:44251; Asking this server to re-register.
I20260928 01:57:23.117127 24358 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9a3818d183894d038ea5871a360af375" instance_seqno: 1790560628472462) as {username='slave'} at 127.18.161.1:41479; Asking this server to re-register.
I20260928 01:57:23.118269 24420 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
I20260928 01:57:23.120679 23663 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:23.121340 24413 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: acquiring CA information for follower catalog manager: success
W20260928 01:57:23.122206 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:57:23.123039 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:57:23.123492 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:57:23.124671 24420 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:57:23.125224 24358 ts_manager.cc:194] Registered new tserver with Master: 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
I20260928 01:57:23.126668 23808 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:23.128629 24413 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 01:57:23.130336 24358 ts_manager.cc:194] Registered new tserver with Master: 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985)
I20260928 01:57:23.148636 23970 heartbeater.cc:344] Connected to a master server at 127.18.161.60:34625
I20260928 01:57:23.154273 24358 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" instance_seqno: 1790560632908893) as {username='slave'} at 127.18.161.3:47579; Asking this server to re-register.
I20260928 01:57:23.156131 23970 heartbeater.cc:461] Registering TS with master...
I20260928 01:57:23.159730 24358 ts_manager.cc:194] Registered new tserver with Master: a0a57cbfb1f2438db0c398cf2786b327 (127.18.161.3:32993)
I20260928 01:57:23.458940 24399 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:23.459444 24399 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:23.462842 24399 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:57:23.466017 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:57:23.476400 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:57:23.477617 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:23.478104 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:23.479003 24399 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:57:24.169421 24431 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:24.170053 24431 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:24.176121 24431 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:57:24.182803 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:57:24.183269 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:24.183746 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:24.184794 24431 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:57:25.076154 24439 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:25.076649 24439 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:25.079303 24439 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:57:25.084364 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:57:25.085188 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:25.085634 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:25.086256 24439 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:57:25.334448 19076 master-stress-test.cc:579] Killing test thread 1/10
I20260928 01:57:26.004827 24451 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:26.005206 24451 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:26.006855 24451 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:57:26.012387 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 01:57:26.013165 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 01:57:26.013484 24345 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:26.014132 24451 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:57:27.250530 24470 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:27.251076 24470 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:27.252593 24470 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:57:27.257403 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:57:27.260121 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:27.260597 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:27.261201 24470 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:57:28.117400 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:57:28.117801 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:57:28.133616 24480 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:28.134058 24480 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:28.135939 24480 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:57:28.140630 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 01:57:28.141360 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 01:57:28.141886 24345 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:28.142699 24480 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:57:28.850972 24489 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:28.851431 24489 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:57:28.853080 24489 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:57:28.854918 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:57:28.855500 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:57:28.855793 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:57:28.856434 24489 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:57:31.156095 24502 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:31.156566 24502 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:31.158167 24502 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:57:31.160661 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 11 similar messages]
W20260928 01:57:31.164140 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 01:57:31.165292 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 01:57:31.165735 24345 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:31.166466 24502 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:57:33.121827 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:57:33.122295 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:57:33.609030 24528 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:33.609596 24528 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:33.611457 24528 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:57:33.616394 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:57:33.617384 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:57:33.617734 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:33.618429 24528 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:57:36.813874 24563 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:36.814433 24563 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:57:36.816825 24563 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:57:36.818696 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:57:36.819310 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:57:36.819595 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:57:36.820194 24563 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:57:38.125334 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:57:38.125717 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:57:43.129329 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:57:43.129833 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:57:45.339879 24609 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:45.340498 24609 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:57:45.342139 24609 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:57:45.344404 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260928 01:57:45.347563 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 01:57:45.348002 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 01:57:45.348335 24345 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:57:45.348969 24609 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:57:48.133802 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:57:48.134191 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:57:48.622974 24642 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:48.623579 24642 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:57:48.625581 24642 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:57:48.627158 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:57:48.627710 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:57:48.627985 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:57:48.628582 24642 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:57:53.138216 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:57:53.138692 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:57:58.142298 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:57:58.142727 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:57:59.291450 24730 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:57:59.292063 24730 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:57:59.294337 24730 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:57:59.296330 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:57:59.296898 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:57:59.297160 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:57:59.297783 24730 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:58:02.125680 24765 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:02.126327 24765 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:58:02.129114 24765 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:58:02.131989 24346 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 01:58:02.135196 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:58:02.135749 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:58:02.136067 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:58:02.136678 24765 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:58:03.145939 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:58:03.146479 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:58:05.204164 24797 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:05.204819 24797 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:58:05.206781 24797 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:58:05.208722 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:58:05.209386 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:58:05.209745 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:58:05.210407 24797 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:58:08.149729 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:58:08.150172 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:58:09.626648 24841 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:09.627240 24841 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:58:09.629065 24841 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:58:09.631052 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 01:58:09.634635 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:58:09.635201 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:58:09.635562 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:58:09.636132 24841 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:58:10.235227 24850 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:10.235693 24850 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:58:10.237680 24850 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:58:10.242630 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:58:10.243242 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:58:10.243553 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:58:10.244107 24850 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:58:13.154253 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:58:13.154762 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 01:58:13.561168 23971 heartbeater.cc:646] Failed to heartbeat to 127.18.161.61:43177 (120 consecutive failures): Network error: Failed to ping master at 127.18.161.61:43177: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 01:58:13.613505 23804 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7920 after lost signal to thread 23676
W20260928 01:58:13.614745 23804 debug-util.cc:398] Leaking SignalData structure 0x7b0800042f60 after lost signal to thread 23807
W20260928 01:58:13.829629 23665 heartbeater.cc:646] Failed to heartbeat to 127.18.161.62:36529 (110 consecutive failures): Network error: Failed to ping master at 127.18.161.62:36529: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:58:13.971505 23810 heartbeater.cc:646] Failed to heartbeat to 127.18.161.62:36529 (110 consecutive failures): Network error: Failed to ping master at 127.18.161.62:36529: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 01:58:15.511446 24894 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:15.512076 24894 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:58:15.514314 24894 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:58:15.516537 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:58:15.517251 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:58:15.517593 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:58:15.518357 24894 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:58:18.158018 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:58:18.158445 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 01:58:19.224488 23804 debug-util.cc:398] Leaking SignalData structure 0x7b08000d64a0 after lost signal to thread 23676
W20260928 01:58:19.225921 23804 debug-util.cc:398] Leaking SignalData structure 0x7b08000ccf60 after lost signal to thread 23807
W20260928 01:58:21.355077 24390 debug-util.cc:398] Leaking SignalData structure 0x7b0800076620 after lost signal to thread 24318
W20260928 01:58:21.355693 24390 debug-util.cc:398] Leaking SignalData structure 0x7b08000707a0 after lost signal to thread 24393
I20260928 01:58:23.232573 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:58:23.233076 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:58:27.252771 24956 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:27.253270 24956 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:58:27.255472 24956 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:58:27.258119 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260928 01:58:27.261893 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:58:27.262526 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:58:27.262854 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:58:27.263423 24956 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:58:28.236667 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:58:28.237063 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:58:28.623867 24968 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:28.624531 24968 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:58:28.626351 24968 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:58:28.628063 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:58:28.628638 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:58:28.628892 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:58:28.629444 24968 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:58:31.034682 23966 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4a40 after lost signal to thread 23821
W20260928 01:58:31.036468 23966 debug-util.cc:398] Leaking SignalData structure 0x7b08000b71e0 after lost signal to thread 23969
I20260928 01:58:31.754762 24987 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:31.755386 24987 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:58:31.757505 24987 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:58:31.763906 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:58:31.764501 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:58:31.764797 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:58:31.765439 24987 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:58:33.240707 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:58:33.241264 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 01:58:33.712886 23966 debug-util.cc:398] Leaking SignalData structure 0x7b08000cf160 after lost signal to thread 23821
W20260928 01:58:33.713734 23966 debug-util.cc:398] Leaking SignalData structure 0x7b08000423a0 after lost signal to thread 23969
I20260928 01:58:38.244686 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:58:38.245108 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:58:38.346161 25024 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:38.346712 25024 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:58:38.349009 25024 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:58:38.350798 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:58:38.351293 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:58:38.351521 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:58:38.352075 25024 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:58:39.085480 25030 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:39.086005 25030 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:58:39.087785 25030 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:58:39.090081 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260928 01:58:39.093760 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:58:39.094244 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:58:39.094599 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:58:39.095141 25030 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:58:43.249281 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:58:43.249922 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:58:48.253119 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:58:48.253605 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:58:48.650468 25086 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:48.650995 25086 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:58:48.653019 25086 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:58:48.654343 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 01:58:48.658187 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 01:58:48.658740 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 01:58:48.659039 24345 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:58:48.659723 25086 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:58:48.787784 25069 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:48.788391 25069 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:58:48.790580 25069 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:58:48.792491 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:58:48.793167 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:58:48.793412 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:58:48.793934 25069 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 01:58:50.036422 23966 debug-util.cc:398] Leaking SignalData structure 0x7b08000cc900 after lost signal to thread 23821
W20260928 01:58:50.037357 23966 debug-util.cc:398] Leaking SignalData structure 0x7b08000cd940 after lost signal to thread 23969
I20260928 01:58:53.257915 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:58:53.258525 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:58:53.511379 25114 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:58:53.511965 25114 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:58:53.514520 25114 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:58:53.516073 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:58:53.516644 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:58:53.516883 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:58:53.517465 25114 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:58:58.262005 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:58:58.262401 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 01:58:59.133177 23659 debug-util.cc:398] Leaking SignalData structure 0x7b08000e1020 after lost signal to thread 23510
W20260928 01:58:59.134320 23659 debug-util.cc:398] Leaking SignalData structure 0x7b0800042460 after lost signal to thread 23662
I20260928 01:59:02.634886 25168 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:59:02.635627 25168 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:59:02.637683 25168 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:59:02.639605 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:59:02.640159 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:59:02.640453 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:59:02.641048 25168 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:59:03.266463 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:59:03.267037 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:59:04.088948 25177 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:59:04.089466 25177 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:59:04.091764 25177 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:59:04.094345 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 01:59:04.097702 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:59:04.098309 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:59:04.098613 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:59:04.099208 25177 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:59:08.271039 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:59:08.271489 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:59:11.267218 25220 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:59:11.268061 25220 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:59:11.270699 25220 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:59:11.273180 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:59:11.273957 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:59:11.274322 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:59:11.275094 25220 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:59:13.275957 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:59:13.276615 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 01:59:13.850060 23971 heartbeater.cc:646] Failed to heartbeat to 127.18.161.61:43177 (240 consecutive failures): Network error: Failed to ping master at 127.18.161.61:43177: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 01:59:14.111907 23665 heartbeater.cc:646] Failed to heartbeat to 127.18.161.62:36529 (230 consecutive failures): Network error: Failed to ping master at 127.18.161.62:36529: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:59:14.430845 23809 heartbeater.cc:646] Failed to heartbeat to 127.18.161.61:43177 (242 consecutive failures): Network error: Failed to ping master at 127.18.161.61:43177: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:59:18.280009 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:59:18.280438 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:59:22.681299 25288 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:59:22.681881 25288 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:59:22.684607 25288 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:59:22.687268 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 01:59:22.690217 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 01:59:22.690701 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 01:59:22.691039 24345 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:59:22.691612 25288 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:59:23.073971 24348 maintenance_manager.cc:419] P 8432e2c39e50435788e612e49a0045ed: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033356
I20260928 01:59:23.165292 24347 maintenance_manager.cc:643] P 8432e2c39e50435788e612e49a0045ed: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.090s	user 0.042s	sys 0.019s Metrics: {"bytes_written":11620,"cfile_init":1,"drs_written":1,"lbm_read_time_us":221,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2524,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"rows_written":21,"thread_start_us":1330,"threads_started":1,"wal-append.queue_time_us":1676}
I20260928 01:59:23.167869 24348 maintenance_manager.cc:419] P 8432e2c39e50435788e612e49a0045ed: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1157 bytes on disk
I20260928 01:59:23.169703 24347 maintenance_manager.cc:643] P 8432e2c39e50435788e612e49a0045ed: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":266,"lbm_reads_lt_1ms":4}
I20260928 01:59:23.284004 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:59:23.284582 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:59:27.845449 25325 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:59:27.846065 25325 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:59:27.848171 25325 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:59:27.850095 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:59:27.850643 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:59:27.850905 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:59:27.851544 25325 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:59:28.287874 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:59:28.288359 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 01:59:29.153756 23659 debug-util.cc:398] Leaking SignalData structure 0x7b08000bcf20 after lost signal to thread 23510
W20260928 01:59:29.154765 23659 debug-util.cc:398] Leaking SignalData structure 0x7b08000d10c0 after lost signal to thread 23662
I20260928 01:59:32.765089 25377 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:59:32.765671 25377 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:59:32.767805 25377 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:59:32.771055 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 01:59:32.775192 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 01:59:32.775710 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 01:59:32.776064 24345 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:59:32.776798 25377 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:59:33.291525 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:59:33.291989 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:59:35.741235 25410 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:59:35.741632 25410 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:59:35.743291 25410 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:59:35.748871 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:59:35.749326 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:59:35.749652 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:59:35.750248 25410 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:59:38.295064 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:59:38.295444 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:59:38.711624 25436 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:59:38.712368 25436 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:59:38.714097 25436 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:59:38.715801 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:59:38.716329 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:59:38.716569 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:59:38.717128 25436 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:59:43.299270 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:59:43.299815 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:59:45.566063 25503 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:59:45.566712 25503 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 01:59:45.569095 25503 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 01:59:45.570850 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 01:59:45.571496 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 01:59:45.571811 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 01:59:45.572636 25503 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 01:59:45.998052 25508 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 01:59:45.998519 25508 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 01:59:46.000568 25508 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 01:59:46.002569 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260928 01:59:46.005797 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 01:59:46.006332 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 01:59:46.006616 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 01:59:46.007191 25508 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 01:59:48.303097 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:59:48.303536 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 01:59:53.010107 24390 debug-util.cc:398] Leaking SignalData structure 0x7b080004f360 after lost signal to thread 24318
W20260928 01:59:53.010787 24390 debug-util.cc:398] Leaking SignalData structure 0x7b0800078c60 after lost signal to thread 24393
I20260928 01:59:53.330583 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:59:53.331154 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 01:59:58.334700 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 01:59:58.335129 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 02:00:00.512430 23966 debug-util.cc:398] Leaking SignalData structure 0x7b08000bcf20 after lost signal to thread 23821
W20260928 02:00:00.513451 23966 debug-util.cc:398] Leaking SignalData structure 0x7b0800041900 after lost signal to thread 23969
I20260928 02:00:02.181159 25660 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:00:02.182241 25660 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 02:00:02.185108 25660 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 02:00:02.186905 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 02:00:02.187630 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 02:00:02.187985 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 02:00:02.188824 25663 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 02:00:03.339407 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:00:03.340037 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 02:00:05.568560 23804 debug-util.cc:398] Leaking SignalData structure 0x7b08000be2c0 after lost signal to thread 23676
W20260928 02:00:05.569583 23804 debug-util.cc:398] Leaking SignalData structure 0x7b08000417e0 after lost signal to thread 23807
I20260928 02:00:05.955700 25699 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:00:05.956267 25699 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 02:00:05.959000 25699 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 02:00:05.961329 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 02:00:05.964195 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 02:00:05.964705 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 02:00:05.965083 24345 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 02:00:05.965701 25699 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 02:00:08.343055 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:00:08.343482 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:00:09.636864 25733 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:00:09.637318 25733 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 02:00:09.639083 25733 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 02:00:09.640779 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 02:00:09.641341 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 02:00:09.641599 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 02:00:09.642162 25733 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 02:00:13.347394 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:00:13.347934 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 02:00:14.138069 23971 heartbeater.cc:646] Failed to heartbeat to 127.18.161.61:43177 (360 consecutive failures): Network error: Failed to ping master at 127.18.161.61:43177: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 02:00:14.401369 23665 heartbeater.cc:646] Failed to heartbeat to 127.18.161.62:36529 (350 consecutive failures): Network error: Failed to ping master at 127.18.161.62:36529: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 02:00:14.861654 23810 heartbeater.cc:646] Failed to heartbeat to 127.18.161.62:36529 (350 consecutive failures): Network error: Failed to ping master at 127.18.161.62:36529: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 02:00:15.062537 25785 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:00:15.063318 25785 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 02:00:15.065730 25785 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 02:00:15.069113 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 02:00:15.072665 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 02:00:15.073388 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 02:00:15.073781 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 02:00:15.074559 25785 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 02:00:18.351300 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:00:18.351656 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:00:23.355509 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:00:23.356006 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:00:27.770717 25903 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:00:27.771314 25903 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 02:00:27.773773 25903 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 02:00:27.775617 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 02:00:27.776181 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 02:00:27.776499 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 02:00:27.777170 25903 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 02:00:28.028055 25906 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:00:28.028596 25906 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 02:00:28.030318 25906 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 02:00:28.032382 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 02:00:28.035375 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 02:00:28.035801 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 02:00:28.036095 24345 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 02:00:28.036715 25906 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 02:00:28.358547 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:00:28.359048 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:00:33.362896 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:00:33.363343 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:00:37.054561 25986 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:00:37.055166 25986 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 02:00:37.057403 25986 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 02:00:37.059639 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 02:00:37.060566 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 02:00:37.061015 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 02:00:37.061795 25986 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 02:00:38.366607 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:00:38.367060 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:00:43.370957 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:00:43.371443 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:00:43.590992 26043 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:00:43.591652 26043 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 02:00:43.594708 26043 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 02:00:43.596462 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 02:00:43.600220 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 02:00:43.600870 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 02:00:43.601163 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 02:00:43.601768 26043 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260928 02:00:43.627015 23966 debug-util.cc:398] Leaking SignalData structure 0x7b0800042f80 after lost signal to thread 23821
W20260928 02:00:43.628014 23966 debug-util.cc:398] Leaking SignalData structure 0x7b08000bdbe0 after lost signal to thread 23969
I20260928 02:00:45.536787 26061 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:00:45.537184 26061 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 02:00:45.538790 26061 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 02:00:45.543308 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 02:00:45.543653 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 02:00:45.543926 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 02:00:45.544548 26061 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 02:00:48.374327 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:00:48.374699 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:00:49.404229 26099 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:00:49.404726 26099 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 02:00:49.406389 26099 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 02:00:49.408635 24346 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260928 02:00:49.411932 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 02:00:49.412474 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 02:00:49.412771 24345 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 02:00:49.413281 26099 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 02:00:50.838873 26115 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:00:50.839426 26115 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 02:00:50.841416 26115 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 02:00:50.843139 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 02:00:50.843643 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 02:00:50.843875 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 02:00:50.844457 26115 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 02:00:53.378484 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:00:53.378965 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 02:00:54.510795 24390 debug-util.cc:398] Leaking SignalData structure 0x7b0800070300 after lost signal to thread 24318
W20260928 02:00:54.511356 24390 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2cc0 after lost signal to thread 24393
W20260928 02:00:55.378569 23659 debug-util.cc:398] Leaking SignalData structure 0x7b08000bff80 after lost signal to thread 23510
W20260928 02:00:55.379592 23659 debug-util.cc:398] Leaking SignalData structure 0x7b08000417e0 after lost signal to thread 23662
I20260928 02:00:58.418483 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:00:58.418953 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:01:02.242128 26217 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:01:02.243420 26217 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 02:01:02.245893 26217 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 02:01:02.247900 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 02:01:02.248584 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 02:01:02.248857 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 02:01:02.249446 26217 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 02:01:03.422942 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:01:03.423496 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:01:08.152622 26268 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:01:08.153134 26268 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 02:01:08.155207 26268 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 02:01:08.157614 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 02:01:08.161490 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 02:01:08.162081 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 02:01:08.162405 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 02:01:08.163168 26268 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 02:01:08.426276 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:01:08.426700 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:01:13.456758 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:01:13.457212 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 02:01:13.765383 24390 debug-util.cc:398] Leaking SignalData structure 0x7b0800070400 after lost signal to thread 24318
W20260928 02:01:13.765985 24390 debug-util.cc:398] Leaking SignalData structure 0x7b0800070640 after lost signal to thread 24393
W20260928 02:01:14.416734 23971 heartbeater.cc:646] Failed to heartbeat to 127.18.161.61:43177 (480 consecutive failures): Network error: Failed to ping master at 127.18.161.61:43177: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 02:01:14.681880 23665 heartbeater.cc:646] Failed to heartbeat to 127.18.161.62:36529 (470 consecutive failures): Network error: Failed to ping master at 127.18.161.62:36529: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 02:01:15.272110 23810 heartbeater.cc:646] Failed to heartbeat to 127.18.161.62:36529 (470 consecutive failures): Network error: Failed to ping master at 127.18.161.62:36529: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 02:01:16.339294 26341 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:01:16.339850 26341 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 02:01:16.341902 26341 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 02:01:16.343564 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 02:01:16.344110 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 02:01:16.344444 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 02:01:16.345074 26341 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 02:01:18.460285 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:01:18.460750 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:01:21.322113 26385 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:01:21.322603 26385 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
W20260928 02:01:21.328806 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260928 02:01:21.334321 26385 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 02:01:21.340022 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 02:01:21.341974 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 02:01:21.342288 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 02:01:21.343011 26385 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 02:01:23.464434 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:01:23.464920 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:01:26.211933 26430 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:01:26.212448 26430 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 02:01:26.214102 26430 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 02:01:26.219736 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 02:01:26.220305 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 02:01:26.220635 24345 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 02:01:26.221227 26430 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 02:01:28.468052 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:01:28.468495 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 02:01:29.703296 23804 debug-util.cc:398] Leaking SignalData structure 0x7b08000d06e0 after lost signal to thread 23676
W20260928 02:01:29.704870 23804 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5cc0 after lost signal to thread 23807
I20260928 02:01:33.472048 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:01:33.472618 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:01:35.275916 26512 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:01:35.276547 26512 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 02:01:35.278788 26512 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 02:01:35.280503 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 02:01:35.281032 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 02:01:35.281286 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 02:01:35.281821 26512 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 02:01:38.312983 26536 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:01:38.313545 26536 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 02:01:38.315299 26536 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 02:01:38.317592 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260928 02:01:38.320698 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 02:01:38.321074 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
I20260928 02:01:38.321368 24345 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 02:01:38.321969 26536 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 02:01:38.474916 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:01:38.475309 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:01:43.479075 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:01:43.479553 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:01:48.077896 26616 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:01:48.078522 26616 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 02:01:48.080407 26616 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 02:01:48.082535 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 02:01:48.083243 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 02:01:48.083573 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 02:01:48.084184 26616 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 02:01:48.482609 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:01:48.483055 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:01:52.947531 26659 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:01:52.948324 26659 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 02:01:52.950202 26659 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 02:01:52.952873 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 02:01:52.956597 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 02:01:52.957180 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 02:01:52.957504 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 02:01:52.958081 26659 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 02:01:53.486421 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:01:53.486874 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 02:01:57.985406 23804 debug-util.cc:398] Leaking SignalData structure 0x7b08000da4c0 after lost signal to thread 23676
W20260928 02:01:57.986374 23804 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2e40 after lost signal to thread 23807
I20260928 02:01:58.490011 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:01:58.490376 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:01:59.681270 26715 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:01:59.681838 26715 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 02:01:59.684540 26715 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 02:01:59.686533 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 02:01:59.687115 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 02:01:59.687521 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 02:01:59.688146 26715 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 02:02:03.494359 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:02:03.494908 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:02:04.085899 26754 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:02:04.086402 26754 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8048303ef62e4a52b5323fe35f42c7f1" member_type: VOTER last_known_addr { host: "127.18.161.62" port: 36529 } } peers { permanent_uuid: "da14a75a1a5a4cf99b25bd57d7e16148" member_type: VOTER last_known_addr { host: "127.18.161.61" port: 43177 } } peers { permanent_uuid: "8432e2c39e50435788e612e49a0045ed" member_type: VOTER last_known_addr { host: "127.18.161.60" port: 34625 } }
I20260928 02:02:04.088340 26754 leader_election.cc:290] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529), da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177)
W20260928 02:02:04.090271 24345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260928 02:02:04.093623 24345 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8048303ef62e4a52b5323fe35f42c7f1 (127.18.161.62:36529): Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111)
W20260928 02:02:04.094242 24346 leader_election.cc:336] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer da14a75a1a5a4cf99b25bd57d7e16148 (127.18.161.61:43177): Network error: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 02:02:04.094585 24346 leader_election.cc:304] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8432e2c39e50435788e612e49a0045ed; no voters: 8048303ef62e4a52b5323fe35f42c7f1, da14a75a1a5a4cf99b25bd57d7e16148
I20260928 02:02:04.095186 26754 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8432e2c39e50435788e612e49a0045ed [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260928 02:02:08.498127 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:02:08.498535 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:02:12.865828 26825 raft_consensus.cc:493] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 02:02:12.866437 26825 raft_consensus.cc:515] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491712372a4f491f9ba8539837899e55" member_type: VOTER last_known_addr { host: "127.18.161.2" port: 36985 } } peers { permanent_uuid: "a0a57cbfb1f2438db0c398cf2786b327" member_type: VOTER last_known_addr { host: "127.18.161.3" port: 32993 } } peers { permanent_uuid: "9a3818d183894d038ea5871a360af375" member_type: VOTER last_known_addr { host: "127.18.161.1" port: 38427 } }
I20260928 02:02:12.868428 26825 leader_election.cc:290] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985), 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427)
W20260928 02:02:12.870400 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491712372a4f491f9ba8539837899e55 (127.18.161.2:36985): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
W20260928 02:02:12.871110 23861 leader_election.cc:343] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a3818d183894d038ea5871a360af375 (127.18.161.1:38427): Not found: Tablet not found: 746096ed34b9482184bd12363587f36f
I20260928 02:02:12.871464 23861 leader_election.cc:304] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0a57cbfb1f2438db0c398cf2786b327; no voters: 491712372a4f491f9ba8539837899e55, 9a3818d183894d038ea5871a360af375
I20260928 02:02:12.872043 26825 raft_consensus.cc:2749] T 746096ed34b9482184bd12363587f36f P a0a57cbfb1f2438db0c398cf2786b327 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 02:02:13.502185 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:02:13.502650 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260928 02:02:13.547410 23804 debug-util.cc:398] Leaking SignalData structure 0x7b08000c32a0 after lost signal to thread 23676
W20260928 02:02:13.548316 23804 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3080 after lost signal to thread 23807
W20260928 02:02:14.692629 23971 heartbeater.cc:646] Failed to heartbeat to 127.18.161.61:43177 (600 consecutive failures): Network error: Failed to ping master at 127.18.161.61:43177: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 02:02:14.963124 23664 heartbeater.cc:646] Failed to heartbeat to 127.18.161.61:43177 (602 consecutive failures): Network error: Failed to ping master at 127.18.161.61:43177: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
W20260928 02:02:15.696489 23809 heartbeater.cc:646] Failed to heartbeat to 127.18.161.61:43177 (602 consecutive failures): Network error: Failed to ping master at 127.18.161.61:43177: Client connection negotiation failed: client connection to 127.18.161.61:43177: connect: Connection refused (error 111)
I20260928 02:02:18.505767 24317 master_runner.cc:187] Error getting master registration for 127.18.161.62:36529: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: connect: Connection refused (error 111), 
I20260928 02:02:18.506160 24317 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 02:02:19.390842 24348 maintenance_manager.cc:419] P 8432e2c39e50435788e612e49a0045ed: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1157 bytes on disk
I20260928 02:02:19.404618 24347 maintenance_manager.cc:643] P 8432e2c39e50435788e612e49a0045ed: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.013s	user 0.008s	sys 0.004s Metrics: {"dirs.queue_time_us":1147,"dirs.run_cpu_time_us":350,"dirs.run_wall_time_us":351,"thread_start_us":1237,"threads_started":2,"wal-append.queue_time_us":879}
W20260928 02:02:20.212123 23981 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625, num_attempts: 769) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 02:02:20.212649 23981 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625, num_attempts: 769) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 02:02:20.212926 23981 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625, num_attempts: 769) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 02:02:20.213382 23981 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625, num_attempts: 769) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20260928 02:02:20.224874 23992 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625, num_attempts: 769) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20260928 02:02:20.225214 23994 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625, num_attempts: 769) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
*** Aborted at 1790560940 (unix time) try "date -d @1790560940" if you are using GNU date ***
*** Check failure stack trace: ***
PC: @                0x0 (unknown)
*** SIGABRT (@0x3e800004a84) received by PID 19076 (TID 0x7f4db14fa700) from PID 19076; stack trace: ***
    @           0x2b0620 __tsan::CallUserSignalHandler() at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
    @           0x2b2b03 rtl_sigaction() at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:2005
    @     0x7f4dc4d8a980 (unknown) at ??:0
    @     0x7f4dbff34e87 gsignal at ??:0
    @     0x7f4dbff367f1 abort at ??:0
    @           0x2b6416 __interceptor_abort at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:263
    @     0x7f4dc2fd2d74 google::LogMessage::SendToLog() at ??:0
    @     0x7f4dc2fd3920 google::LogMessage::Flush() at ??:0
    @     0x7f4dc2fd8a5b google::LogMessageFatal::~LogMessageFatal() at ??:0
    @           0x35ea36 kudu::MasterStressTest::AlterTableThread() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/master-stress-test.cc:?
    @           0x38bc3e _ZNSt3__18__invokeIMN4kudu16MasterStressTestEFvvEPNS1_26MasterStressTest_Test_TestEJEvEEDTcldsdeclsr3std3__1E7forwardIT0_Efp0_Efp_spclsr3std3__1E7forwardIT1_Efp1_EEEOT_OS7_DpOS8_ at /home/jenkins-slave/workspace/build_and_test_flaky@2/thirdparty/installed/tsan/include/c++/v1/type_traits:3846
    @           0x38baf1 _ZNSt3__116__thread_executeINS_10unique_ptrINS_15__thread_structENS_14default_deleteIS2_EEEEMN4kudu16MasterStressTestEFvvEJPNS6_26MasterStressTest_Test_TestEEJLm2EEEEvRNS_5tupleIJT_T0_DpT1_EEENS_15__tuple_indicesIJXspT2_EEEE at /home/jenkins-slave/workspace/build_and_test_flaky@2/thirdparty/installed/tsan/include/c++/v1/thread:281
    @           0x38b23b std::__1::__thread_proxy<>() at /home/jenkins-slave/workspace/build_and_test_flaky@2/thirdparty/installed/tsan/include/c++/v1/thread:?
    @           0x2b04e0 __tsan_thread_start_func at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:959
    @     0x7f4dc4d7f6db start_thread at ??:0
F20260928 02:02:20.225214 23994 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625, num_attempts: 769) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)F000F20260928 02:02:20.243860 23996 master-stress-test.cc:330] 000F20260928 02:02:20.244930 23997 master-stress-test.cc:330] 000F20260928 02:02:20.245910 23993 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.18.161.62:36529,127.18.161.61:43177,127.18.161.60:34625, num_attempts: 769) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.18.161.62:36529: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
    @     0x7f4dc001761f clone at ??:0